Mobile Perception Lab
Welcome to the website of the Mobile Perception Lab led by Prof. Laurent Kneip. Our lab was founded in September 2017 and is part of the School of Information Science and Technology (SIST) at ShanghaiTech.
Our mission is to develop next-generation 3D perception systems for mobile applications, such as robotics, intelligent vehicles, or augmented reality. We focus on using cameras as a primary sensing modality. Through our research, we hope to provide machines with robust, accurate, and efficient scene understanding capabilities, where the generated models cover all aspects reaching from low-level geometry to higher level scene composition, dynamics, and semantic meaning. We achieve this goal by combining both classical, model-based and modern, data-driven techniques. We furthermore explore the potential of novel camera architectures, such as multi-perspective camera arrays, light-field cameras, and event-based sensors. Feel free to explore this webpage to learn more about what we are doing.
MPL is part of the ShanghaiTech Automation and Robotics Center (STAR Center).
July 26th, 2020
Laurent Kneip is an area chair of 3DV 2020 and CVPR 2021!
July 25th, 2020
Laurent Kneip giving a commencement address at the 2020 ShanghaiTech graduation ceremony ... in Chinese!
Please check-out the link here
July 7th, 2020
Excited to announce the first fruits of our work on event based cameras!
MPL just got one paper accepted for ECCV'2020. The paper is called "Globally-Optimal Event Camera Motion Estimation", and it is the first globally optimal solution to continuous motion estimation with an event camera mouned on an AGV.
June 16th, 2020
New publications at ICRA and CVPR!
MPL has had a very successful start into the new year 2020, with a hattrick at ICRA and two publications at CVPR.
May 21st, 2020
Congratulations to Cao Yuchen (Joshua) and Yu Peihong for successfully defending their graduation thesis.
This is a special moment, Cao Yuchen is the first graduate student since the debut of our lab at ShanghaiTech. Please also check out our new alumni section under the people's page, where you will be able to see the faith of past MPL members and collaborators.
August 16, 2019
Laurent Kneip and MPL receive a grant from the International Young Scientist Program from the National Science Foundation of China.
The award apends to another grant received earlier this year from the General Program of the 'Shanghai Innovation in Science and Technology' Natural Science Foundation, and will further support our research on semantic, higher-level SLAM.
July 30, 2019
Paper accepted for 3DV'19
Our innovative application of an aritificial neural network to improve the numerical stability of Groebner basis solvers will be presented orally at 3DV in Quebec City, Canada.
June 24, 2019
New graduate student
Welcome Ling Gao to join MPL, one of ShanghaiTech's own outstanding undergraduate students.
June 20, 2019
Paper accepted for IROS'19
We have an exciting contribution on "articulated" multi-perspective cameras accepted for IROS'19. The case enables motion estimation with non-overlapping cameras distributed over a truck, i.e. tractor and trailor, and handles the fact that these two bodies are moving w.r.t. to each other.
March 28, 2019
Welcoming new members to the group
Welcome Dr Min Li, who is starting as a Research Assistant Professor at MPL. Also welcome Li Cui, who will start as a graduate student at MPL in 2019.
March 12, 2019
Two papers accepted to CVPR'19!
Special congratulations to Huang Kun from MPL on this fine achievement!
February 26, 2019
Congratulations to Dr Zhou Yi!
The first PhD student working under the supervision of Prof Laurent Kneip officially graduated.
January 27, 2019
Laurent Kneip at an NII Shonan meeting
Laurent Kneip was an invited speaker at an NII Shonan meetings on optimization in computer vision, and presented MPL's latest research achievements.
Good start into 2019!
Check out our new contributions to TPAMI and TRO!
TPAMI paper "Minimal case relative pose computation using ray-point-ray features" presents new insights on two-view geometry. TRO paper "Canny-VO: Visual Odometry with RGB-D Cameras based on Geometric 3D-2D Edge Alignment" summarizes our long efforts on semi-dense motion estimation for RGBD cameras.
November 5, 2018
1st prize at the IEEE Australia Postgraduate Student Paper Competition.
September 15, 2018
New graduate student
Welcome Xu Wanting from Xinjiang University to join MPL.
July 9, 2018
ECCV paper on event-based vision accepted!
The fruits of our collaboration with RPG from University of Zurich.
June 25, 2018
New PhD student
Peng Xin from CAS has joined MPL as a new PhD student. Welcome to the team!
June 14, 2018
PAMI paper accepted
Our paper on globally optimal correspondence-less camera resectioning winning a Marr Prize Honourable Mention has been accepted to PAMI!.
March 30, 2018
Oral at CVPR'18!
Our work on globally optimal, non-minimal calibrated relative pose will be presented orally at CVPR'18.
March 23, 2018
New graduate student
Welcome Zhanpeng Ouyang from Nanchang University to join our team!
March 23, 2018
MPL web presence goes live!
We are excited to get started, and here is where you will be able to check out on our progress as we go. We'd love to get feedback from you!
Marr Prize Honourable Mention
Our ICCV'17 work "Globally-Optimal Inlier Set Maximisation for Simultaneous Camera Pose and Feature Correspondence" received a Marr Prize Honourable Mention! The Marr Prize is the most prestigious best paper award in the computer vision community.