Mobile Perception Lab

Welcome to the website of the Mobile Perception Lab led by Prof. Laurent Kneip. Our lab was founded in September 2017 and is part of the School of Information Science and Technology (SIST) at ShanghaiTech.

MPL members




Our mission is to develop next-generation 3D perception systems for mobile applications, such as robotics, intelligent vehicles, or augmented reality. We focus on using cameras as a primary sensing modality. Through our research, we hope to provide machines with robust, accurate, and efficient scene understanding capabilities, where the generated models cover all aspects reaching from low-level geometry to higher level scene composition, dynamics, and semantic meaning. We achieve this goal by combining both classical, model-based and modern, data-driven techniques. We furthermore explore the potential of novel camera architectures, such as multi-perspective camera arrays, light-field cameras, and event-based sensors. Feel free to explore this webpage to learn more about what we are doing.


MPL is part of the ShanghaiTech Automation and Robotics Center (STAR Center).

News

July 26th, 2020

Laurent Kneip is an area chair of 3DV 2020 and CVPR 2021!


July 25th, 2020

Laurent Kneip giving a commencement address at the 2020 ShanghaiTech graduation ceremony ... in Chinese!

Please check-out the link here


July 7th, 2020

Excited to announce the first fruits of our work on event based cameras!

MPL just got one paper accepted for ECCV'2020. The paper is called "Globally-Optimal Event Camera Motion Estimation", and it is the first globally optimal solution to continuous motion estimation with an event camera mouned on an AGV.


June 16th, 2020

New publications at ICRA and CVPR!

MPL has had a very successful start into the new year 2020, with a hattrick at ICRA and two publications at CVPR.


May 21st, 2020

Congratulations to Cao Yuchen (Joshua) and Yu Peihong for successfully defending their graduation thesis.

This is a special moment, Cao Yuchen is the first graduate student since the debut of our lab at ShanghaiTech. Please also check out our new alumni section under the people's page, where you will be able to see the faith of past MPL members and collaborators.


August 16, 2019

Laurent Kneip and MPL receive a grant from the International Young Scientist Program from the National Science Foundation of China.

The award apends to another grant received earlier this year from the General Program of the 'Shanghai Innovation in Science and Technology' Natural Science Foundation, and will further support our research on semantic, higher-level SLAM.


July 30, 2019

Paper accepted for 3DV'19

Our innovative application of an aritificial neural network to improve the numerical stability of Groebner basis solvers will be presented orally at 3DV in Quebec City, Canada.


June 24, 2019

New graduate student

Welcome Ling Gao to join MPL, one of ShanghaiTech's own outstanding undergraduate students.


June 20, 2019

Paper accepted for IROS'19

We have an exciting contribution on "articulated" multi-perspective cameras accepted for IROS'19. The case enables motion estimation with non-overlapping cameras distributed over a truck, i.e. tractor and trailor, and handles the fact that these two bodies are moving w.r.t. to each other.


March 28, 2019

Welcoming new members to the group

Welcome Dr Min Li, who is starting as a Research Assistant Professor at MPL. Also welcome Li Cui, who will start as a graduate student at MPL in 2019.


March 12, 2019

Two papers accepted to CVPR'19!

Special congratulations to Huang Kun from MPL on this fine achievement!


February 26, 2019

Congratulations to Dr Zhou Yi!

The first PhD student working under the supervision of Prof Laurent Kneip officially graduated.


January 27, 2019

Laurent Kneip at an NII Shonan meeting

Laurent Kneip was an invited speaker at an NII Shonan meetings on optimization in computer vision, and presented MPL's latest research achievements.


Good start into 2019!

Check out our new contributions to TPAMI and TRO!

TPAMI paper "Minimal case relative pose computation using ray-point-ray features" presents new insights on two-view geometry. TRO paper "Canny-VO: Visual Odometry with RGB-D Cameras based on Geometric 3D-2D Edge Alignment" summarizes our long efforts on semi-dense motion estimation for RGBD cameras.


November 5, 2018

1st prize at the IEEE Australia Postgraduate Student Paper Competition.


September 15, 2018

New graduate student

Welcome Xu Wanting from Xinjiang University to join MPL.


July 9, 2018

ECCV paper on event-based vision accepted!

The fruits of our collaboration with RPG from University of Zurich.


June 25, 2018

New PhD student

Peng Xin from CAS has joined MPL as a new PhD student. Welcome to the team!


June 14, 2018

PAMI paper accepted

Our paper on globally optimal correspondence-less camera resectioning winning a Marr Prize Honourable Mention has been accepted to PAMI!.


March 30, 2018

Oral at CVPR'18!

Our work on globally optimal, non-minimal calibrated relative pose will be presented orally at CVPR'18.


March 23, 2018

New graduate student

Welcome Zhanpeng Ouyang from Nanchang University to join our team!


March 23, 2018

MPL web presence goes live!

We are excited to get started, and here is where you will be able to check out on our progress as we go. We'd love to get feedback from you!


December, 2017

Marr Prize Honourable Mention

Our ICCV'17 work "Globally-Optimal Inlier Set Maximisation for Simultaneous Camera Pose and Feature Correspondence" received a Marr Prize Honourable Mention! The Marr Prize is the most prestigious best paper award in the computer vision community.


Video Highlights

August 21, 2020

Video of our ECCV'2020 contribution

The video of our ECCV'2020 paper on Globally Optimal Event Camera Motion Estimation is now online. The method provides a globally optimal solution to contrast maximization using branch and bound. Links: Youtube, Bilibili, and PDF.