3D Perception for Robotics
I am a post-doctoral research fellow at Caltech working with Georgia Gkioxari. Previously, I completed my PhD in Robotics at CMU with Deva Ramanan. I was supported in part by a NSF Graduate Research Fellowship.
Research
My research focuses on developing 3D foundation models for robot perception. Current 2D foundation models trained on multi-modal internet-scale data achieve remarkable zero-shot accuracy across a variety of 2D perception tasks. However, extending such foundation models for 3D perception remains challenging due to a lack of diverse large-scale 3D training data. To bridge this gap, my work leverages 2D foundation models and geometric priors to generate 3D pseudo-labels, allowing us to turn any 2D dataset into a 3D dataset!
Formal Biography
Neehar Peri is a post-doctoral research fellow at Caltech working at the intersection of computer vision, machine learning, and robotics. His research scales 3D perception to the open world by leveraging self-distilled geometric structure, cross-modal signals, and few-shot examples instead of large-scale manual 3D annotations. His recent work spans LiDAR scene flow, open-vocabulary 3D detection, and few-shot vision-language models, including a Best Paper Award Candidate at CVPR 2026. He received his PhD in Robotics at CMU with Deva Ramanan, supported in part by an NSF Graduate Research Fellowship.Recent News
- [June 2026] Our paper DetPO: In-Context Learning with Multi-Modal LLMs for Few-Shot Object Detection has been accepted to ECCV 2026
- [June 2026] Our paper UniFlow: Zero-Shot LiDAR Scene Flow for Autonomous Driving has been accepted to ECCV 2026
- [April 2026] I was selected to particpate in the CVPR 2026 Doctoral Consortium
- [February 2026] Our paper RefAV: Towards Planning-Centric Scenario Mining has been accepted to CVPR 2026
- [January 2026] Our paper RF-DETR: Neural Architecture Search for Real-Time Detection Transformers has been accepted to ICLR 2026
Show More
- [September 2025] Our paper Roboflow100-VL: A Multi-Domain Object Detection Benchmark for Vision-Language Models has been accepted to NeurIPS D&B 2025
- [June 2025] Our paper MonoFusion: Sparse-View 4D Reconstruction via Monocular Fusion has been accepted to ICCV 2025
- [May 2025] Our paper Towards Learning to Complete Anything in LiDAR has been accepted to ICML 2025
- [February 2025] Our paper QuickDraw: Fast Visualization, Analysis and Active Learning for Medical Image Segmentation has been accepted to HCII 2025
- [January 2025] Our paper Planning with Adaptive World Models for Autonomous Driving has been accepted to ICRA 2025
- [January 2025] Our paper Neural Eulerian Scene Flow Fields has been accepted to ICLR 2025
- [September 2024] Our paper Revisiting Few-Shot Object Detection with Vision-Language Models has been accepted to NeurIPS D&B 2024
- [September 2024] Our paper Shelf-Supervised Cross-Modal Pre-Training for 3D Object Detection has been accepted to CoRL 2024
- [July 2024] Our paper Better Call SAL: Towards Segmenting Anything in LiDAR has been accepted to ECCV 2024
- [July 2024] Our paper I Can't Believe It's Not Scene Flow has been accepted to ECCV 2024
- [May 2024] Our paper Semi-Supervised Federated Multi-Organ Segmentation with Partial Labels has been accepted to AAPM 2024
- [January 2024] Our paper ZeroFlow: Scalable Scene Flow via Distillation has been accepted to ICLR 2024
- [August 2023] Our paper An Empirical Analysis of Range for 3D Object Detection has been accepted to BRAVO @ ICCV 2023
- [March 2023] I was awarded the NSF Graduate Research Fellowship
- [March 2023] Our paper ReBound: An Open-Source 3D Bounding Box Annotation Tool for Active Learning has been accepted to AutomationXP @ CHI 2023
- [January 2023] Our paper Data and Algorithms for End-to-End Thermal Spectrum Face Verification has been accepted to TBIOM 2022
- [September 2022] Our paper Towards Long Tailed 3D Detection has been accepted to CoRL 2022
- [August 2022] Our paper A Brief Survey of Person Recognition at a Distance has been accepted to ACSSC 2022
- [March 2022] Our paper Forecasting from LiDAR via Future Object Detection has been accepted to CVPR 2022
- [February 2022] Our paper Assessment of a Novel Virtual Environment for Examining Human Cognitive-Motor Performance during Execution of Action Sequences has been accepted to HCII 2022
- [October 2021] Our paper A Synthesis-Based Approach for Thermal-to-Visible Face Verification has been accepted to FG 2021
- [September 2021] Our paper PreferenceNet: Encoding Human Preferences in Auction Design with Deep Learning has been accepted to NeurIPS 2021
- [May 2021] I was selected as one of Maryland's Undergraduate Researchers of the Year
- [May 2021] I was awarded the Sujan Guhan Memorial Best Senior Thesis by UMD's ECE Department
- [December 2020] I was awarded an honorable mention for the Computing Research Association's Outstanding Undergraduate Researcher Award
