James M. Rehg

James M. Rehg

Professor

University of Illinois Urbana-Champaign

Biography

James M. Rehg (pronounced “ray”) is a Founder Professor of Computer Science and Industrial and Enterprise Systems Engineering at University of Illinois Urbana-Champaign. Previously, he was a Professor in the School of Interactive Computing at the Georgia Institute of Technology, where he co-Directed the Center for Health Analytics and Informatics (CHAI). He received his Ph.D. from CMU in 1995 and worked at the Cambridge Research Lab of DEC (and then Compaq) from 1995-2001, where he managed the computer vision research group. He received an NSF CAREER award in 2001 and a Raytheon Faculty Fellowship from Georgia Tech in 2005. He and his students have received a number of best paper awards, including best student paper awards at ICML 2005, BMVC 2010, Mobihealth 2014, Face and Gesture 2015, and a Distinguished Paper Award from ACM IMWUT and a Method of the Year award from the journal Nature Methods. Dr. Rehg served as the General co-Chair for CVPR 2009 and the Program co-Chair for CVPR 2017. He has authored more than 200 peer-reviewed scientific papers and holds 26 issued US patents.

Introduction to the Rehg Lab

We conduct basic research in computer vision and machine learning, and work in a number of interdisciplinary areas: developmental and social psychology, autism research, mobile health, and robotics. The study of human social and cognitive behavior is a cross-cutting theme. We are developing novel methods for measuring behavior in real-life settings, and computational models that connect health-related behaviors to health outcomes in order to enable novel forms of treatment. We are creating machine learning methods that are inspired by child development and investigating biologically-inspired approaches to robot navigation and control.

Prospective Students: If you are interested in joining our group and are not currently at UIUC, please apply directly to the university. For current UIUC MS students, please fill out this form.

labphoto

People


Principal Investigators

Avatar

James M. Rehg

Professor


Graduate Students

Avatar

Max Xu

Machine Learning PhD

Avatar

Anh Thai

CS PhD

Avatar

Bolin Lai

Machine Learning PhD

Avatar

Wenqi Jia

CS PhD

Projects

AutoRally

Autonomous driving

Developmental Machine Learning

Developmental Machine Learning

Mobile and Computational Health

Mobile and Computational Health

Publications

Egocentric Auditory Attention Localization in Conversations

Egocentric Auditory Attention Localization in Conversations

CVPR 2023

In the Eye of Transformer: Global-Local Correlation for Egocentric Gaze Estimation

In the Eye of Transformer: Global-Local Correlation for Egocentric Gaze Estimation

BMVC 2022 (Best Student Paper Award)

Learning Dense Object Descriptors from Multiple Views for Low-shot Category Generalization

Learning Dense Object Descriptors from Multiple Views for Low-shot Category Generalization

NeurIPS 2022

PulseImpute: A Novel Benchmark Task for Pulsative Physiological Signal Imputation

PulseImpute: A Novel Benchmark Task for Pulsative Physiological Signal Imputation

NeurIPS 2022

Discovering Novel Predictors of Minimally Verbal Outcomes in Autism through Computational Modeling

Discovering Novel Predictors of Minimally Verbal Outcomes in Autism through Computational Modeling

INSAR 2022 Oral + Press Conference (< 1% acceptance rate)

Generative Adversarial Network for Future Hand Segmentation from Egocentric Video

Generative Adversarial Network for Future Hand Segmentation from Egocentric Video

ECCV 2022

Planes vs. Chairs: Category-guided 3D shape learning without any 3D cues

Planes vs. Chairs: Category-guided 3D shape learning without any 3D cues

ECCV 2022

4D Human Body Capture from Egocentric Video via 3D Scene Grounding

4D Human Body Capture from Egocentric Video via 3D Scene Grounding

3DV 2021

Transformers for prompt-level EMA non-response prediction

Transformers for prompt-level EMA non-response prediction

arXiv preprint

Efficient Learning and Decoding of the Continuous-Time Hidden Markov Model for Disease Progression Modeling

Efficient Learning and Decoding of the Continuous-Time Hidden Markov Model for Disease Progression Modeling

arXiv preprint

Ego4D: Around the World in 3,000 Hours of Egocentric Video

Ego4D: Around the World in 3,000 Hours of Egocentric Video

CVPR 2022 (oral)

Using Shape to Categorize: Low-Shot Learning with an Explicit Shape Bias

Using Shape to Categorize: Low-Shot Learning with an Explicit Shape Bias

CVPR 2021

The Surprising Positive Knowledge Transfer in Continual 3D Object Shape Reconstruction

The Surprising Positive Knowledge Transfer in Continual 3D Object Shape Reconstruction

3DV 2022

In the Eye of the Beholder: Gaze and Actions in First Person Video

In the Eye of the Beholder: Gaze and Actions in First Person Video

IEEE Transactions on Pattern Analysis and Machine Intelligence

Where Are You? Localization from Embodied Dialog

Where Are You? Localization from Embodied Dialog

EMNLP 2020

Datasets

Georgia Tech Egocentric Activity Datasets

Georgia Tech Egocentric Activity Datasets

Summary Text for GTEA dataset

Toys4K 3D Object Dataset

Toys4K 3D Object Dataset

CVPR 2021

4,000 3D object instances from 105 categories of developmentally plausible objects

Sponsors

NIH NIBIB P41-EB028242: mHealth Center for Discovery, Optimization, and Translation of Temporally-Precise Interventions (mDOT)

NSF OIA 1936970: C-Accel Phase 1: Empowering Neurodiverse Populations for Employment through Inclusion AI and Innovation Science

NSF CNS 1823201: CRI: mResearch: A platform for Reproducible and Extensible Mobile Sensor Big Data Research

NIH NIMH R01-MH114999: Data-Driven Multidimensional Modeling of Nonverbal Communication in Typical and Atypical Development

Contact

  • rehg@gatech.edu
  • CODA Building, 756 W Peachtree St NW, Georgia Institue of Technology, Atlanta, GA 30308
  • CODA 15th floor, office 1550-B