Research Publications
Discover our latest research contributions to the scientific community. Our publications span journal articles, conference papers, and technical reports in radar technology and related fields.
mmPose-NLP: A Natural Language Processing Approach to Precise Skeletal Pose Estimation using mmWave Radars
A. Sengupta, S. Cao
This work introduces mmPose-NLP, applying natural language processing concepts to radar-based pose estimation. The approach treats radar point clouds as sequential data, enabling more effective temporal modeling and improved pose tracking accuracy. First method to precisely …
Online Targetless Radar-Camera Extrinsic Calibration Based on the Common Features of Radar and Camera
L. Cheng, S. Cao
An online targetless calibration method leveraging deep learning to extract common features from raw radar Range-Doppler-Angle data and camera images. Uses RANSAC and adaptive variance Levenberg-Marquardt algorithm for robust calibration in uncontrolled environments.
3D Radar and Camera Co-Calibration: A Flexible and Accurate Method for Target-Based Extrinsic Calibration
L. Cheng, A. Sengupta, S. Cao
A flexible calibration method for 3D radar and camera fusion using a single corner reflector with PnP, RANSAC, and Levenberg-Marquardt optimization. The method does not require specially designed calibration environments and achieves accurate extrinsic calibration through …
Robust Multiobject Tracking Using mmWave Radar-Camera Sensor Fusion
A. Sengupta, L. Cheng, S. Cao
A robust tracking framework using high-level monocular-camera and mmWave radar sensor-fusion. Improves localization accuracy through decision-level sensor fusion and provides robustness via tri-Kalman filter setup for continuous tracking despite single sensor failures.
Stabilizing Skeletal Pose Estimation using mmWave Radar via Dynamic Model and Filtering
S. Hu, A. Sengupta, S. Cao
This work presents a method for stabilizing skeletal pose estimation using mmWave radar through dynamic modeling and filtering techniques. Addresses the challenge of unstable pose estimates in radar-based systems by incorporating temporal consistency constraints.
mmFall: Fall Detection using 4D mmWave Radar and a Hybrid Variational RNN AutoEncoder
F. Jin, A. Sengupta, S. Cao
mmFall presents a hybrid variational RNN autoencoder architecture for fall detection using 4D mmWave radar. The system analyzes micro-Doppler and range-Doppler features with temporal modeling through RNN variants, achieving robust real-time fall detection while maintaining privacy. …
Automatic Radar-Camera Dataset Generation for Sensor-Fusion Applications
A. Sengupta, A. Yoshizawa, S. Cao
A novel approach that leverages YOLOv3 based highly accurate object detection from camera to automatically label point cloud data obtained from a co-calibrated radar sensor. Features co-calibration, clustering and association capabilities for automatically generating datasets containing …
NLP based Skeletal Pose Estimation using mmWave Radar Point-Cloud: A Simulation Approach
A. Sengupta, F. Jin, S. Cao
First approach to estimate 3D positions of 25 skeletal keypoints using simulated mmWave radar-like point-cloud data with natural language processing techniques. Demonstrates the potential of mmWave radars for sparse point-cloud representation with higher resolution than traditional …
mm-Pose: Real-Time Human Skeletal Posture Estimation using mmWave Radars and CNNs
A. Sengupta, F. Jin, R. Zhang, S. Cao
A real-time human skeletal pose estimation system using CNNs trained on mmWave radar data. The approach achieves efficient inference suitable for edge deployment while maintaining high accuracy in pose tracking applications. First method to detect more …
MmWave Radar Point Cloud Segmentation using GMM in Multimodal Traffic Monitoring
F. Jin, A. Sengupta, S. Cao, Y. Wu
A multimodal traffic monitoring approach using high-resolution mmWave radar for point cloud representation. Applies multivariate Gaussian mixture model (GMM) for radar point cloud segmentation using point-wise classification in unsupervised learning for distinguishing pedestrians, cars, and bicycles. …