Hao Zheng

I am a PhD candidate at the Department of Mechanical and Mechatronics Engineering at the University of Auckland, under the supervision of Professor Xun Xu.
My research focuses on integrating AI with Smart Manufacturing, specifically in areas of Video Understanding (Action Recognition & Segmentation), Human-Robot Collaboration, Human-Centric Manufacturing, and Generative AI.
If you're interested in collaborating on research projects related to AI and Manufacturing, feel free to reach out. I am also currently looking for a postdoctoral position or other research roles.

News

Manuscript "A human-robot collaborative assembly framework with quality checking based on real-time dual-hand action segmentation" has been accepted by Robotics and Computer-Integrated Manufacturing.
Hao Zheng, Wanqing Xia, Xun Xu paper

Manuscript "Generative AI for Future Manufacturing" has been submitted to Advanced Engineering Informatics, Preprint is coming.
Hao Zheng, Ziyue Geng, Xun Xu

Publication (*co-first author)

A human-robot collaborative assembly framework with quality checking based on real-time dual-hand action segmentation
       Hao Zheng, Wanqing Xia, Xun Xu
       Robotics and Computer-Integrated Manufacturing (RCIM), paper, Code

DuCAS: a knowledge-enhanced dual-hand compositional action segmentation method for human-robot collaborative assembly
       Hao Zheng, Regina Lee, Huachang Liang, Yuqian Lu, Xun Xu
       2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Code

DuHa: a dual-hand action segmentation method for human-robot collaborative assembly
       Hao Zheng*, Regina Lee, Yuqian Lu, Xun Xu
       2024 IEEE 20th International Conference on Automation Science and Engineering (CASE), Code

A Vision-Enabled Fatigue-Sensitive Human Digital Twin Towards Human-Centric Human-Robot Collaboration
       Saahil Chand, Hao Zheng, Yuqian Lu
       Journal of Manufacturing Systems.

HA-ViD: A Human Assembly Video Dataset for Comprehensive Assembly Knowledge Understanding
       Hao Zheng*, Regina Lee*, Yuqian Lu
       NeurIPS 2023, PDF, Project Page, Code

Human-robot shared assembly taxonomy: A step toward seamless human-robot knowledge transfer
       Regina Lee*, Hao Zheng*, Yuqian Lu
       Robotics and Computer-Integrated Manufacturing, PDF, Project Page

Video-Based Fatigue Estimation for Human-Robot Task Allocation Optimisation
       Hao Zheng, Saahil Chand, Ali Keshvarparast, Daria Battini, Yuqian Lu
       2023 IEEE 19th International Conference on Automation Science and Engineering (CASE), PDF

Outlook on human-centric manufacturing towards Industry 5.0
       Yuqian Lu, Hao Zheng, Saahil Chand, Wanqing Xia, Zengkun Liu, Xun Xu, Lihua Wang, Zhaojun Qin, Jinsong Bao
       Journal of Manufacturing Systems, PDF

A general fault diagnosis framework for rotating machinery and its flexible application example
       Hao Zheng, Gang Cheng, Yuqian Lu, Chang Liu, Yong Li
       Measurement, PDF

Vibration-based and computer vision-aided nondestructive health condition evaluation of rail track structures
       Shaohua Wang*, Hao Zheng*, Lihua Tang, Zhaoyu Li, Renda Zhao, Yuqian Lu, Kean C. Aw
       Journal of Civil Structural Health Monitoring, PDF

A fault diagnosis method for planetary gear under multi-operating conditions based on adaptive extended bag-of-words model
       Hao Zheng, Gang Cheng, Yong Li, Chang Liu
       Measurement, PDF

A new fault diagnosis method for planetary gear based on image feature extraction and bag-of-words model
       Hao Zheng, Gang Cheng, Yong Li, Chang Liu
       Measurement, PDF

Academic Activity

Conference reviewer
  • Conference on Neural Information Processing Systems (NeurIPS): 2024
  • IEEE International Conference on Automation Science and Engineering (CASE): 2024
Journal reviewer
  • IEEE Transactions on Instrumentation & Measurement
  • Robotics and Computer-Integrated Manufacturing
  • Measurement
  • International Journal of Computer Integrated Manufacturing

Education

Ph.D. (current)
  • The Univeristy of Auckalnd
  • Supervisor: Prof. Xun Xu
M.S. of Engineering
  • China University of Mining and Technology
  • Supervisor: Prof. Gang Cheng
B.S. of Engineering
  • Yancheng Institute of Technology