JIN HUANG   黄 进

Ph.D., Associate Research Fellow

Intelligence Engineering Lab (IEL)

Beijing Key Lab of Human-Computer Interaction

State Key Lab of Computer Science

Institute of Software, Chinese Academy of Sciences (ISCAS)

 

4 Zhongguancun South 4th Street

Beijing 100190, China

 

Email:huangjin[at]iscas.ac.cn

Jin Huang is an Associate Research Fellow in the Intelligence Engineering Lab at the Institute of Software, Chinese Academy of Sciences. His research lies in the general area of Human-Computer Interaction (HCI), with a primary focus on understanding and modeling human behaviors with Praxeology, Psychology and Artificial Intelligence (AI). His research interests include Intelligent User Interfaces, Gesture-based Interfaces, Multimodal Interfaces, Mobile Interfaces, and their applications in Education and Healthcare. Jin Huang received his Ph.D. in Department of Computer Science from University of Chinese Academy of Sciences, Master degree in School of Software Engineering from Beijing Jiaotong University, and Bachelor degree in School of Transportation Science and Engineering from Beihang University.

 

Research Interests: HCI Theory, Concepts and Models; Gesture-based Interaction; AR/VR Interaction; Multimodal Interaction; Interactive Machine Learning.

.

RECENT NEWS

 

 

[01/2023]

Two of our full papers have been accepted at CHI 2023!

[12/2022]

Our cutting-edge trajectory prediction technology has been successfully integrated into a range of products, including the HONOR Magic Vs - the latest foldable screen mobile phone.

[10/2021]

I am honored to have been promoted to Associate Research Fellow by the Institute of Software, Chinese Academy of Sciences (ISCAS).

[10/2021]

Our project "Research on Computational Model of Touch Interaction Influenced by Multimodal Situational Factors" has been funded by the National Natural Science Foundation of China (NSFC) General Projects.

[05/2021]

I returned to Beijing from my visit to University of Cambridge UK.


SELECTED PUBLICATIONS  (Full list in Research Gate)

 

[IJHCS] Fei Lyu*, Huijing Li, Qiang Fu, Yujie Liu, Jin Huang, Zhigang Deng. Effects of spatial constraints and ages on children's upper limb performance in mid-air gesture interaction. Int. J. Hum. Comput. Stud. 170: 102952 (2023) (pdf)

 

 

[IJHCS] Juan Liu, Yulong Bian*, Yuting Xi, Yawen Zheng, Jin Huang, Wei Gai, Chenglei Yang, Xiangxu Meng. Evaluating the role of mixed reality in cognitive training of children with ASD: Evidence from a mixed reality aquarium. Int. J. Hum. Comput. Stud. 162: 102815 (2022) (pdf)

 

 

[IJHCS] Jin Huang, John J. Dudley, Stephen Uzor, Dong Wu, Per Ola Kristensson, Feng Tian*. Understanding user performance of acquiring targets with motion-in-depth in virtual reality. Int. J. Hum. Comput. Stud. 163: 102817 (2022) (pdf)

 

 

[THMS] Haonan Xu, Fei Lyu*, Jin Huang, Huawei Tu. Applying Sonification to Sketching in the Air With Mobile AR Devices. IEEE Trans. Hum. Mach. Syst. 52(6): 1352-1363 (2022) (pdf)

 

 

[MobileHCI 2021] Yawen Zheng, Jin Huang*, Juan Liu, Chenglei Yang, Feng Tian. A Scenario Adaptive Model for Predicting Error Rates in Moving Target Selection. In Proceedings of the 23rd International Conference on Mobile Human-Computer Interaction (MobileHCI '21). September 2021 Article No.: 10 pp 1–15.(pdf)

 

 

[CHI 2021] Huawei Tu, Jin Huang*, Hai-Ning Liang, Richard Skarbez, Feng Tian, Henry Been-Lirn Duh. Distractor Effects on Crossing-Based Interaction. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI '21). May 2021, Article No.: 192, pp 1–13.(pdf)

 

 

[CHI LBW 2020] Jin Huang, Xiaolan Peng*, Rui Chen, Shengcai Duan, Feng Tian, Hongan Wang. Negative Emotion, Positive Performance? A Glimpse into Emotional Influences on Moving Target Selection. (CHI EA '20) April 2020, pp 1–8. (pdf)

 

 

[CHI LBW 2020]Ziyue Zhang, Jin Huang*, Feng Tian. Modeling the Uncertainty in Pointing of Moving Targets with Arbitrary Shapes. (CHI EA '20) April 2020, pp 1–7 (pdf)

 

 

[CHI 2020] Jin Huang, Feng Tian*, Xiangmin Fan, Huawei Tu, Hao Zhang, Xiaolan Peng, Hongan Wang. Modeling the Endpoint Uncertainty in Crossing-based Moving Target Selection. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI '20). April 2020, Pages 1–12. (pdf)

CHI 2020 Best Paper Honorable Mention Award (Top 5%)

 

 

[CHI 2020] Xiaolan Peng, Jin Huang, Alena Denisova, Hui Chen*, Feng Tian, Hongan Wang*. A Palette of Deepened Emotions: Exploring Emotional Challenge in Virtual Reality Games. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI '20). April 2020, Pages 1–13.(pdf)

 

 

[CHI 2020] Nianlong Li, Teng Han*, Feng Tian, Jin Huang, Minghui Sun, Pourang Irani, Jason Alexander. Get a Grip: Evaluating Grip Gestures for VR Input using a Lightweight Pen. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI '20). April 2020, Pages 1–13.(pdf)(video)

CHI 2020 Best Paper Honorable Mention Award (Top 5%)

 

 

[UIST 2019] Jin Huang, Feng Tian*, Nianlong Li, Xiangmin Fan. Modeling the Uncertainty in 2D Moving Target Selection. In Proceedings of the 32th annual ACM symposium on User interface software and technology (UIST '19). (October 20–23, 2019, New Orleans, LA, USA:1031-1043.)(pdfvideodemo)

 

 

[CHI LBW 2019] Jin Huang*, Byungjoo Lee. Modeling Error Rates in Spatiotemporal Moving Target Selection. Extended Abstracts of the 2019 CHI Conference on Human Factors in Computin Systems (CHI EA '19), Paper No. LBW1921.(pdf)

 

 

[CHI LBW 2019] Hao Zhang, Jin Huang*, Feng Tian. Trajectory Prediction Model for Crossing-Based Target Selection. Extended Abstracts of the 2019 CHI Conference on Human Factors in Computin Systems (CHI EA '19), Paper No. LBW2089.(pdf)

 

 

[CHI LBW 2019] Xiaolan Peng, Linghan Li, Chen Gao, Jin Huang*, Hui Chen, Feng Tian, HonganWang. Beyond Horror and Fear: Exploring Player Experience Invoked by Emotional Challenge in VR Games. Extended Abstracts of the 2019 CHI Conference on Human Factors in Computin Systems (CHI EA '19), Paper No. LBW1949.(pdf)

 

 

[CHI 2019] Shuai Ma, Zijun Wei, Feng Tian*, Xiangmin Fan, Jianming Zhang, Xiaohui Shen, Zhe Lin, Jin Huang, Radomir Mech, Dimitris Samaras, HonganWang. SmartEye: Assisting Instant Photo Taking via Integrating User Preference with Deep View Proposal Network. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI '19), May 4--9, 2019, Glasgow, Scotland Uk.(pdf)

CHI 2019 Best Paper Honorable Mention Award (Top 5%)

 

 

[CADCG 2019] Xiang Li, Jin Huang, Feng Tian*, Jie Liu, Hongan Wang, Guozhong Dai. A Survey on Story-Telling Methods in Modern Interaction Technology. Journal of Computer-Aided Design & Computer Graphics, 2019, 31(3): 349-363. (In Chinese)(pdf)

 

 

[JoS 2019] Nianlong Li, Jin Huang, Feng Tian(*), Guozhong Dai, Hongan Wang. ICOMDT:An Interaction Computational Model for Dynamic Task. Journal of Software, 2019. (In Chinese)(pdf)

 

 

[Ph.D. Thesis] A Study of Motor Behavior Model on Touch Interactions (In Chinese)(pdf)

Department of Computer Science, University of Chinese Academy of Sciences.

Advisor: Feng Tian

 

 

[CHI LBW 2018] Nianlong Li, Feng Tian*, Jin Huang, Xiangmin Fan, Hongan Wang. 2D-BayesPointer: An Implicit Moving Target Selection Technique Enabled by Human Performance Modeling. Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (CHI EA '18), Paper No. LBW125.(pdf)

 

 

[CHI 2018] Jin Huang, Feng Tian*, Xiangmin Fan, Xiaolong(Luke) Zhang, Shumin Zhai. Understanding the Uncertainty in 1D Unidirectional Moving Target Selection. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI '18), Montreal QC, Canada -- April 21 - 26, 2018, Paper No. 237.(pdf)

 

 

[SCIS 2018] Jin Huang, Xiaolan Peng, Feng Tian*, Hongan Wang, Guozhong Dai. Modeling a Target-selection Motion by Leveraging an Optimal Feedback Control Mechanism. Science China Information Sciences (SCIS), April 2018, 61:044101.(pdf)

 

 

[CADCG 2016] Jin Huang, Dongqi Han, Yineng Chen, Feng Tian(*), Hongan Wang, Guozhong Dai. A Survey on Human-Computer Interaction in Mixed Reality. 2016. Journal of Computer-Aided Design & Computer Graphics, 2016, 28(6), 869-880. (In Chinese)(pdf)

 

 

[JoS 2016] Jin Huang, Yineng Chen, Jie Liu, Feng Tian*, Guozhong Dai, Hongan Wang. 2016. Multimodal Human-Computer Interaction Model for Nerve Function Assessment in Mobile Environment. Journal of Software, 2016, 27, 156-171. (In Chinese)(pdf)

 

 

[MA Thesis] Game Design and Implementation based on XNA(pdf)

School of Software Engineering, Beijing Jiaotong University.

Advisor: Cheng Song, Difang, Ma

 

 

[CICN 2012] Jin Huang*, Wei Wu, Ziyan Ling. Multi-agent Pathfinding System Implemented on XNA. In Proceedings of 4th International Conference on Computational Intelligence and Communication Networks, CICN 2012, 651-655.(pdf)


LICENSED PATENTS

 

A Multi-channel Multi-task Neural System Disease Diagnosis System Based on Pen and Speech. Yang Li, Jin Huang, Feng Tian, Hongan Wang. Filed: 2018.06.06. Patent No. CN 2018105761079
 

Method and System for Assisting Target Selection in 3D Environment Based on Motion Trend Information. Feng Tian, Nianlong Li, Jin Huang, Hongan Wang. Filed: 2020.06.29. Patent No. CN 2020106088083
 

A Moving Target Selection Technology based on Correction of User Performance Model. Jin Huang, Nianlong Li, Feng Tian, Hongan Wang. Filed: 2018-06-01. Patent No. CN 2018105586224
 

A Target Selection Method and Electronic Device based on Artificial Potential Field. Jin Huang, Hao Zhang, Feng Tian, Hongan Wang. Filed: 2020-06-28. Patent No. CN 2020105981767
 

A Sketch Gesture Recognition Method based on Interactive Sequence Information. Xiang Li, Feng Tian, Jin Huang, Zongqi Zhang, Hongan Wang, Guozhong Dai. Filed: 2019-03-22. Patent No. CN 2019102219143
 

A Gait Recognition Method and System for Target User in Daily Environment. Feng Tian, Jin Huang, Lixin Zhou, Yicheng Zhu, Shuai Ma, Hongan Wang. Filed: 2019-01-10. Patent No. CN 2019100216329
 

A Clock Drawing Test Method and System based on Digital Pen. Feng Tian, Jin Huang, Hongan Wang. Filed: 2017-02-23. Patent No. CN 2017101005307

 

SERVICE

Professional Affiliations

Member of China Computer Federation (CCF)

Member of Chinese Association for Artificial Intelligence (CAAI)

Member of China Society of Image and Graphics (CSIG)

Conference Paper Reviewing

ACM CHI Conference on Human Factors in Computing Systems (CHI)

ACM Symposium on User Interface Software and Technology (UIST)

IEEE Conference on Virtual Reality and 3D User Interfaces (IEEE VR)

ACM International Joint Conference on Pervasive and Ubiquitous Computing (Ubicomp)

ACM IUI International Conference on Intelligent User Interfaces (IUI)

Journal Paper Reviewing

International Journal of Human-Computer Studies (IJHCS)

ACM Transactions on Interactive Intelligent Systems (TiiS)

 

SUPERVISION

 

Doctoral Students

2019 -

Wenhui Kang. University of Chinese Academic of Science. External Member of Supervisory Committee.

Thesis Topic TBD.

2018 - 2021

Nianlong Li. University of Chinese Academic of Science. External Member of Supervisory Committee.

Handheld Interaction for Spatial Environment.

2018 -

Hao Zhang. University of Chinese Academic of Science. External Member of Supervisory Committee.

Thesis Topic TBD.

Master Students

2018 - 2022

Ziyue Zhang. University of Chinese Academic of Science. External Member of Supervisory Committee.

Research on Shape-feature-sensitive Dynamic Target Selection Technology.

2020 - 2022

Wenqing Yao. University of Chinese Academic of Science. External Member of Supervisory Committee.

Online Handwriting Verification Technology based on Multi-channel Feature Fusion.

Research Interns - Master Students

Winter 2018

Yujie Liu. Beijing University of Posts and Telecommunications.

Winter 2018

Ziyue Qu. University of York.

Winter 2019

Haonan Xu. Beijing University of Posts and Telecommunications.

Winter 2021

Yan Guo. Shandong University.

Research Interns - Undergraduate Students

2022 - 2023

Haonian Wang. Beijing Normal University.

Research Assistants

2018 - 2020

Xiaolan Peng. Institute of Software, Chinese Academy of Sciences.

2018 -

Yang Li. Institute of Software, Chinese Academy of Sciences.

 

Last updated in Feb., 2023

Back To Top