Application of Multimodal Interaction Technology in Automatic Cockpit Environment

Lü Jiawei, Lü Danxuan

AUTO ELECTRIC PARTS ›› 2025, Vol. 1 ›› Issue (9) : 13-15.

AUTO ELECTRIC PARTS ›› 2025, Vol. 1 ›› Issue (9) : 13-15.
Intelligent Networking

Application of Multimodal Interaction Technology in Automatic Cockpit Environment

  • Lü Jiawei, Lü Danxuan
Author information +
History +

Abstract

With the continuous development of intelligent connected vehicle technology, multi-modal interaction technology is increasingly widely used in the field of autonomous driving. Therefore, this paper deeply studies the application of multimodal interaction technology in the automatic cockpit environment, focusing on speech, gesture, physiological perception and so on. At the same time, on the basis of in-depth analysis of the core challenges such as modal conflict and system robustness decline in the cabin, a system-level solution including modal decoupling structure, adaptive fault-tolerant mechanism and semantic discrimination priority strategy is proposed, hoping to promote the healthy development of intelligent connected vehicle industry, so that autonomous driving technology can better serve human society.

Key words

automatic cockpit / multimodal interaction / semantic fusion

Cite this article

Download Citations
Lü Jiawei, Lü Danxuan. Application of Multimodal Interaction Technology in Automatic Cockpit Environment[J]. AUTO ELECTRIC PARTS. 2025, 1(9): 13-15

References

[1] 黄若晴,王荣庆 . 汽车智能座舱多模态人机交互设计研究综述 [J]. 时代汽车,2024(23):133-135.

[2] 王国庆,裴云强,杨阳,等 . 多模可信交互:从多模态信息融合到人—机器人—数字人三位一体式交互模型 [J]. 中国科学:信息科学,2024,54(4):872-892.

[3] 靳运博,贺智东,王新彭 . 多模态人机交互在智能网联汽车自动驾驶中的挑战与对策研究 [J]. 时代汽车,2025(4):4-6.

[4]唐小林,甘露,李国法,等.面向自动驾驶的大模型对齐技术:综述 [J]. 汽车工程,2024,46(11):1937-1951.

Accesses

Citation

Detail

Sections
Recommended

/