[论文解读] Artificial Intelligence for the Metaverse: A Survey

Thien Huynh‐The, Quoc‐Viet Pham+4 more|arXiv (Cornell University)|Feb 15, 2022

Virtual Reality Applications and Impacts被引用 72

一句话总结

对人工智能在元宇宙中的全面综述，涵盖六个技术方面（NLP、机器视觉、区块链、网络、数字孪生、神经接口）、AI驱动的应用以及未来方向。

ABSTRACT

Along with the massive growth of the Internet from the 1990s until now, various innovative technologies have been created to bring users breathtaking experiences with more virtual interactions in cyberspace. Many virtual environments with thousands of services and applications, from social networks to virtual gaming worlds, have been developed with immersive experience and digital transformation, but most are incoherent instead of being integrated into a platform. In this context, metaverse, a term formed by combining meta and universe, has been introduced as a shared virtual world that is fueled by many emerging technologies, such as fifth-generation networks and beyond, virtual reality, and artificial intelligence (AI). Among such technologies, AI has shown the great importance of processing big data to enhance immersive experience and enable human-like intelligence of virtual agents. In this survey, we make a beneficial effort to explore the role of AI in the foundation and development of the metaverse. We first deliver a preliminary of AI, including machine learning algorithms and deep learning architectures, and its role in the metaverse. We then convey a comprehensive investigation of AI-based methods concerning six technical aspects that have potentials for the metaverse: natural language processing, machine vision, blockchain, networking, digital twin, and neural interface, and being potential for the metaverse. Subsequently, several AI-aided applications, such as healthcare, manufacturing, smart cities, and gaming, are studied to be deployed in the virtual worlds. Finally, we conclude the key contribution of this survey and open some future research directions in AI for the metaverse.

研究动机与目标

• 提供对适用于元宇宙的AI技术（机器学习和深度学习）及学习范式的简要概述。
• 对六个技术方面的AI驱动方法进行综述，以评估它们对元宇宙平台的潜力。
• 识别将AI应用于元宇宙的AI驱动应用与现实世界项目。
• 讨论推进沉浸式虚拟世界AI的未来研究方向。

提出的方法

• 回顾传统与先进的AI/ML技术（有监督、无监督、半监督、强化学习；深度学习架构如RNN、CNN、SOM、自编码器）。
• 将AI方法映射到六个与元宇宙相关的技术方面：NLP、机器视觉、区块链、网络、数字孪生、神经接口。
• 讨论AI驱动的应用（医疗、游戏、制造、智慧城市等）以及示例元宇宙项目。
• 突出元宇宙中AI的潜在未来研究方向和未解决的挑战。

实验结果

研究问题

• RQ1 AI在关键元宇宙技术层（NLP、视觉、区块链、网络、数字孪生、神经接口）中的作用是什么？
• RQ2 AI方法如何应用于现实世界的元宇宙应用和项目？
• RQ3 哪些未来研究方向最有前景，以推动AI驱动的元宇宙平台？
• RQ4 将AI与XR/VR、区块链和网络整合对沉浸式体验有何影响？

主要发现

• AI技术，包括ML和DL，在六大技术方面支撑元宇宙的核心能力。
• AI驱动的方法支持自然语言代理、用于XR的计算机视觉、可安全扩展的网络以及数字孪生/神经接口的整合。
• 该综述讨论在虚拟世界中AI驱动的应用，如医疗、制造、智慧城市、游戏、电子商务、房地产和DeFi。
• 若干元宇宙项目展示了AI增强的沉浸式体验和面向用户的服务。
• 提出未来研究方向，以引导AI在可扩展、可安全且互操作的元宇宙平台中的整合。