[Paper Review] AI and 6G into the Metaverse: Fundamentals, Challenges and Future Research Trends

Muhammad Zawish, Fayaz Ali Dharejo+5 more|arXiv (Cornell University)|Aug 23, 2022

Advanced Wireless Communication Technologies20 citations

TL;DR

This survey analyzes how AI and 6G will enable Metaverse experiences, exploring AR/VR/spatial computing, edge AI, sustainability, use cases, and future research directions.

ABSTRACT

Since Facebook was renamed Meta, a lot of attention, debate, and exploration have intensified about what the Metaverse is, how it works, and the possible ways to exploit it. It is anticipated that Metaverse will be a continuum of rapidly emerging technologies, usecases, capabilities, and experiences that will make it up for the next evolution of the Internet. Several researchers have already surveyed the literature on artificial intelligence (AI) and wireless communications in realizing the Metaverse. However, due to the rapid emergence and continuous evolution of technologies, there is a need for a comprehensive and in-depth survey of the role of AI, 6G, and the nexus of both in realizing the immersive experiences of Metaverse. Therefore, in this survey, we first introduce the background and ongoing progress in augmented reality (AR), virtual reality (VR), mixed reality (MR) and spatial computing, followed by the technical aspects of AI and 6G. Then, we survey the role of AI in the Metaverse by reviewing the state-of-the-art in deep learning, computer vision, and Edge AI to extract the requirements of 6G in Metaverse. Next, we investigate the promising services of B5G/6G towards Metaverse, followed by identifying the role of AI in 6G networks and 6G networks for AI in support of Metaverse applications, and the need for sustainability in Metaverse. Finally, we enlist the existing and potential applications, usecases, and projects to highlight the importance of progress in the Metaverse. Moreover, in order to provide potential research directions to researchers, we underline the challenges, research gaps, and lessons learned identified from the literature review of the aforementioned technologies.

Motivation & Objective

• Describe the underlying components of the Metaverse (VR, MR, AR, and Spatial computing) to ground technical understanding.
• Present a thorough review of AI in the Metaverse to extract 6G requirements and enable end-to-end intelligent systems.
• Explain the role of B5G/6G in enabling immersive Metaverse experiences and identify services they can provide.
• Explore the integrated role of AI and 6G for Metaverse, and discuss sustainability, applications, projects, challenges, and lessons learned.

Proposed method

• Review state-of-the-art in AI, computer vision, learning paradigms, and Edge AI as they relate to the Metaverse.
• Define the role of AI in the layered Metaverse architecture and extract 6G communication requirements.
• Analyze immersive experiences and holographic telepresence through 5G-NR, URLLC, mmWave, MEC, THz communications, and their interplay.
• Investigate how AI can be used in 6G networks and how 6G can support AI for Metaverse applications.
• Assess sustainability, potential applications/use-cases, and ongoing projects to highlight progress and opportunities.

Experimental results

Research questions

• RQ1 Is B5G/6G required in the near term for Metaverse, and what services can it provide to Metaverse applications?
• RQ2 What services and capabilities can B5G/6G bring to Metaverse, especially for immersive experiences and holographic telepresence?
• RQ3 How can AI and 6G be integrated to realize sustainable, ubiquitous, and low-latency Metaverse experiences?
• RQ4 What are the sustainability considerations and potential architectural/technological solutions for Metaverse deployments?
• RQ5 What are the key applications, use-cases, and projects that illustrate progress in Metaverse enabled by AI and 6G?

Key findings

• AI and 6G together can enable ubiquitous intelligence, tactile feedback, and self-optimizing capabilities for the Metaverse.
• 6G aims for Tbps data rates, sub-1 ms latency, and wide mobility support to satisfy Metaverse requirements.
• Edge computing and Edge AI can reduce delays and address privacy, improving QoE in Metaverse services.
• A broad set of applications and use-cases is identified, along with ongoing projects and demonstrations, illustrating practical progress.
• The survey identifies challenges, gaps, and lessons learned to guide future research in AI-6G-Metaverse integration.