0
100
go back
Top

The Entanglement. Volumetric Music Performances in a Virtual Metaverse Environment

  /    /    /  The Entanglement. Volumetric Music Performances in a Virtual Metaverse Environment

The Entanglement. Volumetric Music Performances in a Virtual Metaverse Environment

We present the implementation of a multi-user metaverse environment for telematic

concert performances. It uses low-latency, real-time WebRTC-based peer-to-peer (P2P) broadcasting for audiovisual volumetric rendering with binaural spatial audio and 3D video streaming from depth cameras. The system is realized using a web-based framework to implement a platform-independent online multi-user environment compatible with the WebXR standard. The performers’, as well as the audience’s audio, can be streamed and shared in the environment and is rendered binaurally. In addition, the performers’ depth image is streamed from 3D cameras and rendered in the environment as a three-dimensional point cloud. The result is a real-time 6-DoF audiovisual volumetric performance in a virtual 3D world that provides an immersive concert experience. It can be experienced with WebXR compatible devices, whether screen-based on the computer, mobile or on VR and AR systems. The implemented system was developed and evaluated with a first-of-this-kind virtual performance, “The Entanglement.”

The multi-user metaverse environment was tested and further developed during a residency at the Institute for Computer Music and Sound Technology at Zurich University of the Arts.

Damian Dziwis presented “The Entanglement. Volumetric Music Performances in a Virtual Metaverse Environment” at the Now Net Arts Conference 2022: Network Arts Stage – Artistic, Technological, and Social Strategies, on November 1, 2022.

Category:
Date:
Next Up
Background color
Texture style
select texture
clear

MONOLAB

A PROFESSIONAL SOLUTION for all types of CREATIVES. Packed with a ton of beautiful elements, powerful options & fully flexible layouts.

Laptop Image
Demo Image
Main Home
Demo Image
Thumbnail Projects
Demo Image
Portfolio Attached Info
Demo Image
Projects Carousel
Demo Image
Portfolio Masonry
Demo Image
Portfolio Gallery

Layouts for everything

Monolab is equipped with predesigned templates great for setting up an online store, presenting yourself, your work & much more.

Page Image
Agency Studio
Page Image
What We Do
Page Image
Contact
Page Image
Who We Are
Page Image
Shop Masonry Carousel
Page Image
Careers

Create A CAPTIVATING PORTFOLIO without knowing a single line of code. With Monolab you get A UNIQUE BLEND of style & ease of use.