IMMERSIVE VIRTUAL LOCATION CREATION USING GENERATIVE ARTIFICIAL INTELLIGENCE
Dossier Overview
Inventor
Oliver SCHIRMER; Frank FEINBUBE; Max SCHNEIDER
IPC Classification
CPC Classification
A system associated with an immersive experience framework may include an immersive virtual location data store containing information about a plurality of three-dimensional scenes (with each scene being associated with an immersive virtual location). An immersive virtual location tool may receive, from a creator, an immersive virtual location request (e.g., including an environment description). A request prompt is created based on the environment description and transmitted to a text-to-video generative AI model. A video of the virtual location is received from the generative AI model and converted into a three-dimensional scene using a volume rendering technique. Information about the scene is stored in the immersive virtual location data store and a user can interact with the scene using a substantially real-time experience interaction engine. In some embodiments, a JSON file describing the scene is directly generated using a LLM without creating the video.
Original (Chinese)
A system associated with an immersive experience framework may include an immersive virtual location data store containing information about a plurality of three-dimensional scenes (with each scene being associated with an immersive virtual location). An immersive virtual location tool may receive, from a creator, an immersive virtual location request (e.g., including an environment description). A request prompt is created based on the environment description and transmitted to a text-to-video generative AI model. A video of the virtual location is received from the generative AI model and converted into a three-dimensional scene using a volume rendering technique. Information about the scene is stored in the immersive virtual location data store and a user can interact with the scene using a substantially real-time experience interaction engine. In some embodiments, a JSON file describing the scene is directly generated using a LLM without creating the video.
External Resources