What is Luma AI’s Dream Machine? Why fans are flocking to video generator

Luma Labs, the AI company known for creating the Genie generative 3D model, has now ventured into AI-powered video technology with its new offering, Dream Machine — and social media users have been raving about it. Among several new AI video makers on the scene, it is in direct competition with OpenAI’s upcoming Sora tool.

What is Luma AI?

Luma AI is a platform where users can create 3D models using text, images, or video inputs. The tool helps professionals such as those in architecture, product design, content creation, and research and development, dream up abstract concepts. The company streamlines the process of exporting work across various platforms.

The 3D models are also advancing meta-activities such as gaming, virtual reality, and e-commerce by simplifying the creation of 3D online spaces.

Developed by LumaLabs in San Francisco, California, Luma AI uses knowledge of machine learning, augmented reality, and 3D photography to merge AI with the field of 3D modeling.

Using Neural Radiance Fields (NeRF) technology to transform images and videos captured by smartphones into highly realistic 3D models, NeRF alters ordinary scenes and objects by adding an element of realism to them.

Co-founder and CEO Amit Jain, who was previously part of the Apple Vision Pro and Apple’s computer vision team, is currently leading the charge.

Among the various gadgets, Dream Machine is the company’s new contribution, an AI model designed to produce high-quality, realistic videos from text and images. So far, it generates accurate, consistent, and dynamic visuals. The tool moves toward creating a universal imagination engine and is now accessible to all.

In a statement on their blog page, Luma Labs said: “We have built Dream Machine on a scalable, efficient, and multimodal transformer architecture and trained it directly on videos.”

They described the tool as an “imagination engine,” as “we find joy and purpose in making things. At Luma we are building general AI systems that will help people make beautiful, powerful, creative things that are inaccessible or simply impossible.”

How have people reacted to Dream Machine?

The launch of Dream Machine saw such a surge in demand that Luma Labs had to implement a queuing system after their servers were overwhelmed.

Introducing Dream Machine – a next generation video model for creating high quality, realistic shots from text instructions and images using AI. It’s available to everyone today! Try for free here https://t.co/rBVWU50kTc #LumaDreamMachine pic.twitter.com/Ypmacd8E9z

— Luma AI (@LumaLabsAI) June 12, 2024

She's alive