I Tried The New Ray3 AI Video Maker by Luma Labs

Previously 12 months, searches for “AI video maker” have skyrocketed by over 200%. This isn’t a shocker, as creators in all places are searching for quicker, smarter methods to show concepts into visuals. In actual fact, the very concept of such AI instruments was to offer artistic freedom to everybody, whether or not with a videomaking background or not. Into this wave comes Luma AI Ray3, the most recent video-generation mannequin from Luma Labs.

Positioned as a “visible thought associate,” Ray3 is constructed to assist creators ideate, storyboard, and refine their movies inside a single interface. At the least that’s what the corporate goals at, as per its launch announcement. Powered by Ray3 for video and Photon for photos, the system goals to push video creation from experimentation to execution, all in minutes.

I attempted my hand on the new Ray3. Right here, I share all about it, my expertise, and how one can attempt it out for your self. Learn on!

What’s Luma AI Ray3?

At its core, Luma AI Ray3 is the most recent improve to Luma Labs’ video-generation mannequin, designed to push previous the bounds of Ray2. In contrast to earlier iterations that targeted totally on rendering brief clips, Ray3 introduces a unified artistic layer: you possibly can ideate, experiment, and direct visible outputs with out leaving the interface.

The system combines two engines below one roof – Ray3 for video and Photon for photos. This pairing means you possibly can transfer fluidly between nonetheless photos and movement, treating them as components of the identical artistic course of.

But, probably the most attention-grabbing function Ray3 brings is its reference-driven consistency. The brand new AI video-gen mannequin helps you to lock kinds or characters throughout a number of pictures, one thing many different AI video makers nonetheless wrestle with.

Key Options of Luma AI Ray3

Aside from the reference-driven video-making, Ray3 has a number of latest options. Here’s a deep dive into all of those.

1. Boards for Structured Creativity

Ray3 introduces a number of boards – Artboard, Storyboard, and Moodboard. These let creators organise uncooked concepts into structured visuals. As an alternative of leaping straight into video, you possibly can form the appear and feel earlier than committing to era.

2. Modify with Pure Language

Want fast modifications? Merely sort directions like “make it anime” and the mannequin edits your picture or video accordingly. This bridges the hole between skilled enhancing instruments and on a regular basis artistic language.

3. Modify with Visible Cues

Some of the novel options I’ve personally seen in an AI video maker, Ray3, now helps you to modify a video by including visible cues to it. The AI mannequin is ready to interpret these cues and make modifications to your video accordingly.

4. Reference for Type and Character Consistency

Some of the highly effective additions: reference-based era. By importing a visible reference, Ray3 can keep constant kinds, environments, and even recurring characters throughout a number of outputs. Most AI video makers nonetheless lack this means.

5. Keyframe Management

Administrators typically suppose by way of keyframes, and Ray3 embraces that. By defining a begin and finish body, you possibly can let the AI fill within the in-between movement, including a layer of management and predictability to generative video.

6. Brainstorm and Inventive Question

Past video era, Ray3 doubles as an concept associate. Its question system can broaden tough prompts into detailed artistic instructions, stopping artistic blocks.

7. Share & Remix

Each challenge comes with a built-in “behind the scenes” layer. Different creators can see your course of, remix your outputs, and construct collaboratively, making Ray3 as a lot a group device as a manufacturing engine.

8. HDR Era

Ray3 claims to be the world’s first mannequin that is ready to ship studio-grade HDR movies by native excessive dynamic vary colour era. The AI video device is ready to generate gorgeous HDR movies from textual content prompts, SDR photos, in addition to SDR movies. What’s extra, it might probably even export these as 16-bit EXR for seamless integration into professional workflows.

Most AI video makers (see the highest 10 right here) generate clips in isolation, however Luma AI Ray3 combines a number of fashions and controls into one pipeline. On the core are two engines working collectively:

• Ray3 (video mannequin): Generates movement sequences, interprets prompts, and handles transitions between frames.
• Photon (picture mannequin): Produces high-quality stills, references, and beginning factors that may stream immediately into video creation.
• Right here’s how the method unfolds while you use Ray3:
• Prompting or Referencing: You start with both a textual content immediate (“make it anime”) or a visible reference (a picture, a mode, or a personality).
• Scene Era: Photon generates the stills, whereas Ray3 animates them into easy movement, making use of lighting, textures, and digital camera results.
• Keyframe Course: For those who present a begin and finish body, Ray3 fills within the in-betweens, simulating how a director would plan pictures.
• Edits and Modifications: You possibly can iterate immediately utilizing pure language, from type swaps to environmental modifications, with out touching conventional enhancing software program.
• Collaboration Layer: Your outputs and processes might be shared, remixed, or prolonged by different creators on the platform.

Easy methods to Entry Luma AI Ray3

In the mean time, Dream Machine is offered on each the online and iOS. Ray3, nevertheless, appears to be in a trial mode at current on each.

Ray3 AI Video Maker: Palms-on

We tried the Ray3 for a novel video round a mystical theme utilizing the next immediate:

Generate a sweeping cinematic sequence of a lone wanderer – a tall, cloaked determine with glowing amber eyes – crossing an limitless ocean of clouds on a floating obsidian bridge. Every step sends faint ripples of sunshine by the bridge, as if it’s alive. The digital camera glides outward to disclose colossal celestial beings carved of residing starlight, suspended within the sky like historic guardians.

Their silhouettes stretch throughout the heavens, topped with halos of orbiting moons. Because the traveler strikes ahead, the beings slowly flip their heads, illuminating the trail with cascades of golden cosmic fireplace.

The traveler stops on the fringe of the bridge, cloak billowing, because the scene erupts in a symphony of auroras, taking pictures stars, and resonant cosmic hums.The temper is epic, surreal, and awe-inspiring – a visible surprise that blends fantasy, sci-fi, and dreamlike fantasy.

Right here is the output that the AI device generated:

As you possibly can see, the video is sort of distinctive by way of high quality. It managed to check a complete new state of affairs as talked about within the immediate, and got here up with fairly a nuanced and correct video accordingly. It even tried to include the finer particulars throughout the immediate, just like the lighting on the ft of the determine as he walks on the bridge, in addition to his amber purple eyes.

Having mentioned that, I can see some inconsistencies within the video too. A number of the objects on the far finish are randomly altering shapes all through the video, whereas the celestial beings proven are performing completely random acts. Even the hooded determine is strolling a bit surprisingly, together with his arm completely disappearing from imaginative and prescient after some extent.

Ray3 AI Video Maker: My Expertise

I attempted a number of different movies too, utilizing easy textual content era prompts in addition to some with reference photos. Whereas Ray3 is ready to catch the final function of the video fairly effectively, it largely tends to fail within the nuances of issues and the finer particulars. A video of a fighter jet flying over Noida, as an example, turned out a completely bizarre output. Your complete shot was shaky, and the jet modified form halfway by the video. Similar with a video of an Indian father-son duo taking part in billiards (pool). The balls on the pool desk appeared to seem out of mid-air after which disappear simply as abruptly.

I did some analysis on how Luma Labs greatest suggests using Ray3. As per the corporate, the mannequin works greatest with “brief, pure language, easy prompts. Whereas Ray3 tries to be as correct as attainable to the immediate given, it’s most snug with easy and shorter prompts which can be extremely particular. This additionally means the mannequin is best fitted to movies round objects and environments which were envisioned earlier than. Give it one thing completely distinctive and tends to fumble at midnight.

The place it shines is the best of animations round a reference picture. Merely add the picture you need to animate, and it offers you a high-quality video output, across the identical, even with out the necessity for a immediate. Working example, should you add a picture of a canine, it should animate it with the canine shaking its head or wagging its tail. No immediate wanted. In case there are modifications, you possibly can then point out the identical by follow-up prompts, and Ray3 will get these executed too. Fairly easy, and really helpful.

Conclusion

Whereas Ray3 is spectacular, I really feel it nonetheless has an extended solution to go as an excellent AI video maker. The checklist of latest options it now provides is, little question, extraordinarily helpful. Animating a picture, including a keyframe, and even modifying a video utilizing pure language or visible cues are gamechangers in some ways. As is its means to provide you with HDR movies within the paid model.

However to name it an ideal AI video era device, there may be going to be some time in that.