LTXV Text To Video
Video Lecture
| Section | Video Links |
|---|---|
| LTXV Text To Video |   |
(Pay Per View)
You can use PayPal to purchase a one time viewing of this video for $1.49 USD.
Description
LTX-Video is the first DiT-based video generation model capable of generating high-quality videos in real-time. It produces 30 FPS videos at a 1216×704 resolution faster than they can be watched.
Install LTXV Checkpoints
Place the required checkpoint models into your ComfyUI/models/checkpoints/ folder.
FP8
ltxv-2b-0.9.8-distilled-fp8.safetensors (4.46 GB)
ltxv-13b-0.9.8-distilled-fp8.safetensors (15.7 GB)
FP16
ltxv-2b-0.9.8-distilled.safetensors (6.34 GB)
ltxv-13b-0.9.8-distilled.safetensors (28.6 GB)
Install T5 Text Encoder
Since the clip (text encoder) is not included in the LTXV checkpoint downloads, we need to install a clip text encoder separately. This will be used to process and understand the prompts.
Download t5xxl_fp16.safetensors and save into ComfyUI/models/clip_/
If you have a low VRAM GPU, you can try instead to use t5xxl_fp8_e4m3fn.safetensors.
The T5 encoder can follow complex and detailed descriptions, allowing users with less technical knowledge to create effective prompts for image generation.
Prompt Engineering
Since we are using the T5 text encoder, LTXV can handle quite large and more descriptive prompts averaging 100 words or more.
When writing prompts, it can help to consider these factors,
- Scene Setup:
A [person/people/object] is [action] in [location]. - Character/Object Detail:
They are [describe clothing, appearance, or surrounding details]. - Scene Shift (1–2s in):
Suddenly, [unexpected change occurs]. - Camera Movement:
The camera starts [describe shot type], then [describe how it shifts focus after the event]. - Lighting/Atmosphere:
Lighting is [tone/color], with [time of day or season].
Sample Prompts
| Prompt | Workflow |
|---|---|
A lone fisherman rows across a foggy bay at dawn. The fisherman wears a weathered coat, his face lined with years of sea life, and a wooden oar creaks against the boat. The camera begins with a wide aerial shot, then slowly cranes down to eye level as ripples widen across the water. Lighting is soft, bluish tones of early morning, with golden sunlight breaking faintly through the mist. |
 |
A young woman runs through a sunflower field in late summer. Her white dress flows in the wind, hair catching the light as she brushes her fingertips against tall blossoms. The camera tracks alongside her in a dolly shot, occasionally cutting to close-ups of her hands and the flowers swaying. Lighting is warm golden-hour sunlight with saturated yellows and deep orange flares. |
 |
A street performer plays violin under a rain-soaked neon sign in the city at night. The performer is middle-aged, dressed in a long coat, with water dripping from the brim of his hat, bow strokes echoing against wet pavement. The camera pushes in slowly from a wide shot, lens flares from neon lights reflecting off puddles. Lighting is moody with magenta and cyan neon tones bouncing off rain, creating a cinematic, noir atmosphere. |
 |
Two mountaineers rest on a rocky cliff, overlooking a vast snow-covered valley. Both wear heavy climbing gear, ice axes resting at their sides, as they gaze toward a distant summit. The camera orbits around them in a slow 360-degree drone shot, revealing the scale of the landscape. Lighting is crisp white daylight of early winter, with pale blue shadows stretching across the snow. |
 |
A couple dances slowly in the middle of an empty train station at midnight. They wear vintage clothing—he in suspenders and a hat, she in a flowing dress—echoes of jazz faintly playing as their steps echo on marble floors. The camera dollies backward in a wide shot, then arcs in a circular movement around them. Lighting is cool blue overhead lamps with a single warm spotlight spilling through a high arched window. |
 |
A surfer waits on their board, floating in still waters just before dawn. The ocean is glassy and calm, horizon glowing faint orange as seabirds pass overhead, the surfer poised in anticipation. The camera starts beneath the waterline, half submerged, then tilts up to reveal the silhouette against the sunrise. Lighting is soft pre-dawn hues, with gradients of lavender and pale pink. |
 |
With Scene Shifts
| Prompt | Workflow |
|---|---|
A woman paints on a canvas set up by the seaside, waves rolling softly behind her. Her brushstrokes are calm and deliberate, a straw hat shielding her face from the sun. One second in, a sudden gust of wind rips the canvas from its stand, sending it tumbling toward the shore. The camera starts with a medium over-the-shoulder shot, then whips to follow the flying canvas as it skids across the sand. Lighting is vibrant midday sun with crisp blue tones. |
 |
A woman sips coffee at a small cafe table on a quiet street corner in autumn. She wears a wool scarf, notebook open beside her cup, leaves drifting down from nearby trees. One second in, a gust of wind flips the notebook pages and sends a loose leaf skittering across the cobblestones. The camera begins on a medium shot of her sipping, then pans quickly to track the runaway paper. Lighting is soft golden morning light with warm amber and russet tones from fallen leaves. |
|
An elderly woman tends roses in a small garden behind her cottage. She wears a wide-brimmed hat, gently pruning blossoms with silver shears. The camera begins in a tight shot of her hands trimming roses, then racks focus to a cat perched on the wall. Lighting is sunny blue skies, filtered through shifting tree branches. |
 |
A jogger runs along a foggy forest trail, breath visible in the chilly morning air. She wears headphones, a bright red jacket. A deer unexpectedly darts across the path in front of her. The camera starts with a steady tracking shot from behind, then quickly pans to capture the deer disappearing into the mist. Lighting is muted blue-gray dawn, fog diffusing the light through the trees. |
 |
A painter stands on a cliffside, sketching the ocean horizon on a large canvas. Waves crash far below, wind tugging at his coat, brushes scattered on a nearby stool. One second in, a seagull swoops low, nearly brushing the edge of the canvas before climbing skyward. The camera begins in a wide shot framing both painter and horizon, then tilts up to follow the bird's flight. Lighting is crisp late-afternoon sunlight with golden reflections bouncing off the sea. |
 |
Two friends sit on a train, one gazing out the window while the other sketches in a notebook. The window shows fields rushing by, reflections flickering across their faces. One second in, the sketcher's pencil snaps, startling both of them. The camera begins focused on the friend staring out the window, then quickly pans to the sketcher fumbling with the broken pencil. Lighting is soft morning light filtering through the moving train windows, casting shifting shadows. |