When to use Reference to Video
Use Reference to Video when you need:- Character consistency — the same person or character across multiple shots
- Product accuracy — a real product that must look identical to the original
- Scene continuity — a specific environment or background across generations
- Multi-character scenes — multiple distinct characters interacting without blending
Available models
Kling O3 uses a structured approach with Elements (character identity anchors with frontal + reference images) and Scene Images. Grok Imagine R2V takes a simpler approach — you upload reference images directly and reference them in your prompt with
@Image1, @Image2, etc.
Kling O3 Reference to Video
Core concepts
Kling O3 Reference to Video uses three types of visual input that work together:
*At least one of: start frame, elements, or scene reference images is required.
Elements
An Element is a character or object you want to keep visually stable throughout the video. Each element consists of:- Frontal Image (required per element) — a clear, front-facing photo of the subject. This is the primary identity anchor. Think of it as the “passport photo” of your character or product.
- Reference Images (1–3, optional) — additional angles of the same subject (side view, 45-degree angle, back). These help the model understand the subject in 3D space. If not provided, the frontal image is automatically used as the reference.
@Element1, @Element2, etc.
Scene Reference Images
Scene references define the “stage” where the action takes place. They influence:- Lighting and color palette
- Architecture and environment details
- Overall visual style and mood
@Image1, @Image2, etc. in your prompt.
Limitations
The total number of images across all input types is limited:
Example scenarios:
- 7 elements + 0 scene images = 7 ✓ (no frames)
- 5 elements + 2 scene images = 7 ✓ (no frames)
- First frame (1) + 3 elements + 3 scene images = 7 ✓
- First frame (1) + last frame (1) + 3 elements + 2 scene images = 7 ✓
- First frame (1) + 4 elements = ✗ (max 3 elements with frame)
- First frame (1) + last frame (1) + 4 elements = ✗ (max 3 elements with frames)
Each element requires a frontal image. If you don’t provide reference images for an element, the frontal image is automatically used as the reference.
Multi-shot mode
Multi-shot lets you break a single generation into multiple scenes, each with its own prompt and duration. Elements and scene references carry across all shots, maintaining consistency. The total duration across all shots cannot exceed 15 seconds.Step-by-step guide (Video Studio)
1. Open Video Studio and select the model
Go to venice.ai/video. In the Model Browser on the left, select one of the Kling O3 Reference to Video models:- Kling O3 Pro R2V — higher quality, longer generation time (~6 min)
- Kling O3 Standard R2V — faster, more cost-effective for iteration
2. Add Visual Inputs (at least one required)
You must provide at least one visual input to generate a video: a start frame, an element, or a scene reference image. In the Input Panel, you’ll see the Elements section. Click Add Element to create an element for characters or objects you want to keep visually consistent. For each element:- Click the Frontal tile to upload a clear, front-facing image of your character or object
- Optionally click Add under Reference Images to upload additional angles (1–3)
3. Add Scene Reference Images (optional)
Below the Elements section, you’ll see Scene Reference Images. Upload images that define the environment you want — a specific location, lighting setup, or art style. These are tagged automatically as@Image1, @Image2, etc.
4. Upload a Start Frame (optional)
If you want to control the exact first frame of your video, switch to the Image input type and upload a start frame. You can also optionally set an end frame.5. Write your prompt
In the prompt field, describe the action you want while referencing your elements and scene images using the@ tags:
6. Configure settings
Open Video Settings to adjust:Audio generation adds native sound effects, dialogue, and ambient audio synchronized to the video. It increases cost by ~25%.
7. Generate
Click Generate Video. Kling O3 typically takes 4–6 minutes depending on the model tier and duration. You can queue multiple generations and browse results in the Video Gallery.Multi-shot storyboarding
For narrative sequences, use multi-shot mode to define separate scenes within a single generation.- In the prompt area, click Add Shot to create additional shots
- Write a separate prompt for each shot
- Set the duration for each shot (3–15s each, total ≤ 15s)
Prompting tips
Structure your prompt
Follow this pattern for reliable results:Keep prompts 50–150 words
Shorter prompts lack detail. Longer prompts introduce contradictions. Aim for the sweet spot.Use simple camera language
The model responds best to straightforward camera directions:Use consistent vocabulary
If you describe a character wearing “a red jacket” in one prompt, don’t switch to “crimson coat” in the next. The model treats different words as different intent.Place camera instructions early
Put the camera direction near the beginning of the prompt for more reliable results:Kling O3 Pricing
Kling O3 Reference to Video models use duration-based pricing:
Example: A 10-second video with audio = 10 × 1.40**
Use the Video Quote API for exact pricing before generation.
Kling O3 API usage
Kling O3 Reference to Video is also available via the Venice API. See the Video Queue API for full details.Python
Node.js
cURL
Element schema
Each element in theelements array accepts:
The API also supports
video_url for video-based elements, but this is not currently available in the Video Studio UI.Kling O3 Troubleshooting
Grok Imagine Reference to Video
Grok Imagine R2V takes a simpler approach than Kling O3. Instead of structured Elements with frontal/reference image separation, you upload flat reference images and reference them directly in your prompt using@Image1, @Image2, etc. The model incorporates those subjects into the generated video.
How it works
- Upload 1–7 reference images — photos of characters, objects, or scenes you want in the video
- Write a prompt that describes the video, using
@Image1,@Image2, etc. to reference specific images - The model generates a video incorporating those references
@Image tags in your prompt, all uploaded images are referenced automatically.
Settings
Grok Imagine R2V does not support audio generation, multi-shot mode, or Elements. For those features, use Kling O3 R2V.
Step-by-step guide (Video Studio)
1. Select the model
Go to venice.ai/video. In the Model Browser, select Grok Imagine R2V.2. Upload reference images
Click References in the input toolbar (or use the + menu) to open the reference images panel. Upload 1–7 images of the characters, objects, or scenes you want in the video. Each image is automatically tagged as@Image1, @Image2, etc. in the order you upload them (left to right).
3. Write your prompt
Describe the video you want. Use@Image tags to reference specific images:
@ in the prompt field to see an autocomplete menu of available image references.
4. Configure settings and generate
Open Video Settings to adjust aspect ratio, resolution, and duration. Click Generate Video.Grok Imagine R2V Pricing
Grok Imagine R2V uses duration and resolution-based pricing:
Example: An 8-second video at 480p = 8 × 0.50**
Grok Imagine charges a content moderation fee for generated videos, even if the video is rejected. This is reflected in the credit cost shown before generation.
Grok Imagine R2V API usage
Python
Node.js
cURL
API parameters
Grok Imagine R2V does not use the
elements, image_urls, or imageUrl fields. All reference images are passed via referenceImageUrls.