Kling O1 - Reference to Video

Try Kling O1 - Reference to Video in the Workbench

Run this model interactively, tune parameters, and compare outputs.

Model ID: kling-video-o1-reference-to-video Kling O1 - Reference to Video is a multimodal video generation model designed for reference-guided video synthesis. It excels in transforming reference videos or images into new sequences while preserving motion dynamics, camera movements, and visual styles for consistent outputs. Some other noteworthy features of Kling O1 - Reference to Video include image-to-video transformations, multi-reference image conditioning (up to 7 images), scene extension with continuity, and support for start/end frames or keyframes.

Metric	Value
Parameter Count	Unknown
Mixture of Experts	Unknown
Context Length	Unknown
Multilingual	No
Quantized*	Unknown

*Quantization is specific to the inference provider and the model may be offered with different quantization levels by other providers.

Example request

Use the Workbench as a request builder: configure parameters for this model in the UI, then open the API tab to copy the exact cURL or Python call.

Sync
Async
Async with SSE

This blocks until the video is ready (typically 5-15 minutes). Prefer Async or Async with SSE for anything beyond quick experimentation.See the video generation reference for more details.

Minimal
Basic parameters
All parameters

curl -X POST https://hub.oxen.ai/api/ai/videos/generate \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $OXEN_API_KEY" \
  -d '{
  "model": "kling-video-o1-reference-to-video",
  "prompt": "@Element1 flies into the scene and lands on the table next to the ox in @Image1",
  "input_image": [
    "https://hub.oxen.ai/api/repos/ox/Oxen-AI-Assets/file/main/images/daily_moo.png"
  ]
}'

curl -X POST https://hub.oxen.ai/api/ai/videos/generate \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $OXEN_API_KEY" \
  -d '{
  "model": "kling-video-o1-reference-to-video",
  "prompt": "@Element1 flies into the scene and lands on the table next to the ox in @Image1",
  "input_image": [
    "https://hub.oxen.ai/api/repos/ox/Oxen-AI-Assets/file/main/images/daily_moo.png"
  ],
  "elements": [
    {
      "frontal_image_url": "https://hub.oxen.ai/api/repos/ox/Oxen-AI-Assets/file/main/images/red_bird.png",
      "reference_image_urls": [
        "https://hub.oxen.ai/api/repos/ox/Oxen-AI-Assets/file/main/images/red_bird_side.png"
      ]
    }
  ]
}'

curl -X POST https://hub.oxen.ai/api/ai/videos/generate \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $OXEN_API_KEY" \
  -d '{
  "model": "kling-video-o1-reference-to-video",
  "prompt": "@Element1 flies into the scene and lands on the table next to the ox in @Image1",
  "input_image": [
    "https://hub.oxen.ai/api/repos/ox/Oxen-AI-Assets/file/main/images/daily_moo.png"
  ],
  "elements": [
    {
      "frontal_image_url": "https://hub.oxen.ai/api/repos/ox/Oxen-AI-Assets/file/main/images/red_bird.png",
      "reference_image_urls": [
        "https://hub.oxen.ai/api/repos/ox/Oxen-AI-Assets/file/main/images/red_bird_side.png"
      ]
    }
  ],
  "aspect_ratio": "16:9",
  "duration": 5
}'

See the async queue reference for more details.

Minimal
Basic parameters
All parameters

# Enqueue, capture the generation id.
GEN_ID=$(curl -s -X POST https://hub.oxen.ai/api/ai/queue \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $OXEN_API_KEY" \
  -d '{
  "model": "kling-video-o1-reference-to-video",
  "prompt": "@Element1 flies into the scene and lands on the table next to the ox in @Image1",
  "input_image": [
    "https://hub.oxen.ai/api/repos/ox/Oxen-AI-Assets/file/main/images/daily_moo.png"
  ]
}' | jq -r '.generations[0].generation_id')

# Poll until the generation reaches a terminal status.
while true; do
  STATUS=$(curl -s -H "Authorization: Bearer $OXEN_API_KEY" \
    "https://hub.oxen.ai/api/ai/queue/$GEN_ID" | jq -r '.status')
  echo "Status: $STATUS"
  case $STATUS in succeeded|failed|cancelled) break;; esac
  sleep 5
done

# Print the result.
curl -s -H "Authorization: Bearer $OXEN_API_KEY" \
  "https://hub.oxen.ai/api/ai/queue/$GEN_ID" | jq .

# Enqueue, capture the generation id.
GEN_ID=$(curl -s -X POST https://hub.oxen.ai/api/ai/queue \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $OXEN_API_KEY" \
  -d '{
  "model": "kling-video-o1-reference-to-video",
  "prompt": "@Element1 flies into the scene and lands on the table next to the ox in @Image1",
  "input_image": [
    "https://hub.oxen.ai/api/repos/ox/Oxen-AI-Assets/file/main/images/daily_moo.png"
  ],
  "elements": [
    {
      "frontal_image_url": "https://hub.oxen.ai/api/repos/ox/Oxen-AI-Assets/file/main/images/red_bird.png",
      "reference_image_urls": [
        "https://hub.oxen.ai/api/repos/ox/Oxen-AI-Assets/file/main/images/red_bird_side.png"
      ]
    }
  ]
}' | jq -r '.generations[0].generation_id')

# Poll until the generation reaches a terminal status.
while true; do
  STATUS=$(curl -s -H "Authorization: Bearer $OXEN_API_KEY" \
    "https://hub.oxen.ai/api/ai/queue/$GEN_ID" | jq -r '.status')
  echo "Status: $STATUS"
  case $STATUS in succeeded|failed|cancelled) break;; esac
  sleep 5
done

# Print the result.
curl -s -H "Authorization: Bearer $OXEN_API_KEY" \
  "https://hub.oxen.ai/api/ai/queue/$GEN_ID" | jq .

# Enqueue, capture the generation id.
GEN_ID=$(curl -s -X POST https://hub.oxen.ai/api/ai/queue \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $OXEN_API_KEY" \
  -d '{
  "model": "kling-video-o1-reference-to-video",
  "prompt": "@Element1 flies into the scene and lands on the table next to the ox in @Image1",
  "input_image": [
    "https://hub.oxen.ai/api/repos/ox/Oxen-AI-Assets/file/main/images/daily_moo.png"
  ],
  "elements": [
    {
      "frontal_image_url": "https://hub.oxen.ai/api/repos/ox/Oxen-AI-Assets/file/main/images/red_bird.png",
      "reference_image_urls": [
        "https://hub.oxen.ai/api/repos/ox/Oxen-AI-Assets/file/main/images/red_bird_side.png"
      ]
    }
  ],
  "aspect_ratio": "16:9",
  "duration": 5
}' | jq -r '.generations[0].generation_id')

# Poll until the generation reaches a terminal status.
while true; do
  STATUS=$(curl -s -H "Authorization: Bearer $OXEN_API_KEY" \
    "https://hub.oxen.ai/api/ai/queue/$GEN_ID" | jq -r '.status')
  echo "Status: $STATUS"
  case $STATUS in succeeded|failed|cancelled) break;; esac
  sleep 5
done

# Print the result.
curl -s -H "Authorization: Bearer $OXEN_API_KEY" \
  "https://hub.oxen.ai/api/ai/queue/$GEN_ID" | jq .

See the async queue reference for more details.

Minimal
Basic parameters
All parameters

# Enqueue, capture the generation id.
GEN_ID=$(curl -s -X POST https://hub.oxen.ai/api/ai/queue \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $OXEN_API_KEY" \
  -d '{
  "model": "kling-video-o1-reference-to-video",
  "prompt": "@Element1 flies into the scene and lands on the table next to the ox in @Image1",
  "input_image": [
    "https://hub.oxen.ai/api/repos/ox/Oxen-AI-Assets/file/main/images/daily_moo.png"
  ]
}' | jq -r '.generations[0].generation_id')

# Stream the SSE channel, grab the data line that follows a
# media_generation_completed event for our id, and pretty-print it.
curl -sN -H "Authorization: Bearer $OXEN_API_KEY" https://hub.oxen.ai/api/events \
  | awk -v id="$GEN_ID" '
    /^event: media_generation_completed$/ { expect=1; next }
    /^data: / && expect {
      payload = substr($0, 7)
      if (index(payload, "\"generation_id\":\"" id "\"")) { print payload; exit }
      expect = 0
    }
  ' | jq .

# Enqueue, capture the generation id.
GEN_ID=$(curl -s -X POST https://hub.oxen.ai/api/ai/queue \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $OXEN_API_KEY" \
  -d '{
  "model": "kling-video-o1-reference-to-video",
  "prompt": "@Element1 flies into the scene and lands on the table next to the ox in @Image1",
  "input_image": [
    "https://hub.oxen.ai/api/repos/ox/Oxen-AI-Assets/file/main/images/daily_moo.png"
  ],
  "elements": [
    {
      "frontal_image_url": "https://hub.oxen.ai/api/repos/ox/Oxen-AI-Assets/file/main/images/red_bird.png",
      "reference_image_urls": [
        "https://hub.oxen.ai/api/repos/ox/Oxen-AI-Assets/file/main/images/red_bird_side.png"
      ]
    }
  ]
}' | jq -r '.generations[0].generation_id')

# Stream the SSE channel, grab the data line that follows a
# media_generation_completed event for our id, and pretty-print it.
curl -sN -H "Authorization: Bearer $OXEN_API_KEY" https://hub.oxen.ai/api/events \
  | awk -v id="$GEN_ID" '
    /^event: media_generation_completed$/ { expect=1; next }
    /^data: / && expect {
      payload = substr($0, 7)
      if (index(payload, "\"generation_id\":\"" id "\"")) { print payload; exit }
      expect = 0
    }
  ' | jq .

# Enqueue, capture the generation id.
GEN_ID=$(curl -s -X POST https://hub.oxen.ai/api/ai/queue \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $OXEN_API_KEY" \
  -d '{
  "model": "kling-video-o1-reference-to-video",
  "prompt": "@Element1 flies into the scene and lands on the table next to the ox in @Image1",
  "input_image": [
    "https://hub.oxen.ai/api/repos/ox/Oxen-AI-Assets/file/main/images/daily_moo.png"
  ],
  "elements": [
    {
      "frontal_image_url": "https://hub.oxen.ai/api/repos/ox/Oxen-AI-Assets/file/main/images/red_bird.png",
      "reference_image_urls": [
        "https://hub.oxen.ai/api/repos/ox/Oxen-AI-Assets/file/main/images/red_bird_side.png"
      ]
    }
  ],
  "aspect_ratio": "16:9",
  "duration": 5
}' | jq -r '.generations[0].generation_id')

# Stream the SSE channel, grab the data line that follows a
# media_generation_completed event for our id, and pretty-print it.
curl -sN -H "Authorization: Bearer $OXEN_API_KEY" https://hub.oxen.ai/api/events \
  | awk -v id="$GEN_ID" '
    /^event: media_generation_completed$/ { expect=1; next }
    /^data: / && expect {
      payload = substr($0, 7)
      if (index(payload, "\"generation_id\":\"" id "\"")) { print payload; exit }
      expect = 0
    }
  ' | jq .

Fetch model details

The models endpoint returns the full model object, including its json_request_schema.

curl -H "Authorization: Bearer $OXEN_API_KEY" https://hub.oxen.ai/api/ai/models/kling-video-o1-reference-to-video

Request parameters

Required parameters

Field	Type	Default	Description
`prompt`	`string`	`"@Element1 flies into the scene and lands on the table next to the ox in @Image1"`	Text description of what you want to generate, or the instruction on how to edit the given image.
`input_image`	`array<string>`	`["https://hub.oxen.ai/api/repos/ox/Oxen-AI-Assets/file/main/images/daily_moo.png"]`	Optional reference images. Use @Image1, @Image2, etc. in the prompt to refer to them.

Optional parameters

Field	Type	Default	Description
`elements`	`array<object>`	`[{"frontal_image_url": "https://hub.oxen.ai/api/repos/ox/Oxen-AI-Assets/file/main/images/red_bird.png", "reference_image_urls": ["https://hub.oxen.ai/api/repos/ox/Oxen-AI-Assets/file/main/images/red_bird_side.png"]}]`	Optional element references. Use @Element1, @Element2, etc. in the prompt to refer to them.
`aspect_ratio`	`string`	`"16:9"`	Video aspect ratio One of: 9:16, 1:1, 16:9.
`duration`	`integer`	`5`	Video duration in seconds One of: 5, 10.

Inference API

Documentation Index

Try Kling O1 - Reference to Video in the Workbench

​Example request

​Fetch model details

​Request parameters

​Required parameters

​Optional parameters

Example request

Fetch model details

Request parameters

Required parameters

Optional parameters