LTX 2.3 Pro: Audio to Video

Try LTX 2.3 Pro: Audio to Video in the Workbench

Run this model interactively, tune parameters, and compare outputs.

Model ID: ltx-2-3-pro-audio-to-video High-fidelity audio-to-video generation from Lightricks LTX-2.3 Pro. Creates video from an input image and audio file, synchronizing visuals with the audio. Supports 1080p output at up to 50 FPS.

Example request

Use the Workbench as a request builder: configure parameters for this model in the UI, then open the API tab to copy the exact cURL or Python call.

Sync
Async
Async with SSE

This blocks until the video is ready (typically 5-15 minutes). Prefer Async or Async with SSE for anything beyond quick experimentation.See the video generation reference for more details.

Minimal
Basic parameters

curl -X POST https://hub.oxen.ai/api/ai/videos/generate \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $OXEN_API_KEY" \
  -d '{
  "model": "ltx-2-3-pro-audio-to-video",
  "input_audio": "https://example.com/audio.mp3"
}'

curl -X POST https://hub.oxen.ai/api/ai/videos/generate \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $OXEN_API_KEY" \
  -d '{
  "model": "ltx-2-3-pro-audio-to-video",
  "prompt": "<prompt>",
  "input_image": "https://hub.oxen.ai/api/repos/elau/assets/file/main/bloxy/bloxy_cropped_512x512.png",
  "input_audio": "https://example.com/audio.mp3"
}'

See the async queue reference for more details.

Minimal
Basic parameters

# Enqueue, capture the generation id.
GEN_ID=$(curl -s -X POST https://hub.oxen.ai/api/ai/queue \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $OXEN_API_KEY" \
  -d '{
  "model": "ltx-2-3-pro-audio-to-video",
  "input_audio": "https://example.com/audio.mp3"
}' | jq -r '.generations[0].generation_id')

# Poll the single generation until it 404s (terminal state).
while curl -s -o /dev/null -w "%{http_code}" \
    -H "Authorization: Bearer $OXEN_API_KEY" \
    "https://hub.oxen.ai/api/ai/queue/$GEN_ID" | grep -q "^200$"; do
  sleep 5
done
echo "Done. See the 'Async with SSE' tab to receive the result URL."

# Enqueue, capture the generation id.
GEN_ID=$(curl -s -X POST https://hub.oxen.ai/api/ai/queue \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $OXEN_API_KEY" \
  -d '{
  "model": "ltx-2-3-pro-audio-to-video",
  "prompt": "<prompt>",
  "input_image": "https://hub.oxen.ai/api/repos/elau/assets/file/main/bloxy/bloxy_cropped_512x512.png",
  "input_audio": "https://example.com/audio.mp3"
}' | jq -r '.generations[0].generation_id')

# Poll the single generation until it 404s (terminal state).
while curl -s -o /dev/null -w "%{http_code}" \
    -H "Authorization: Bearer $OXEN_API_KEY" \
    "https://hub.oxen.ai/api/ai/queue/$GEN_ID" | grep -q "^200$"; do
  sleep 5
done
echo "Done. See the 'Async with SSE' tab to receive the result URL."

See the async queue reference for more details.

Minimal
Basic parameters

# Enqueue, capture the generation id.
GEN_ID=$(curl -s -X POST https://hub.oxen.ai/api/ai/queue \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $OXEN_API_KEY" \
  -d '{
  "model": "ltx-2-3-pro-audio-to-video",
  "input_audio": "https://example.com/audio.mp3"
}' | jq -r '.generations[0].generation_id')

# Stream the SSE channel, grab the data line that follows a
# media_generation_completed event for our id, and pretty-print it.
curl -sN -H "Authorization: Bearer $OXEN_API_KEY" https://hub.oxen.ai/api/events \
  | awk -v id="$GEN_ID" '
    /^event: media_generation_completed$/ { expect=1; next }
    /^data: / && expect {
      payload = substr($0, 7)
      if (index(payload, "\"generation_id\":\"" id "\"")) { print payload; exit }
      expect = 0
    }
  ' | jq .

# Enqueue, capture the generation id.
GEN_ID=$(curl -s -X POST https://hub.oxen.ai/api/ai/queue \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $OXEN_API_KEY" \
  -d '{
  "model": "ltx-2-3-pro-audio-to-video",
  "prompt": "<prompt>",
  "input_image": "https://hub.oxen.ai/api/repos/elau/assets/file/main/bloxy/bloxy_cropped_512x512.png",
  "input_audio": "https://example.com/audio.mp3"
}' | jq -r '.generations[0].generation_id')

# Stream the SSE channel, grab the data line that follows a
# media_generation_completed event for our id, and pretty-print it.
curl -sN -H "Authorization: Bearer $OXEN_API_KEY" https://hub.oxen.ai/api/events \
  | awk -v id="$GEN_ID" '
    /^event: media_generation_completed$/ { expect=1; next }
    /^data: / && expect {
      payload = substr($0, 7)
      if (index(payload, "\"generation_id\":\"" id "\"")) { print payload; exit }
      expect = 0
    }
  ' | jq .

Fetch model details

The models endpoint returns the full model object, including its json_request_schema.

curl -H "Authorization: Bearer $OXEN_API_KEY" https://hub.oxen.ai/api/ai/models/ltx-2-3-pro-audio-to-video

Request parameters

Required parameters

Field	Type	Default	Description
`input_audio`	`string`	—	URL of the audio file to generate a video from. Duration must be between 2 and 20 seconds. Format: uri.

Optional parameters

Field	Type	Default	Description
`prompt`	`string`	—	Text description of how the video should be generated. Required if image is not provided. When image is provided, this describes how the image should be animated.
`input_image`	`string`	—	URL of an image to use as the first frame of the video. If not provided, prompt is required. Format: uri.

Inference API

Try LTX 2.3 Pro: Audio to Video in the Workbench

​Example request

​Fetch model details

​Request parameters

​Required parameters

​Optional parameters

Example request

Fetch model details

Request parameters

Required parameters

Optional parameters