Shotcraft
Directory

158 models, and what their licences actually say

Specifications are what each vendor's documentation said on the date we read it. Where a figure could not be sourced, it says so rather than guessing.

Browse by what it makes

Each category has its own page, with a written introduction and a side-by-side comparison of the specs that decide the choice.

158 models

3D assets has no model in this directory. That is a gap in what we have catalogued, not a claim that nothing exists.

Adobe Premiere Pro AI tools (Generative Extend)

Premiere Pro carries a set of Firefly-backed AI features, the best known being Generative Extend, which lengthens a clip's head or tail by generating additional

Editing and post · Adobe

DaVinci Resolve 21 AI tools (Neural Engine)

DaVinci Resolve 21 bundles a large set of Neural Engine AI tools inside a full edit, grade, VFX and audio suite. Version 21 adds AI IntelliSearch for finding pe

Editing and post · Blackmagic Design

Descript Underlord

AI co-editor inside Descript's transcript-based editor that performs editing actions on command: removing filler words, adding captions, generating short clips,

Editing and post · Descript

Google Flow

Google's consumer and prosumer filmmaking app built on Veo 3.1. It wraps generation in a shot-based workflow: text-to-video, Frames to Video, Ingredients to Vid

Editing and post · Google

Kaiber Superstudio

AI video generation and styling tool known for music-video style transformations under the Superstudio interface. Liveness check on 2026-08-14: kaiber.ai still

Editing and post · Kaiber

Luma Modify Video (Ray3.2)

Video-to-video editing mode of Ray3.2. It re-renders existing footage from a natural-language prompt while conditioning on the source, with nine strength preset

Editing and post · Luma AI

OpusClip

Takes long-form video and automatically cuts it into short vertical clips, adding animated captions, reframing to vertical, scoring likely virality and publishi

Editing and post · OpusClip

Pikadditions

Inserts an object or character into existing video footage, matching it to the scene. Exposed as a video-to-video model on the Pika API at a flat per-request pr

Editing and post · Pika

Pikaffects

Preset physical effect transformations applied to an image or an existing video, such as melting, exploding, inflating, crushing or dissolving a subject. Availa

Editing and post · Pika

Pikaswaps

Replaces an object or element in an existing video with a different one while keeping the surrounding footage intact. Exposed as a video-to-video model on the P

Editing and post · Pika

Wan 2.1 VACE (1.3B and 14B)

An all-in-one video creation and editing model built on the Wan 2.1 backbone. It handles reference-to-video, video-to-video restyling, masked inpainting and out

Editing and post · Alibaba Tongyi Lab (Wan)

Adobe Firefly Image Model 5

Adobe's current Firefly image model, announced in public beta at Adobe MAX on 28 October 2025, generating at native 4 MP resolution without an upscale pass. It

Image generation · Adobe

FLUX.1 Kontext [pro] / [max]

Instruction-driven image editing models from the FLUX.1 generation (2025), still exposed as live /flux-kontext-pro and /flux-kontext-max endpoints. They take an

Image generation · Black Forest Labs

FLUX.2 [dev]

32-billion-parameter open-weights checkpoint that does text-to-image plus single- and multi-reference editing in one model, released 25 November 2025 on Hugging

Image generation · Black Forest Labs

FLUX.2 [flex]

Hosted FLUX.2 variant that exposes sampling steps and guidance scale as API parameters, letting callers trade quality and prompt adherence against speed and cos

Image generation · Black Forest Labs

FLUX.2 [klein] (4B / 9B)

Size-distilled open-weights members of the FLUX.2 family, released January 2026 in 4B and 9B sizes plus 'Base' checkpoints intended for fine-tuning and LoRA tra

Image generation · Black Forest Labs

FLUX.2 [max]

Top-tier hosted model in the FLUX.2 family, exposed as the /flux-2-max endpoint on the BFL API. Handles text-to-image plus single- and multi-reference editing i

Image generation · Black Forest Labs

FLUX.2 [pro]

The main hosted FLUX.2 model, launched 25 November 2025, offered as both a rolling preview endpoint and a pinned snapshot for reproducible workflows. Combines t

Image generation · Black Forest Labs

GPT Image 2

OpenAI's current image model (default snapshot gpt-image-2-2026-04-21), served on both /v1/images/generations and /v1/images/edits with documented inpainting su

Image generation · OpenAI

Ideogram 3.0

Previous Ideogram flagship, still fully priced and served on the API, and the version that carries the Character reference feature: one uploaded reference image

Image generation · Ideogram

Ideogram 4.0

Ideogram's current flagship, a 9.3B-parameter diffusion transformer released 3 June 2026 with both API access and downloadable weights. Its distinguishing featu

Image generation · Ideogram

Imagen 4 (Fast / Standard / Ultra)

Google's standalone dedicated text-to-image family (imagen-4.0-fast-generate-001, imagen-4.0-generate-001, imagen-4.0-ultra-generate-001), offering 1K or 2K out

Image generation · Google

Krea 2

Krea's first from-scratch foundation image model, a 12-billion-parameter text-to-image diffusion model released 22 June 2026 with weights published on Hugging F

Image generation · Krea AI

Luma Photon 1 / Photon Flash 1

Luma's image models (photon-1 default, photon-flash-1 for speed) on the same API platform as its Dream Machine video models. Both expose the full control set: i

Image generation · Luma AI

Midjourney V8.2

Midjourney's current default image model, released 24 July 2026 as an aesthetics and reliability update over V8.1. Vendor notes emphasise bolder, more sophistic

Image generation · Midjourney

Nano Banana 2 (Gemini 3.1 Flash Image)

Google's workhorse image model, model ID gemini-3.1-flash-image, described in the docs as the most versatile generalist of the Nano Banana line and the default

Image generation · Google

Nano Banana Pro (Gemini 3 Pro Image)

Google's premium image generation and editing model, model ID gemini-3-pro-image, built on Gemini 3 Pro and announced 20 November 2025. It generates at 1K, 2K a

Image generation · Google

Recraft V4.1 (raster)

Recraft's current raster model, released 14 May 2026, shipped in eight variants across Standard/Pro (higher resolution and finer detail for print) and Utility/U

Image generation · Recraft

Recraft V4.1 Vector

Recraft's vector generation path, which outputs genuinely editable SVG files rather than raster images that need tracing. Available as V4.1 Vector, V4.1 Vector

Image generation · Recraft

Stable Diffusion 3.5 Large

Stability AI's 8-billion-parameter open-weights flagship, a multimodal diffusion transformer aimed at roughly 1-megapixel output. It ships alongside Large Turbo

Image generation · Stability AI

Stable Image Ultra

Stability's highest-quality hosted text-to-image service on its developer platform, positioned above Stable Image Core and updated to run on the Stable Diffusio

Image generation · Stability AI

Flawless DeepEditor and TrueSync

Neural performance editing tools for film and episodic post. DeepEditor applies new dialogue to existing shots and refines performances, covering in-vision ADR,

Lip sync and avatars · Flawless AI

Hedra character / avatar platform

Character and avatar video platform that has grown into a unified inference API putting multiple leading image, video and audio models behind one API key, one e

Lip sync and avatars · Hedra

HeyGen Avatar IV (and Avatar V)

Avatar IV is HeyGen's current default avatar engine, driving a photo, consented digital twin or studio avatar from either a typed script (text to speech) or an

Lip sync and avatars · HeyGen

LatentSync

Open-weights end-to-end lipsync method built on audio-conditioned latent diffusion, generating mouth movement directly from audio without an intermediate motion

Lip sync and avatars · ByteDance

Mirage / Captions

Mirage is a family of end-to-end audio and video foundation models that generate performances, voiceover, captions, graphics and music score, with the output ke

Lip sync and avatars · Mirage (NOCAP, Inc.) / Captions

Synthesia Express-2

Combined video and voice engine that generates full-body avatars which gesture, not just talk. Express-Voice clones a voice in context without fine-tuning, pres

Lip sync and avatars · Synthesia

lipsync-2 and lipsync-2-pro

lipsync-2 is Sync's general-purpose lipsync model, preserving each speaker's individual speaking style at 512x512 resolution. lipsync-2-pro adds diffusion-based

Lip sync and avatars · Sync (Sync Labs)

sync-3

Sync's flagship lipsync model and the current default for all users. Processes an entire shot holistically rather than in snippets, which lets it handle occlusi

Lip sync and avatars · Sync (Sync Labs)

ACE-Step

An open-source music generation foundation model combining diffusion with a lightweight linear transformer, released May 2025 by ACE Studio and StepFun. It gene

Music and sound · ACE Studio / StepFun

AIVA

Generates instrumental music from style presets and influence uploads for video, game and content creators, exporting MP3 and MIDI on lower tiers and WAV plus a

Music and sound · AIVA Technologies

Beatoven.ai maestro

Generates royalty-free background music and text-prompted sound effects for video, podcast, game and advertising work, downloadable as MP3 or WAV with a licence

Music and sound · Beatoven.ai

Eleven Music (music_v2)

Generates songs with vocals or instrumentals from a natural-language prompt, from user lyrics, or from a structured JSON 'composition plan' that specifies secti

Music and sound · ElevenLabs

ElevenLabs Sound Effects (eleven_text_to_sound_v2)

Generates sound effects, foley, ambiences and short musical elements from a text description, from 0.5 to 30 seconds per generation. A loop flag produces seamle

Music and sound · ElevenLabs

Epidemic Sound AI tools (Studio, Search by video, Find similar)

Epidemic Sound is a licensed catalogue of human-made music and sound effects, not a generative music model. Its AI features are retrieval and editing tools: Sea

Music and sound · Epidemic Sound

Google Lyria 3 Clip

The short-form Lyria 3 variant, model ID lyria-3-clip-preview, which produces a fixed 30-second clip from a text prompt with optional lyrics and image reference

Music and sound · Google

Google Lyria 3 Pro

Generates full songs with vocals and timed lyrics from a text prompt, optional user-supplied lyrics and up to ten reference images, at up to about three minutes

Music and sound · Google

Google Lyria RealTime

An experimental streaming music model (models/lyria-realtime-exp) that generates continuous instrumental music over a bidirectional WebSocket while you steer it

Music and sound · Google

Loudly (VEGA / MANTA)

Generates music from text using its VEGA 1-3 instrumental models and MANTA 1 vocal model, then offers an AI Remixer, AI Mastering, a Stem Splitter (vocals, drum

Music and sound · Loudly

Meta MusicGen (AudioCraft)

MusicGen is Meta's open text-to-music model, distributed in the AudioCraft research library alongside AudioGen (text-to-sound), MAGNeT, MusicGen Style (text-and

Music and sound · Meta

Mubert

Generates royalty-free AI music from text prompts, images or a taxonomy of 200+ moods and themes, sold as a consumer 'Render' subscription and as a developer AP

Music and sound · Mubert

SOUNDRAW

Generates royalty-free instrumental and vocal tracks and lets you edit them in the browser: adjust length and energy, toggle instruments, blend genres, and mute

Music and sound · SOUNDRAW

Stable Audio 3.0 Large

The flagship closed-weights model in the Stable Audio 3.0 family, released 20 May 2026 and aimed at music platforms and high-volume production. It generates var

Music and sound · Stability AI

Stable Audio 3.0 Medium

The open-weights mid-size member of the Stable Audio 3.0 family, released 20 May 2026 for full song composition with tracks up to 6:20. Weights are published on

Music and sound · Stability AI

Stable Audio 3.0 Small and Small SFX

Two open-weight on-device variants released 20 May 2026. Small runs full music composition on a mobile device or consumer laptop with tracks up to two minutes;

Music and sound · Stability AI

Stable Audio Open Small

A 0.5B-parameter latent diffusion transformer released 14 May 2025 with Arm, generating up to 11 seconds of 44.1 kHz stereo audio from English text prompts on-d

Music and sound · Stability AI

Suno Studio 2.0

A browser-based generative DAW layered on top of Suno's generation models. It supports MIDI input and built-in synths, industry-standard audio effects including

Music and sound · Suno

Suno v5.5

Generates complete songs with vocals and lyrics from a text prompt, style tags and optionally user-written lyrics, or instrumentals only. v5.5 adds Voices (reco

Music and sound · Suno

Udio v1.5 (Allegro)

Generates songs with vocals from a text prompt and optional user lyrics, in 32-second or 130-second segments that can be extended, remixed, inpainted and arrang

Music and sound · Udio

Magnific Relight

Relighting tool that changes the lighting conditions of an existing image, available in the Magnific app and as an API endpoint. Sits alongside the Magnific ups

Upscaling and restoration · Magnific (formerly Freepik Company)

Magnific Upscaler Creative

Prompt-guided creative upscaler that can introduce or infer new detail while enlarging an image, with controls balancing fidelity against creativity and optiona

Upscaling and restoration · Magnific (formerly Freepik Company)

Magnific Upscaler Precision

High-fidelity super-resolution mode that enlarges images without hallucinating new content, preserving edges, fine detail and text readability while removing no

Upscaling and restoration · Magnific (formerly Freepik Company)

Topaz Astra

Browser-based cloud video enhancement app that runs Topaz's heavier diffusion models in two modes: Creative (Astra 1, Astra 2) for stylised enhancement of AI-ge

Upscaling and restoration · Topaz Labs

Topaz Bloom

Web-based creative image upscaler aimed at digital art and AI-generated images. Scales images up to 8x while generating new detail and texture, with adjustable

Upscaling and restoration · Topaz Labs

Topaz Gigapixel

Still-image upscaler used in video pipelines for stills, plates, matte paintings and frame grabs. Supports upscaling up to 16x with nine models covering Standar

Upscaling and restoration · Topaz Labs

Topaz Project Starlight

Diffusion-based video restoration model that upscales, denoises, de-aliases and sharpens footage in one pass with no sliders, analysing hundreds of surrounding

Upscaling and restoration · Topaz Labs

Topaz Video

Desktop application that upscales, denoises, deinterlaces, stabilises and interpolates frames in existing footage using a library of purpose-built models includ

Upscaling and restoration · Topaz Labs

Adobe Firefly Video Model

The Adobe Firefly Video Model generates video from a text prompt, optionally guided by an image used as the first or final frame. Adobe's Firefly Services API e

Video generation · Adobe

Allegro

A small text-to-video model comprising a 2.8B VideoDiT and a 175M VideoVAE, released under Apache-2.0 in October 2024. It generates 88-frame clips at 720x1280 a

Video generation · Rhymes AI

Amazon Nova Reel 1.1

Amazon Nova Reel generates video from text prompts or from text plus an image, and is available only through Amazon Bedrock. AWS documents output at 1280x720 an

Video generation · Amazon Web Services (Amazon Nova)

ByteDance Seedance 2.0

Seedance 2.0 is ByteDance Seed's unified multimodal audio-video model: a single generation pass accepts text plus mixed references (up to 9 images, 3 video clip

Video generation · ByteDance

CogVideoX1.5-5B (and 5B / 2B / I2V variants)

CogVideoX1.5-5B generates 1360x768 video at 16 fps in frame counts of 16N+1 up to 161 frames (about 10 seconds), with a matching I2V checkpoint. Earlier CogVide

Video generation · Zhipu AI / THUDM (Z.ai)

FramePack

A next-frame-prediction network structure that compresses input context to a constant length, so generation cost does not grow with video length. This lets 13B-

Video generation · lllyasviel (Lvmin Zhang)

Haiper 2.x (discontinued)

Haiper's 2.x text-to-video and image-to-video models were a European alternative to Runway and Pika, built by a London team of Google DeepMind alumni. The produ

Video generation · Haiper AI

Higgsfield Cinematic Studio 3.0 / Video 3.5

Cinematic Studio is Higgsfield's current first-party video pipeline, exposed through the product at higgsfield.ai/generate and through the CLI and API as cinema

Video generation · Higgsfield AI

Higgsfield DoP (Lite / Standard / Turbo)

DoP ('Director of Photography') is Higgsfield's own image-to-video model family, exposed on the API as higgsfield-ai/dop/standard and in the product as Lite, St

Video generation · Higgsfield AI

HunyuanVideo (13B)

Tencent's original open video foundation model, with over 13 billion parameters - the largest open-weights video model at its December 2024 release. Generates 1

Video generation · Tencent Hunyuan

HunyuanVideo 1.5

An 8.3B-parameter video model covering both text-to-video and image-to-video, released with 480p and 720p checkpoints plus a super-resolution stage that upscale

Video generation · Tencent Hunyuan

HunyuanVideo-Avatar

Audio-driven human animation built on HunyuanVideo. Given a character image and an audio track it generates emotion-controllable dialogue video, and supports mu

Video generation · Tencent Hunyuan

HunyuanVideo-I2V

An image-to-video adaptation of HunyuanVideo that uses a token-replace technique to condition on a reference image, emphasizing first-frame consistency. Support

Video generation · Tencent Hunyuan

Kling 2.5 Turbo

Kling 2.5 Turbo (kling-v2-5-turbo) is the previous-generation value model, restricted to text and image input with fixed 5 or 10 second output at 720P or 1080P.

Video generation · Kling AI (Kuaishou Technology)

Kling 2.6

Kling 2.6 (kling-v2-6) generates 3 to 10 second clips at 720P or 1080P from text, image or video input, with optional native audio and voice control at 1080P. I

Video generation · Kling AI (Kuaishou Technology)

Kling 3.0

Kling 3.0 (API name kling-v3) is Kuaishou's flagship general video model, taking text, image or video input and producing 3 to 15 second clips at 720P, 1080P or

Video generation · Kling AI (Kuaishou Technology)

Kling 3.0 Omni

Kling 3.0 Omni (kling-v3-omni) is the multimodal member of the 3.0 family: it accepts text, images and reference video in one request and outputs 3 to 15 second

Video generation · Kling AI (Kuaishou Technology)

Kling 3.0 Turbo

Kling 3.0 Turbo (kling-3.0-turbo) is the cheaper, faster member of the 3.0 family, covering text-to-video and image-to-video at 720P or 1080P for 3 to 15 second

Video generation · Kling AI (Kuaishou Technology)

Kling O1

Kling O1 (kling-video-o1) is a unified video model that takes all-in-one multimodal instructions including reference video, and outputs 3 to 10 second clips at

Video generation · Kling AI (Kuaishou Technology)

LTX-2.5

A 22B-parameter diffusion transformer that generates synchronized video and audio in a single model, using a Gemma-class 12B text encoder and separate video and

Video generation · Lightricks

LTX-Video 13B 0.9.8 (and distilled / 2B variants)

The first-generation LTX-Video family: a 13B DiT plus a distilled 13B and a 2B distilled model, all built for speed via multiscale rendering. It is one of the f

Video generation · Lightricks

Luma Dream Machine / Ray2

Luma's original consumer video product (Dream Machine) and the Ray2 model family behind it, with API model IDs ray-2 and ray-flash-2 and resolution options of 5

Video generation · Luma AI

Luma Ray3.14

Ray3 line model that preceded Ray3.2. Luma's field guide describes it as the default workhorse with 5-10 second text-to-video, 5 second image-to-video, draft th

Video generation · Luma AI

Luma Ray3.2

Luma's current video model, released June 2026. Generates 5 or 10 second clips at up to 1080p from text or images, with six aspect ratios, native HDR in 16-bit

Video generation · Luma AI

Meta Movie Gen (weights unreleased)

A research model family announced by Meta in October 2024 covering text-to-video, personalized video, instruction-based video editing and synchronized audio gen

Video generation · Meta

MiniMax H3

MiniMax H3 is a single multimodal model that accepts text, images, video and audio in one content array and returns 4 to 15 second video at 768P or 2K with nati

Video generation · MiniMax (Hailuo AI)

MiniMax Hailuo 02

MiniMax-Hailuo-02 is the 2025-generation Hailuo model and the only MiniMax V1 model that supports first-and-last-frame generation as well as text-to-video and i

Video generation · MiniMax (Hailuo AI)

MiniMax Hailuo 2.3 (and 2.3-Fast)

MiniMax-Hailuo-2.3 is the previous-generation Hailuo video model, still served on MiniMax's V1 text-to-video and image-to-video endpoints. Output is 6 or 10 sec

Video generation · MiniMax (Hailuo AI)

Mochi 1 (preview)

A 10B-parameter text-to-video diffusion model using an Asymmetric Diffusion Transformer (AsymmDiT) architecture, released as a research preview under Apache-2.0

Video generation · Genmo

Moonvalley Marey (Realism v1.5)

Marey is Moonvalley's foundational video model, marketed as the first commercially safe video model because it is trained only on licensed high-resolution foota

Video generation · Moonvalley

NVIDIA Cosmos 3 (Super / Nano / Edge)

A family of omnimodal world foundation models aimed at physical AI - robotics, autonomous vehicles and simulation - rather than creative filmmaking. Cosmos 3 sh

Video generation · NVIDIA

Open-Sora 2.0

An 11B-parameter open video generation model released with weights, inference code and training code under Apache-2.0. It generates at 256px and 768px in frame

Video generation · HPC-AI Tech (Colossal-AI)

Pika 2.5

Pika's current generation model, available as both text-to-video and image-to-video on the Pika API and in the Pika consumer app. Outputs 720p or 1080p; Pika's

Video generation · Pika

Pika 2.5 Keyframe

Keyframe-driven variant of Pika 2.5, exposed as an image-to-video model on the Pika API. It interpolates between supplied frames rather than generating freely f

Video generation · Pika

PixVerse C1

C1 is PixVerse's first model aimed at film production, announced in April 2026. PixVerse states it generates up to 1080p and 15 seconds with native audio-visual

Video generation · PixVerse

PixVerse V6

V6 is PixVerse's general-purpose flagship, launched 30 March 2026. It covers text-to-video, image-to-video, transition, video extension and fusion (reference-to

Video generation · PixVerse

Pyramid Flow (miniFLUX / SD3)

An autoregressive video generation method based on pyramidal flow matching, trained entirely on open-source datasets and accepted to ICLR 2025. The larger check

Video generation · Pyramid Flow (academic collaboration)

Runway Act-Two

Performance transfer model. You supply a character as an image or video plus a driving reference video of a person performing, and Act-Two maps that performance

Video generation · Runway

Runway Aleph 2.0

In-context video editing model. It takes an existing video plus a text instruction and optional keyframe images, and re-renders the footage to add, remove, rest

Video generation · Runway

Runway Gen-4 Aleph

First-generation Aleph video-to-video editing model, which introduced prompt-driven in-context editing of existing footage at Runway. Discontinued on 2026-07-30

Video generation · Runway

Runway Gen-4 Turbo

Fast, low-cost image-to-video model. It requires a starting image rather than accepting a bare text prompt, and supports a wider set of output aspect ratios tha

Video generation · Runway

Runway Gen-4.5

Runway's current flagship generation model, producing video from text alone or from a starting image. Announced 2025-12-01 for the web app and added to the deve

Video generation · Runway

Seedance 1.0 Pro (closed weights)

ByteDance's commercial video generation model, available in Pro, Pro Fast and Lite tiers via API. It supports text-to-video and image-to-video at 480p, 720p and

Video generation · ByteDance

SkyReels-V2 (Diffusion Forcing / T2V / I2V)

An open video model family whose Diffusion Forcing (DF) variants generate effectively unbounded-length video by autoregressive extension rather than producing a

Video generation · Skywork AI

Sora 2

Generates video with synchronised audio from a text prompt or from a reference image used as the opening frame. Accessible only through the OpenAI Videos API; t

Video generation · OpenAI

Sora 2 Pro

Higher-fidelity tier of Sora 2 aimed at production output, and the only Sora tier that can export 1080p. Same text-and-image inputs and synchronised audio outpu

Video generation · OpenAI

Stable Video Diffusion (SVD-XT)

An image-to-video latent diffusion model that animates a single still image into a short clip at 576x1024. The XT variant is a fine-tune of the original 14-fram

Video generation · Stability AI

Veo 3

Previous-generation Veo model with native audio, superseded by Veo 3.1. Google's Gemini API pricing page marks Veo 3 as deprecated with a scheduled shutdown of

Video generation · Google

Veo 3.1

Generates 4, 6 or 8 second clips with natively generated audio from a text prompt, an image, or up to three reference images. Supports first-and-last-frame inte

Video generation · Google

Veo 3.1 Fast

Lower-latency, lower-cost variant of Veo 3.1 with the same feature surface: native audio, 4K support, up to three reference images, first/last frame and video e

Video generation · Google

Veo 3.1 Lite

Cheapest Veo 3.1 tier, capped at 1080p. Unlike the standard and Fast variants it does not support video extension, 4K output, or reference images. Model ID veo-

Video generation · Google

Vidu Q1

Vidu Q1 is the legacy model kept for existing integrations. It produces exactly 5 second clips at 1080p only, across text-to-video, image-to-video, start-end-to

Video generation · Shengshu Technology (Vidu)

Vidu Q2

Vidu Q2 is the previous generation and the model that established Vidu's reference-to-video positioning: up to seven reference images covering faces, gestures,

Video generation · Shengshu Technology (Vidu)

Vidu Q3-mix

Vidu Q3-mix is the reference-to-video-only Q3 variant that Shengshu describes as the strongest overall balance of visual quality, dynamics and intelligent scene

Video generation · Shengshu Technology (Vidu)

Vidu Q3-pro

Vidu Q3-pro is Shengshu's top-quality Q3 variant for text-to-video, image-to-video and start-end-to-video, producing 1 to 16 second clips at 540p, 720p or 1080p

Video generation · Shengshu Technology (Vidu)

Vidu Q3-turbo

Vidu Q3-turbo is the fast, low-cost Q3 variant covering text-to-video, image-to-video, start-end-to-video and reference-to-video with 540p to 1080p output. Dura

Video generation · Shengshu Technology (Vidu)

Wan 2.1 T2V (1.3B and 14B)

The first widely adopted Apache-2.0 video generation family. T2V-1.3B generates 480P and fits in about 8.19GB of VRAM; T2V-14B handles 480P and 720P. Both produ

Video generation · Alibaba Tongyi Lab (Wan)

Wan 2.2 I2V-A14B

Animates a still image into video, optionally guided by a text prompt, using the same 27B/14B-active mixture-of-experts architecture as the text-to-video siblin

Video generation · Alibaba Tongyi Lab (Wan)

Wan 2.2 S2V-14B

Audio-driven video generation: takes a reference image plus an audio track and produces a speaking or performing subject synchronized to that audio. Output leng

Video generation · Alibaba Tongyi Lab (Wan)

Wan 2.2 T2V-A14B

Generates video from a text prompt using a mixture-of-experts diffusion transformer with 27B total and 14B active parameters, split into a high-noise expert for

Video generation · Alibaba Tongyi Lab (Wan)

Wan 2.2 TI2V-5B

A 5B-parameter dense model that handles both text-to-video and image-to-video in one checkpoint. It uses the Wan2.2-VAE with a 16x16x4 compression ratio to gene

Video generation · Alibaba Tongyi Lab (Wan)

Wan-Animate-2

Character animation and replacement driven directly by a video. It consumes the driving video inside a redesigned diffusion transformer rather than going throug

Video generation · Alibaba Tongyi Lab (Wan)

Aura-2

Deepgram's current TTS model, with 37 English voices plus voices in Spanish, Dutch, German, Italian, French and Japanese - seven languages total. It is priced p

Voice and speech · Deepgram

Azure AI Speech text-to-speech (Neural, Neural HD, MAI voices)

Microsoft's enterprise speech synthesis service, with 200+ prebuilt neural voices across 80+ locales plus tiers for HD voices, multilingual voices, multi-talker

Voice and speech · Microsoft (Azure AI Speech)

Chatterbox Multilingual

An open-weights, 500M-parameter zero-shot TTS model from Resemble AI covering 23+ languages, released under the MIT licence. It clones a voice from a short refe

Voice and speech · Resemble AI

Chirp 3: HD voices (Google Cloud Text-to-Speech)

Google Cloud's current-generation HD voice set, with 28 voices available across 50+ languages and locales. It supports pace control from 0.25x to 2x, pause mark

Voice and speech · Google

Deepdub (eTTS, Speech-to-Speech, Live)

Enterprise AI voice and dubbing stack covering expressive text-to-speech with emotional control, speech-to-speech voice conversion and translation, voice clonin

Voice and speech · Deepdub

Eleven Flash v2.5

The low-latency ElevenLabs model, documented at roughly 75ms model latency with a 40,000-character request limit. It covers 32 languages and is priced at half t

Voice and speech · ElevenLabs

Eleven Multilingual v2

The older ElevenLabs workhorse model, described in the docs as the most stable choice for long-form generation. It covers 29 languages and accepts up to 10,000

Voice and speech · ElevenLabs

Eleven v3

ElevenLabs' most expressive text-to-speech model, aimed at emotionally varied narration rather than lowest latency. It supports natural multi-speaker dialogue a

Voice and speech · ElevenLabs

ElevenLabs Agents

A hosted conversational voice stack that chains a fine-tuned speech-to-text model, a selectable LLM, low-latency TTS and a proprietary turn-taking model. It inc

Voice and speech · ElevenLabs

ElevenLabs Dubbing (v2)

End-to-end dubbing that transcribes, translates and regenerates speech in the source speaker's voice across 90+ languages, with dialect variants in v2. It detec

Voice and speech · ElevenLabs

ElevenLabs Voice Changer (Multilingual STS v2)

Speech-to-speech conversion that keeps the performance of a recorded take - timing, emphasis, delivery - and replaces the timbre with a different voice. Two mod

Voice and speech · ElevenLabs

ElevenLabs Voice Cloning (Instant and Professional)

Two cloning paths: Instant Voice Cloning estimates a voice from 1-2 minutes of audio with no verification, and Professional Voice Cloning fine-tunes a dedicated

Voice and speech · ElevenLabs

Fish Audio S2.1 Pro

Fish Audio's recommended production TTS model, covering 83 languages with natural-language delivery control using bracket syntax and multi-speaker dialogue. Pri

Voice and speech · Fish Audio

Gemini native TTS

Speech generation built into Gemini models, driven by natural-language style instructions rather than SSML. It offers 30 voice options across 60+ auto-detected

Voice and speech · Google

HeyGen Video Translation

Translates an existing video into another language, optionally regenerating the speaker's mouth movements to match the new audio. Offered in a faster Speed mode

Voice and speech · HeyGen

Kokoro-82M

A very small open-weights TTS model - 82M parameters, StyleTTS2 architecture with an ISTFTNet vocoder - released under Apache-2.0. Version 1.0 ships 54 voices a

Voice and speech · hexgrad (Kokoro)

LMNT TTS

A low-latency TTS API with voice cloning from a 5-second recording and 31 languages including mid-sentence language switching. Streaming latency is stated as 15

Voice and speech · LMNT

MiniMax Speech 2.8 (HD and Turbo)

MiniMax's current expressive TTS line, announced January 2026, in an HD variant for quality and a Turbo variant for speed. It supports roughly 40 languages via

Voice and speech · MiniMax (Hailuo AI)

Murf Gen2 (and Falcon 2)

Murf offers two API models: Gen2 for studio-quality customisable synthesis and Falcon 2, a streaming model documented at sub-100ms latency for conversational us

Voice and speech · Murf AI

Octave 2

An LLM-based TTS model that interprets the meaning of the text to choose pronunciation, pitch and tempo rather than reading flatly. It supports designing a voic

Voice and speech · Hume AI

OpenAI transcription (gpt-4o-transcribe, gpt-transcribe, Whisper)

A family of speech-to-text models spanning batch and realtime use: Whisper and gpt-4o-transcribe for files, gpt-4o-transcribe-diarize for speaker-separated tran

Voice and speech · OpenAI

RWS AI Dubbing and Voiceover (formerly Papercup)

AI dubbing and voiceover service delivered as part of RWS's localisation offering. Papercup, previously an independent AI dubbing startup, no longer operates as

Voice and speech · RWS (Papercup)

Rask AI

Video localisation platform that translates video into 135 languages, clones voices in 32 of them, and optionally lip-syncs the speaker to the new audio. Higher

Voice and speech · Rask AI

Respeecher Voice Marketplace (speech-to-speech and TTS)

Speech-to-speech voice conversion that maps one performer's recorded delivery onto a different voice while keeping emotion and dynamics, plus a TTS path. Voices

Voice and speech · Respeecher

Scribe v2

Speech-to-text model covering 90+ languages with word- and character-level timestamps and speaker diarization for up to 32 speakers. It adds entity detection an

Voice and speech · ElevenLabs

Sonic 3.5

Cartesia's current TTS model, documented at sub-90ms first-byte latency across 42 languages. It is tuned for conversational delivery and for reading alphanumeri

Voice and speech · Cartesia

XTTS-v2

An open-weights multilingual TTS and voice cloning model covering 17 languages at 24kHz, still widely used for local voice cloning. Coqui Inc. shut down in Janu

Voice and speech · Coqui (defunct)

gpt-4o-mini-tts

OpenAI's current text-to-speech model, steerable with natural-language instructions about how a line should be delivered. It replaces the older tts-1 and tts-1-

Voice and speech · OpenAI

gpt-realtime-2.1

OpenAI's speech-to-speech model for live conversation, taking audio in and producing audio out with tool use. A mini variant trades quality for roughly a third

Voice and speech · OpenAI