Skip to content
  • Models
  • Rankings
  • Ori
Sign Up
Sign Up
OpenRouterOpenRouter
© 2026 OpenRouter, Inc

Product

  • Chat
  • Rankings
  • Benchmarks
  • Apps
  • Discover
  • Models
  • Collections
  • Providers
  • Pricing
  • Business
  • Enterprise
  • Labs

Company

  • About
  • Blog
  • Careers
    Hiring
  • Privacy
  • Terms of Service
  • Trust Center
  • Support
  • Works With OR
  • Data
  • Brand

Developer

  • Documentation
  • API Reference
  • Developer Platform
  • Status

Connect

  • Discord
  • GitHub
  • LinkedIn
  • X
  • YouTube
All benchmarks

Media benchmarks

Compare generation quality across media models

ImageVideoSpeechMemes
Fidelity
Plain sentenceFive nos
Normalization
Invoice lineDirections and units
Prosody
Punctuation
Cues
Bracketed cueNonverbal cue
Language
Other languageCode switch
Length
One wordFull paragraph
Literalness
Embedded instruction

Bracketed cue

Why we chose this prompt: Bracketed stage directions like [whispering] and [excited] are a common way to direct delivery. The model has to act on them and not read them aloud, and the two cues in one prompt test whether it can switch.

Prompt

[whispering] Route 6 Espresso is open till nine, and the last train leaves at eleven fifty-six. [excited] The last train leaves at eleven fifty-six!

Sort by
  • Favicon for google

    Zephyr

    Cost
    --
    Generation time
    10.0s
    Correctness
    100%
  • Favicon for microsoft

    en-US-Harper:MAI-Voice-2

    Cost
    $0.003
    Generation time
    2.3s
    Correctness
    100%
  • Favicon for qwen

    loongjohn

    Cost
    $0.002
    Generation time
    3.1s
    Correctness
    100%
  • Favicon for qwen

    longanlingxin

    Cost
    $0.003
    Generation time
    2.9s
    Correctness
    100%
  • Favicon for x-ai

    eve

    Cost
    $0.002
    Generation time
    1.6s
    Correctness
    100%
  • Favicon for fish-audio

    provider default

    Cost
    $0.002
    Generation time
    1.5s
    Correctness
    96%
  • Favicon for fish-audio

    provider default

    Cost
    $0.002
    Generation time
    2.3s
    Correctness
    93%
  • Favicon for microsoft

    en-US-Harper:MAI-Voice-2

    Cost
    $0.002
    Generation time
    1.9s
    Correctness
    90%
  • Favicon for mistralai

    en_paul_sad

    Cost
    $0.000
    Generation time
    2.1s
    Correctness
    90%
  • Favicon for fish-audio

    provider default

    Cost
    --
    Generation time
    1.3s
    Correctness
    86%
  • Favicon for canopylabs

    tara

    Cost
    $0.001
    Generation time
    10.5s
    Correctness
    83%
  • Favicon for hexgrad

    af_alloy

    Cost
    $0.000092
    Generation time
    3.6s
    Correctness
    83%
  • Favicon for minimax

    English_expressive_narrator

    Cost
    $0.015
    Generation time
    2.3s
    Correctness
    83%
  • Favicon for minimax

    English_expressive_narrator

    Cost
    $0.009
    Generation time
    1.4s
    Correctness
    83%
  • Favicon for deepgram

    aura-2-thalia-en

    Cost
    $0.004
    Generation time
    4.1s
    Correctness
    77%
  • Favicon for sesame

    conversational_a

    Cost
    $0.001
    Generation time
    9.9s
    Correctness
    43%