Skip to main content

Multimodal Inputs

UserMessage.content accepts either plain text or an ordered array of multimodal content parts.

Source Types

Use source.type to describe payload delivery:
  • data: Inline base64 payload with required mimeType
  • url: HTTP(S) or data URL, optional mimeType

Common Use Cases

Visual QA

Audio transcription

Mixed media comparison