---
title: "Multimodal input"
slug: plugins/unity/Samples~/MultimodalInput
---

<a id="multimodal-input"></a>

Attach `MultimodalInputExample` and `AstralRuntimeInitializer` to a GameObject.
Assign a readable `RGBA32` texture for image calls and an accessible `AudioClip`
for audio calls. Set `mediaProjectorPath` to the projector or encoder GGUF used
by the selected model.

- `RunImageGeneration` feeds the prompt and caller-owned texture bytes.
- `RunAudioGeneration` copies interleaved clip samples into a temporary
  `NativeArray<float>` and feeds explicit channel and sample-rate metadata.
- `EmbedImage` enqueues a multimodal embedding, creates a generic request
  reference, collects into a caller-owned vector, and reports terminal status.

Every path checks model capabilities before calling the media API. Texture and
audio memory remain valid until the synchronous feed or collect operation
returns.

Source: [View the pinned source](https://github.com/Cosmin-B/astral-runtime/blob/f2d13b77c70624ede5bc06823d4a794a4b955e10/plugins/unity/Samples~/MultimodalInput/README.md) · [Edit this source](https://github.com/Cosmin-B/astral-runtime/edit/main/plugins/unity/Samples~/MultimodalInput/README.md)