How to Run an AI Text-to-Speech Agent with OE Runtime

Convert written content into natural-sounding speech audio automatically. OE Runtime connects to ElevenLabs, prepares your text for audio delivery, generates the audio with your chosen voice settings, and returns the file URL — all from a single YAML file.

The Agent YAML

Create a file called agent.yaml inside a speech-audio/ directory:

name: Text to Speech Agent
description: Convert text to natural-sounding speech audio
instructions: |
  You are a speech synthesis agent. Convert provided text to audio using ElevenLabs.
  Choose voice settings appropriate for the content type.
  Complete all steps fully before writing your report.
steps:
  - name: Prepare Content
    content: |
      Prepare the following text for speech synthesis. Clean it for audio delivery -
      expand abbreviations, add natural pause markers, and confirm it reads well aloud:

      "Welcome to Open Enterprise. Your AI automation platform is ready. You can now
      build, deploy, and run intelligent agents that connect to any tool or service.
      Let's get started."
  - name: Generate Audio
    content: |
      Call the ElevenLabs connector to convert the prepared text to speech.
      Use a professional, clear voice. Set stability to 0.7 and similarity boost to 0.8.
      Wait for generation to complete and retrieve the audio file URL or path.
  - name: Report
    content: |
      Summarize the result:
      - Text converted (character count)
      - Voice settings used (voice name, stability, similarity boost)
      - Output audio URL or file path
      - Estimated duration
      - Confirm successful generation
connectors:
  - connection_name: ElevenLabs
    connection_type: elevenlabs

The Config File

Create oe-config.json in the same directory:

{
  "llm": {
    "provider": "openai",
    "model": "gpt-4o",
    "apiKey": "YOUR_OPENAI_API_KEY"
  },
  "server": {
    "enabled": false,
    "port": 3333,
    "apiKey": "your-secret-api-key"
  },
  "connectors": [
    {
      "connection_name": "ElevenLabs",
      "connection_type": "elevenlabs",
      "apiKey": "YOUR_ELEVENLABS_API_KEY",
      "voiceId": "21m00Tcm4TlvDq8ikWAM",
      "modelId": "eleven_multilingual_v2"
    }
  ]
}

Get your ElevenLabs API key from elevenlabs.io/app/settings. The voiceId shown is Rachel — a clear, professional voice. Browse all available voices at elevenlabs.io/voice-library and replace the voiceId with your preferred option. The eleven_multilingual_v2 model supports 29 languages.

Download OE Runtime

Run the Agent

Windows

# Run the agent
oe-runtime-win.exe speech-audio/agent.yaml --config speech-audio/oe-config.json

macOS

# Make executable (first time only)
chmod +x oe-runtime-macos

# Run the agent
oe-runtime-macos speech-audio/agent.yaml --config speech-audio/oe-config.json

Linux

# Make executable (first time only)
chmod +x oe-runtime-linux

# Run the agent
oe-runtime-linux speech-audio/agent.yaml --config speech-audio/oe-config.json

Running as an API Server

Add --serve to start OE Runtime as an HTTP server on port 3333:

oe-runtime-win.exe --serve --config speech-audio/oe-config.json

Then send a request:

curl -X POST http://localhost:3333/run \
  -H "Content-Type: application/json" \
  -d '{"yaml": "speech-audio/agent.yaml", "params": {}}'

Or import the Postman collection (download above) to test all endpoints visually.

Use Cases

• Podcast and audio content production — Convert written articles, blog posts, or scripts into professional-quality audio narrations for podcasts, audio blogs, or newsletter audio editions. The agent handles text preparation, normalises punctuation for natural pacing, and delivers a finished audio file ready for publishing.
• E-learning and training narration — Generate voiceovers for online course videos, training modules, and instructional content without recording studio time or voice talent fees. The agent produces consistent audio quality across hundreds of modules and can be re-run instantly whenever course content is updated.
• Accessibility and inclusive design — Create audio versions of written content — product documentation, help articles, and announcements — to make your product accessible to users with visual impairments or reading difficulties. Audio content also improves accessibility for users in hands-free or mobile contexts.
• IVR and voice assistant scripts — Generate natural-sounding audio prompts for interactive voice response systems, call centre greetings, and voice assistant responses. The agent can produce dozens of variations of the same prompt to A/B test which voice style and phrasing gets the best caller response.
• Video and presentation voiceovers — Add professional narration to marketing videos, product demos, explainer animations, and investor presentations without hiring a voice actor. The agent converts your script to audio in minutes and you can regenerate specific sections instantly if the copy changes.
• Multilingual content delivery — Generate audio in multiple languages using ElevenLabs' multilingual model to serve international audiences with localised voice content. Combined with a translation step, the agent can produce the same content in 29 languages in a single pipeline run.
• Automated customer communications — Convert personalised written messages — appointment reminders, delivery notifications, or account alerts — into audio for delivery via phone or voice messaging. Voice messages have significantly higher engagement rates than text messages for time-sensitive communications.
• Real-time content narration — Run the agent as an API server and call it from your CMS or publishing platform to automatically generate audio versions of every new article or post. Readers who prefer audio can listen rather than read, and your content library builds an audio catalogue passively over time.