Skip to content

Swan ElevenLabs Agent Package

Use these files to configure the Swan voice agent in ElevenLabs.

  • System prompt: paste into the ElevenLabs agent instructions. This controls behavior, tone, safety boundaries, and conversation style.
  • Swan Recovery Playbook: upload as the knowledge base. This gives the agent deeper EasyPeasy-style recovery context to retrieve during conversation.

The system prompt should stay relatively compact. Put the agent's behavior in the prompt, and put longer recovery context in the knowledge base.

Set up in ElevenLabs

  1. Open ElevenLabs and create or edit the Swan Conversational AI agent.
  2. Open System prompt.
  3. Copy the system prompt block into the agent instructions or system prompt field.
  4. Copy the first message into the first-message or opening-message field.
  5. Open Swan Recovery Playbook.
  6. Upload the playbook as the agent knowledge base.
  7. Attach or enable that knowledge base for the Swan agent.
  8. Save the agent.
  9. Run a direct ElevenLabs test call before testing through Swan.
  • First message: use the first message from the system prompt file.
  • Model: start with the balanced default recommended by ElevenLabs for conversational agents. If the agent feels shallow, test a stronger reasoning model and compare latency.
  • Voice: choose a calm, grounded, emotionally expressive voice. Avoid a sales, hype, or customer-support tone.
  • Turn-taking: use a patient setting so the user has room to speak.
  • Interruptions: keep interruptions enabled so the user can cut in naturally.
  • Timeout: after a few seconds of silence, use a quiet check-in such as I'm here. Take your time.

Open source browser intervention software.