Twitter/X

Decide autonomy first: 'in the loop' = human approves, 'on the loop' = AI decides…

2026-05-12 · 16:06 UTC ·@coreyganim ·1 min read

Brief

Corey Ganim outlines a no-code method to build an appointment-booking voice agent that can go live and take calls in under an hour. He recommends choosing an autonomy level by risk, separating agent instructions from the knowledge base, enforcing a five-part system prompt, adding an emergency safety check and two-strike handoff, then deploying via Voiceflow + Twilio with collaborator @SJW75.

Why it matters

Decide autonomy first: 'in the loop' = human approves, 'on the loop' = AI decides with supervision, 'fully autonomous' = AI runs free; choose by asking 'what's the impact of a bad decision?'

Key details

  • Use two docs only: Agent instructions (behavior) and Knowledge Base (content) kept separate so updates are a single change; system prompt must include five sections — Identity, Voice, Speech characteristics, Core rules, Conversation flow — missing one makes the agent go off-script.
  • Prioritize safety and handoffs: implement an emergency safety question that routes to a human on a bad answer, use a two-strike rule (transfer after two failed attempts), then paste the prompt into Voiceflow (auto-generates flow), upload the knowledge base, and connect Twilio to go live (claim: under an hour); collaborator: @SJW75 (video piped.video/watch?v=owkictxN).
Source evidence

how to build a voice agent that books appointments on autopilot without a single line of code (live and taking calls in under an hour):

  1. Pick your autonomy level first. In the loop = human approves. On the loop = AI decides, you supervise. Fully autonomous = AI runs free. The question that decides it: what's the impact of a bad decision?

  2. Two docs run the whole agent. Agent instructions = how it behaves. Knowledge base = what it knows. Keep them separate so updating is one line, not a rebuild.

  3. The system prompt has 5 required sections. Identity. Voice. Speech characteristics. Core rules. Conversation flow. Skip one and the agent goes off-script on the first real call.

  4. Tell it what NOT to do, not just what to do. LLMs are wired to win the game. Without "do not" rules, your appointment bot will start troubleshooting client problems mid-call.

  5. Build the emergency check first. For anything high-stakes, ask the safety question before anything else. Bad answer = exit and route to a human. Everything else depends on this branch.

  6. The two-strike rule prevents bad reviews. Asked twice and still can't get it? Transfer to a human. A clean handoff beats a janky save every time.

  7. The full build is 4 steps. Paste the prompt into Voiceflow. It auto-generates the flow. Upload the knowledge base. Connect Twilio.

Full build with @SJW75 (one of the actual OGs of conversational AI, building voice agents since 2017) in the video below:

piped.video/watch?v=owkictxN…

(also available on the Build With AI podcast wherever you get your pods)

Video