Automated voice bot that calls Pretty Good AI's test line and simulates realistic patient conversations to evaluate agent quality and find bugs.
See ARCHITECTURE.md for full system design and decision rationale.
python make_calls.py- Twilio: twilio.com/try-twilio
- Deepgram: console.deepgram.com
- Groq: console.groq.com
- ngrok: ngrok.com/download
pip install -r requirements.txt
cp .env.example .env
# Fill in your keysngrok http 8000
# Copy the https URL into PUBLIC_URL in .envuvicorn main:app --host 0.0.0.0 --port 8000python make_calls.pypython download_recordings.py| # | Name | Tests |
|---|---|---|
| 1 | new_appointment | Standard scheduling |
| 2 | reschedule | Change existing appointment |
| 3 | medication_refill | Refill workflow |
| 4 | cancel_appointment | Cancellation handling |
| 5 | practice_info | Hours and insurance questions |
| 6 | weekend_request | Edge: closed on weekends |
| 7 | elderly_patient | Edge: slow confused speaker |
| 8 | barge_in_impatient | Edge: interruptions |
| 9 | reluctant_caller | Edge: private health concern |
| 10 | controlled_substance | Edge: lost prescription |
Under $1 total for all 10 calls.