Build an AI Voice Agent for Calls with Open Source
1 points
20 hours ago
| 2 comments
| github.com
| HN
sagarkava
20 hours ago
[-]
Hi I am Sagar, We just open-sourced a complete framework to build an AI-powered telephony agent that can handle both inbound and outbound calls—using Python, SIP, and cloud LLMs like OpenAI or Gemini.

You can use it to create smart appointment bots, voice feedback collectors, or even enterprise IVR systems. It’s modular (plug in your SIP provider or AI model), production-ready, and extensible for real-time workflows.

Features include:

SIP & VoIP call handling (Twilio, Plivo, etc)

LLM-integrated AI agent (customizable prompt & tools)

FastAPI-based server for routing and control

Plugins for STT, TTS, sentiment analysis

Support for Agent2Agent and MCP protocols

GitHub Repo:https://github.com/videosdk-live/agents Full Blog: https://www.videosdk.live/blog/ai-telephony-agent-inbound-ou...

Would love feedback from anyone working with telephony, LLMs, or real-time automation!

reply
methuselah_in
20 hours ago
[-]
No offense, but how many people will be jobless because of this?
reply
sagarkava
19 hours ago
[-]
Totally valid concern. The goal isn’t to replace people, but to offload repetitive tasks so humans can focus on higher-value work.

We’ve also built in Human-in-the-Loop support so a person can step in anytime the AI falls short. More on that here: https://docs.videosdk.live/ai_agents/human-in-the-loop

It’s about shifting roles, not eliminating them and doing it responsibly.

reply
methuselah_in
12 hours ago
[-]
What you say is totally going to do opposite! In developing countries like India here people don't have too many skills are going to face the heat anyways
reply