“I work with an AI, she calls me on the phone when she has a problem”

“I work with an AI, she calls me on the phone when she has a problem”

CallMe allows Claude Code to call its user when they have to make a choice or are stuck on a given task. A module that allows more background tasks to be delegated to AI.

What if AI became a truly autonomous worker? This is the goal of CallMe, a plugin developed by the open source community on GitHub. The tool, designed as an add-on to Claude Code, allows the developer to entrust a list of complex tasks to the AI ​​agent in complete autonomy. If the latter needs help, for advice, blocking or a preference, he calls the user directly on his personal number. The developer can then make his choices on the phone, without returning to his screen. An astonishing tool which should allow you to really delegate to Claude Code and let its user go about their business. Implementation and testing.

Configuration and implementation

To function, CallMe requires the use of three external components: a call service, an OpenAI key (for speech-to-text and text-to-speech) and an ngrok account (to expose the plugin externally, outside the local network). Once the configuration is complete, simply install the plugin in Claude Code and configure the environment variables.

1. Create an ngrok account

Ngrok creates a tunnel that exposes your local server to the web. Without this, Telnyx or Twilio cannot send webhooks to your machine to transmit call audio. The principle is simple: create a free account on ngrok.com and retrieve the URL associated with your account. The latter appears on the dashboard just after creating the account.

Keep this URL, you will need it later.

2. Set up a call service

CallMe supports two call providers: Twilio and Telnyx. The plugin developer recommends using Telnyx, about 50% cheaper than its competitor. We therefore choose Telnyx. First create an account on the service (simple with Google Connect). When you create the account, you are credited 5 dollars. You must then create a “Voice API application” (accessible from the main interface):

  1. Fill in the name of the application (example: “CallMe Claude”)
  2. Select a calling site (we choose Germany to avoid excessive latency)
  3. In webhook URL, enter the URL of your ngrok followed by “/twiml” (yoururl.com/twiml)
  4. Click “create” to create the application

Once the app is created, you will need to purchase a number and assign it to the app. In France, count on around 1 dollar per month. The procedure is simple and quick (24 to 48 hours for number validation). After assigning the number, retrieve your application ID from Telnyx.

Once the ID is retrieved, you will also need to retrieve the app’s API key. To do this, go to Account → API Keys, create your API key, then retrieve it.

3. Configure environment variables

The third step is to configure environment variables. Open the settings.json file in the .claude directory (on Windows: C:/Users/YourName/.claude, on macOS/Linux: ~/.claude).

Add this structure by replacing the values ​​with your identifiers:

{

  "env": {

    "CALLME_PHONE_PROVIDER": "telnyx",

    "CALLME_PHONE_ACCOUNT_SID": "votre-application-id-telnyx",

    "CALLME_PHONE_AUTH_TOKEN": "votre-api-key-telnyx",

    "CALLME_PHONE_NUMBER": "+33..",

    "CALLME_USER_PHONE_NUMBER": "+33…",

    "CALLME_OPENAI_API_KEY": "sk-proj-...",

    "CALLME_NGROK_AUTHTOKEN": "2abc..."

  }

}

CALLME_PHONE_NUMBER corresponds to the Telnyx number you purchased, CALLME_OPENAI_API_KEY” to your OpenAI API key (the procedure to retrieve it is quite simple) and CALLME_USER_PHONE_NUMBER is your personal number to receive calls.

4. Install the plugin in Claude Code

Last step: install the plugin directly in Claude Code. Launch Claude Code and type the following commands:

/marketplace plugin add ZeframLou/call-me

/plugin install callme@callme

CallMe is now installed and configured.

Once the plugin is installed, the workflow is simple. Claude Code communicates with CallMe’s MCP (Model Context Protocol) server which runs locally on your machine. When the AI ​​agent needs human intervention, it triggers a call through this server. The MCP server then exposes an ngrok tunnel which allows Telnyx or Twilio to communicate with your local machine via webhooks. The call provider then dials your personal number. You pick up, answer Claude’s question, and your voice response is transcribed into text by OpenAI’s Whisper API before being sent back to Claude Code. The agent can then continue their work with your decision. Everything is done in a few seconds and allows you to keep the context of the conversation without having to return to your screen.

To fully exploit CallMe, you must launch Claude Code with the –dangerously-skip-permissions option. Without this, the agent will continue to request manual validations for each tool or system command, which reduces the usefulness of the plugin. The setting disables security barriers and lets Claude do whatever he wants without asking permission (this involves trusting Claude). To avoid him calling you every five minutes, make it clear in your initial prompt that he should only contact you if he is really stuck or faced with a major strategic choice. Otherwise, the AI ​​tends to ask you a little too often, according to our various tests.

In terms of prices, CallMe remains very accessible. The Telnyx number costs around 1 euro per month, to which is added 0.007 dollars per minute of outgoing call. OpenAI APIs add approximately $0.026 per minute (0.006 for speech-to-text Whisper and 0.02 for text-to-speech). In total, each minute of conversation costs around 0.03 euros. For typical use of 10 calls of 2 minutes per month, we arrive at less than 2 euros per month, ngrok being free in the basic version. Notable detail, Anthropic’s official GitHub account “claude” is among the contributors to the project, alongside the creator. A signal which suggests that Anthropic is closely following this initiative, or even actively contributing to it. What is there to hope for in the long term native integration?

Jake Thompson
Jake Thompson
Growing up in Seattle, I've always been intrigued by the ever-evolving digital landscape and its impacts on our world. With a background in computer science and business from MIT, I've spent the last decade working with tech companies and writing about technological advancements. I'm passionate about uncovering how innovation and digitalization are reshaping industries, and I feel privileged to share these insights through MeshedSociety.com.

Leave a Comment