I built an in-call AI, and the hard part was making it talk less

We use Attio for call recordings (tried a few other notetakers as well). And they work great... that's kind of the problem. The summary shows up with the answer to the question I couldn't answer well during the meeting. The information existed the whole time. My notes, the CRM, earlier in the same call. Just not reachable when we are busy in the meeting.

So the question we kept having: why does all this intelligence only show up after the call ends?

We tried the obvious things. LLM in a side tab doesn't work, you can't always type and listen at the same time... and it knows nothing about your call anyway. Then I built the better version, an AI commenting on the call live. But we noticed that the real importance is minimizing a cognitive load of users by minimizing interruptions during the live call.

So almost all the work went into making it talk less, think more. This is how we built Heyalo (https://heyalo.ai). It listens and reasons through the whole call, speaks when something's worth a mention.