question

khalil-choudhry15631 avatar image
khalil-choudhry15631 asked khalil-choudhry15631 commented

Realtime Voice bot with RingCentral

I can't seem to find any API that allows me to listen to calls in realtime and reply programatically to the call in realtime. Can anyone please guide me to the right direction for this.Thanks
General Topic
1 |1500 characters needed characters left characters exceeded

Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.

Embbnux Ji avatar image
Embbnux Ji answered
Hi Khalil, If you don't need voice, you can use TelephonySession api to listen and control call:
https://developers.ringcentral.com/api-reference#Extension-Telephony-Sessions-Event-Beta
https://developers.ringcentral.com/api-reference#Call-Control-rejectParty

If you want to play with real time voice, you can use our webRTC phone library  https://github.com/ringcentral/ringcentral-web-phone
1 |1500 characters needed characters left characters exceeded

Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.

khalil-choudhry15631 avatar image
khalil-choudhry15631 answered
I want to reply to customer queries programmatically. Answer to what he/she asks on phone.
1 |1500 characters needed characters left characters exceeded

Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.

Phong Vu avatar image
Phong Vu answered
You wrote "API that allows me to listen to calls in realtime ...". Did you mean to listen to incoming call (ringing) or to listen to the call after the call is picked up?

If you want to listen to incoming call while it is ringing, use the presence push notification or the telephony session API.

If you want to listen to the voice of the call, then the WebRTC would help.

Also, you wrote ".. reply programmatically to the call in realtime", did you mean to pick a ringing call programmatically? If so, I am afraid that you cannot do that unless you make a call handling rule to direct the call to a voicemail.
1 |1500 characters needed characters left characters exceeded

Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.

khalil-choudhry15631 avatar image
khalil-choudhry15631 answered khalil-choudhry15631 commented
Ok. I am actually looking for voicebots. Reply to the call while it is going on. Answer to the incoming calls.
6 comments
1 |1500 characters needed characters left characters exceeded

Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.

So the bot will auto answer(pick up) the call when it is ringing, and will reply smartly when it hears something from the caller. Am I right?
0 Likes 0 ·
I think you need to use WebPhone SDK .  https://github.com/ringcentral/ringcentral-web-phone

Other SDKs/APIs don't have the ability to actually answer the call.

And I am afraid that there is no out-of-box solution. You need to do some development based on that SDK.

Tricky part might be voice to text conversion. You need a third party services so that your bot can know what is the caller saying.
0 Likes 0 ·
I have looked into the git repo but it does provide to play/reply audio message during call.
0 Likes 0 ·
Hi Khalil, you are right. I don't think there is an out-of-box solution.  I might investigate further but I cannot promise any timeline.
0 Likes 0 ·
Show more comments

Developer sandbox tools

Using the RingCentral Phone for Desktop, you can dial or receive test calls, send and receive test SMS or Fax messages in your sandbox environment.

Download RingCentral Phone for Desktop:

Tip: switch to the "sandbox mode" before logging in the app:

  • On MacOS: press "fn + command + f2" keys
  • On Windows: press "Ctrl + F2" keys