question

khalil-choudhry15631 avatar image
khalil-choudhry15631 asked Roman Pierce edited

Realtime Voice bot with RingCentral

I can't seem to find any API that allows me to listen to calls in realtime and reply programatically to the call in realtime. Can anyone please guide me to the right direction for this.Thanks

getting started
1 |3000

Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.

Embbnux Ji avatar image
Embbnux Ji answered
Hi Khalil, If you don't need voice, you can use TelephonySession api to listen and control call:
https://developers.ringcentral.com/api-reference#Extension-Telephony-Sessions-Event-Beta
https://developers.ringcentral.com/api-reference#Call-Control-rejectParty

If you want to play with real time voice, you can use our webRTC phone library  https://github.com/ringcentral/ringcentral-web-phone
1 |3000

Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.

khalil-choudhry15631 avatar image
khalil-choudhry15631 answered
I want to reply to customer queries programmatically. Answer to what he/she asks on phone.
1 |3000

Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.

Phong Vu avatar image
Phong Vu answered
You wrote "API that allows me to listen to calls in realtime ...". Did you mean to listen to incoming call (ringing) or to listen to the call after the call is picked up?

If you want to listen to incoming call while it is ringing, use the presence push notification or the telephony session API.

If you want to listen to the voice of the call, then the WebRTC would help.

Also, you wrote ".. reply programmatically to the call in realtime", did you mean to pick a ringing call programmatically? If so, I am afraid that you cannot do that unless you make a call handling rule to direct the call to a voicemail.
1 |3000

Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.

khalil-choudhry15631 avatar image
khalil-choudhry15631 answered Roman Pierce edited
Ok. I am actually looking for voicebots. Reply to the call while it is going on. Answer to the incoming calls.
7 comments
1 |3000

Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.

Tyler Liu avatar image Tyler Liu ♦ commented ·
So the bot will auto answer(pick up) the call when it is ringing, and will reply smartly when it hears something from the caller. Am I right?
0 Likes 0 ·
khalil-choudhry15631 avatar image khalil-choudhry15631 commented ·
Yes
0 Likes 0 ·
Tyler Liu avatar image Tyler Liu ♦ commented ·
I think you need to use WebPhone SDK .  https://github.com/ringcentral/ringcentral-web-phone

Other SDKs/APIs don't have the ability to actually answer the call.

And I am afraid that there is no out-of-box solution. You need to do some development based on that SDK.

Tricky part might be voice to text conversion. You need a third party services so that your bot can know what is the caller saying.
0 Likes 0 ·
khalil-choudhry15631 avatar image khalil-choudhry15631 commented ·
I have looked into the git repo but it does provide to play/reply audio message during call.
0 Likes 0 ·
Tyler Liu avatar image Tyler Liu ♦ commented ·
Hi Khalil, you are right. I don't think there is an out-of-box solution.  I might investigate further but I cannot promise any timeline.
0 Likes 0 ·
Show more comments

Developer sandbox tools

Using the RingCentral Phone for Desktop, you can dial or receive test calls, send and receive test SMS or Fax messages in your sandbox environment.

Download RingCentral Phone for Desktop:

Tip: switch to the "sandbox mode" before logging in the app:

  • On MacOS: press "fn + command + f2" keys
  • On Windows: press "Ctrl + F2" keys