Mixing
How do I use twiml.gather continuously in existing call?
I want to be able to capture both parties speech to text continuously in a call and send those strings off to be translated in real-time and then use twiml.say to speak the text back. I have not been having much luck with this and wondering how I should go about doing this.
The one user will make a call from their phone to the other support person which is at a web browser. I have the call setup and working fine, however I cannot find any documentation anywhere that is aligned with what I am wanting to do and wondering if it is possible or if I need to be looking down a different route.
Should anyone have any advice or has seen samples similar to this I would love to see them. Thanks!
node.js twilio twilio-api
asked Nov 20 '18 at 18:13
xtr33mextr33me
445522
add a comment |
I want to be able to capture both parties speech to text continuously in a call and send those strings off to be translated in real-time and then use twiml.say to speak the text back. I have not been having much luck with this and wondering how I should go about doing this.
The one user will make a call from their phone to the other support person which is at a web browser. I have the call setup and working fine, however I cannot find any documentation anywhere that is aligned with what I am wanting to do and wondering if it is possible or if I need to be looking down a different route.
Should anyone have any advice or has seen samples similar to this I would love to see them. Thanks!
node.js twilio twilio-api
asked Nov 20 '18 at 18:13
xtr33mextr33me
445522
add a comment |
I want to be able to capture both parties speech to text continuously in a call and send those strings off to be translated in real-time and then use twiml.say to speak the text back. I have not been having much luck with this and wondering how I should go about doing this.
The one user will make a call from their phone to the other support person which is at a web browser. I have the call setup and working fine, however I cannot find any documentation anywhere that is aligned with what I am wanting to do and wondering if it is possible or if I need to be looking down a different route.
Should anyone have any advice or has seen samples similar to this I would love to see them. Thanks!
node.js twilio twilio-api
asked Nov 20 '18 at 18:13
xtr33mextr33me
445522
I want to be able to capture both parties speech to text continuously in a call and send those strings off to be translated in real-time and then use twiml.say to speak the text back. I have not been having much luck with this and wondering how I should go about doing this.
The one user will make a call from their phone to the other support person which is at a web browser. I have the call setup and working fine, however I cannot find any documentation anywhere that is aligned with what I am wanting to do and wondering if it is possible or if I need to be looking down a different route.
Should anyone have any advice or has seen samples similar to this I would love to see them. Thanks!
node.js twilio twilio-api
node.js twilio twilio-api
asked Nov 20 '18 at 18:13
xtr33mextr33me
445522
asked Nov 20 '18 at 18:13
xtr33mextr33me
445522
asked Nov 20 '18 at 18:13
xtr33mextr33me
445522
asked Nov 20 '18 at 18:13
xtr33mextr33me
445522
asked Nov 20 '18 at 18:13
xtr33mextr33me
445522
445522
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
Twilio developer evangelist here.
It's not currently possible to capture a two legged conversation with <Gather> and speech recognition. So you might need to look somewhere else for this functionality.
answered Nov 20 '18 at 23:33
philnashphilnash
37.8k93454
Thanks philnash! Can you think of doing this anyway using a conference room and translation boots as agents? Just curious. Thanks again!
– xtr33me
Nov 20 '18 at 23:36
What do you mean by "translation boots (bots?)" ?
– philnash
Nov 20 '18 at 23:38
Sorry...so I was asked to put together a pic where we can have two people speaking different languages in a support call and have each sides spoken language translated for the other. We currently have a Google cloud service that will take a full sentence and perform transliteration on it. So what I was wondering is if another approach might be to have a conference room with two people speaking different languages and then two bots or let's say websockets or services that are in the conference as well. One bot would translate from Spanish to English let's say and the other English to Spanish.
– xtr33me
Nov 21 '18 at 0:25
Essentially I am trying to mimick something like Skypes translation but just for voice and between a phone and web browser via twilio.
– xtr33me
Nov 21 '18 at 0:27
You can't really get the realtime stream of audio from a conference easily. The only way to do it would be to make a SIP connection from your server to Twilio and then dial that into the conference, and read the audio from the stream. But I don't have any more detail than that. We did once demo a live transcription from a conference, but the feature hasn't surfaced yet, you might get more details by contacting Twilio support about that.
– philnash
Nov 21 '18 at 1:07
|
show 3 more comments
Your Answer
StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53399082%2fhow-do-i-use-twiml-gather-continuously-in-existing-call%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
Twilio developer evangelist here.
It's not currently possible to capture a two legged conversation with <Gather> and speech recognition. So you might need to look somewhere else for this functionality.
answered Nov 20 '18 at 23:33
philnashphilnash
37.8k93454
Thanks philnash! Can you think of doing this anyway using a conference room and translation boots as agents? Just curious. Thanks again!
– xtr33me
Nov 20 '18 at 23:36
What do you mean by "translation boots (bots?)" ?
– philnash
Nov 20 '18 at 23:38
Sorry...so I was asked to put together a pic where we can have two people speaking different languages in a support call and have each sides spoken language translated for the other. We currently have a Google cloud service that will take a full sentence and perform transliteration on it. So what I was wondering is if another approach might be to have a conference room with two people speaking different languages and then two bots or let's say websockets or services that are in the conference as well. One bot would translate from Spanish to English let's say and the other English to Spanish.
– xtr33me
Nov 21 '18 at 0:25
Essentially I am trying to mimick something like Skypes translation but just for voice and between a phone and web browser via twilio.
– xtr33me
Nov 21 '18 at 0:27
You can't really get the realtime stream of audio from a conference easily. The only way to do it would be to make a SIP connection from your server to Twilio and then dial that into the conference, and read the audio from the stream. But I don't have any more detail than that. We did once demo a live transcription from a conference, but the feature hasn't surfaced yet, you might get more details by contacting Twilio support about that.
– philnash
Nov 21 '18 at 1:07
|
show 3 more comments
Twilio developer evangelist here.
It's not currently possible to capture a two legged conversation with <Gather> and speech recognition. So you might need to look somewhere else for this functionality.
answered Nov 20 '18 at 23:33
philnashphilnash
37.8k93454
Thanks philnash! Can you think of doing this anyway using a conference room and translation boots as agents? Just curious. Thanks again!
– xtr33me
Nov 20 '18 at 23:36
What do you mean by "translation boots (bots?)" ?
– philnash
Nov 20 '18 at 23:38
Sorry...so I was asked to put together a pic where we can have two people speaking different languages in a support call and have each sides spoken language translated for the other. We currently have a Google cloud service that will take a full sentence and perform transliteration on it. So what I was wondering is if another approach might be to have a conference room with two people speaking different languages and then two bots or let's say websockets or services that are in the conference as well. One bot would translate from Spanish to English let's say and the other English to Spanish.
– xtr33me
Nov 21 '18 at 0:25
Essentially I am trying to mimick something like Skypes translation but just for voice and between a phone and web browser via twilio.
– xtr33me
Nov 21 '18 at 0:27
You can't really get the realtime stream of audio from a conference easily. The only way to do it would be to make a SIP connection from your server to Twilio and then dial that into the conference, and read the audio from the stream. But I don't have any more detail than that. We did once demo a live transcription from a conference, but the feature hasn't surfaced yet, you might get more details by contacting Twilio support about that.
– philnash
Nov 21 '18 at 1:07
|
show 3 more comments
Twilio developer evangelist here.
It's not currently possible to capture a two legged conversation with <Gather> and speech recognition. So you might need to look somewhere else for this functionality.
answered Nov 20 '18 at 23:33
philnashphilnash
37.8k93454
Twilio developer evangelist here.
It's not currently possible to capture a two legged conversation with <Gather> and speech recognition. So you might need to look somewhere else for this functionality.
answered Nov 20 '18 at 23:33
philnashphilnash
37.8k93454
answered Nov 20 '18 at 23:33
philnashphilnash
37.8k93454
answered Nov 20 '18 at 23:33
philnashphilnash
37.8k93454
answered Nov 20 '18 at 23:33
philnashphilnash
37.8k93454
37.8k93454
Thanks philnash! Can you think of doing this anyway using a conference room and translation boots as agents? Just curious. Thanks again!
– xtr33me
Nov 20 '18 at 23:36
What do you mean by "translation boots (bots?)" ?
– philnash
Nov 20 '18 at 23:38
Sorry...so I was asked to put together a pic where we can have two people speaking different languages in a support call and have each sides spoken language translated for the other. We currently have a Google cloud service that will take a full sentence and perform transliteration on it. So what I was wondering is if another approach might be to have a conference room with two people speaking different languages and then two bots or let's say websockets or services that are in the conference as well. One bot would translate from Spanish to English let's say and the other English to Spanish.
– xtr33me
Nov 21 '18 at 0:25
Essentially I am trying to mimick something like Skypes translation but just for voice and between a phone and web browser via twilio.
– xtr33me
Nov 21 '18 at 0:27
You can't really get the realtime stream of audio from a conference easily. The only way to do it would be to make a SIP connection from your server to Twilio and then dial that into the conference, and read the audio from the stream. But I don't have any more detail than that. We did once demo a live transcription from a conference, but the feature hasn't surfaced yet, you might get more details by contacting Twilio support about that.
– philnash
Nov 21 '18 at 1:07
|
show 3 more comments
Thanks philnash! Can you think of doing this anyway using a conference room and translation boots as agents? Just curious. Thanks again!
– xtr33me
Nov 20 '18 at 23:36
What do you mean by "translation boots (bots?)" ?
– philnash
Nov 20 '18 at 23:38
Sorry...so I was asked to put together a pic where we can have two people speaking different languages in a support call and have each sides spoken language translated for the other. We currently have a Google cloud service that will take a full sentence and perform transliteration on it. So what I was wondering is if another approach might be to have a conference room with two people speaking different languages and then two bots or let's say websockets or services that are in the conference as well. One bot would translate from Spanish to English let's say and the other English to Spanish.
– xtr33me
Nov 21 '18 at 0:25
Essentially I am trying to mimick something like Skypes translation but just for voice and between a phone and web browser via twilio.
– xtr33me
Nov 21 '18 at 0:27
You can't really get the realtime stream of audio from a conference easily. The only way to do it would be to make a SIP connection from your server to Twilio and then dial that into the conference, and read the audio from the stream. But I don't have any more detail than that. We did once demo a live transcription from a conference, but the feature hasn't surfaced yet, you might get more details by contacting Twilio support about that.
– philnash
Nov 21 '18 at 1:07
Thanks philnash! Can you think of doing this anyway using a conference room and translation boots as agents? Just curious. Thanks again!
– xtr33me
Nov 20 '18 at 23:36
Thanks philnash! Can you think of doing this anyway using a conference room and translation boots as agents? Just curious. Thanks again!
– xtr33me
Nov 20 '18 at 23:36
What do you mean by "translation boots (bots?)" ?
– philnash
Nov 20 '18 at 23:38
What do you mean by "translation boots (bots?)" ?
– philnash
Nov 20 '18 at 23:38
Sorry...so I was asked to put together a pic where we can have two people speaking different languages in a support call and have each sides spoken language translated for the other. We currently have a Google cloud service that will take a full sentence and perform transliteration on it. So what I was wondering is if another approach might be to have a conference room with two people speaking different languages and then two bots or let's say websockets or services that are in the conference as well. One bot would translate from Spanish to English let's say and the other English to Spanish.
– xtr33me
Nov 21 '18 at 0:25
Sorry...so I was asked to put together a pic where we can have two people speaking different languages in a support call and have each sides spoken language translated for the other. We currently have a Google cloud service that will take a full sentence and perform transliteration on it. So what I was wondering is if another approach might be to have a conference room with two people speaking different languages and then two bots or let's say websockets or services that are in the conference as well. One bot would translate from Spanish to English let's say and the other English to Spanish.
– xtr33me
Nov 21 '18 at 0:25
Essentially I am trying to mimick something like Skypes translation but just for voice and between a phone and web browser via twilio.
– xtr33me
Nov 21 '18 at 0:27
Essentially I am trying to mimick something like Skypes translation but just for voice and between a phone and web browser via twilio.
– xtr33me
Nov 21 '18 at 0:27
You can't really get the realtime stream of audio from a conference easily. The only way to do it would be to make a SIP connection from your server to Twilio and then dial that into the conference, and read the audio from the stream. But I don't have any more detail than that. We did once demo a live transcription from a conference, but the feature hasn't surfaced yet, you might get more details by contacting Twilio support about that.
– philnash
Nov 21 '18 at 1:07
You can't really get the realtime stream of audio from a conference easily. The only way to do it would be to make a SIP connection from your server to Twilio and then dial that into the conference, and read the audio from the stream. But I don't have any more detail than that. We did once demo a live transcription from a conference, but the feature hasn't surfaced yet, you might get more details by contacting Twilio support about that.
– philnash
Nov 21 '18 at 1:07
|
show 3 more comments
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53399082%2fhow-do-i-use-twiml-gather-continuously-in-existing-call%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
