AZURE AI - REAL-TIME TRANSCRIBE CONVERSATION (FRONT-END DESKTOP & NATIVE MOBILE)
==================================================
ELEMENT DESCRIPTION
----------------------------------
AZURE AI - REAL-TIME TRANSCRIBE CONVERSATION (FRONT-END DESKTOP & NATIVE MOBILE) enables conversations to be transcribed in real-time while simultaneously identifying speakers.
Diarization refers to the ability to tell who spoke and when. It differentiates speakers in mono channel audio input based on their voice characteristics.
This allows for the identification of speakers during conversations and can be useful in a variety of scenarios such as doctor-patient conversations, agent-customer interactions, and court proceedings.
STEP-BY-STEP SETUP
--------------------------------
0) Register on Azure AI.
https://azure.microsoft.com/free/cognitive-services 1) Create a Speech resource in the Azure portal.
https://portal.azure.com/#create/Microsoft.CognitiveServicesSpeechServices 2) After your Speech resource is deployed, select Go to resource to view and manage keys. For more information about Azure AI services resources, see Get the AZURE AI SPEECH RESOURCE KEY for your resource. See
https://learn.microsoft.com/en-us/azure/ai-services/multi-service-resource?pivots=azportal#get-the-keys-for-your-resource 3) Register on plugins.wiseable.io. Create a new Credential which associates your BUBBLE APP URL and your AZURE AI SPEECH RESOURCE KEY.
The registration service will generate your PUBLIC ACCESS KEY. This key serves as a secure proxy for your real API key. It allows your application to communicate with the service without exposing your real API key. Since this PUBLIC ACCESS KEY is explicitly tied to your registered BUBBLE APP URL, it can only be used from that domain, ensuring that even if the key is publicly visible, it remains safe and cannot be misused by unauthorized sources.
4) In the Plugin Settings, enter your PUBLIC ACCESS KEY generated at the previous step and the SPEECH REGION.
5) Add the AZURE AI - REAL-TIME TRANSCRIBE CONVERSATION (FRONT-END DESKTOP & NATIVE MOBILE) to the page on which Speech to Text must be performed and configure its properties.
FIELDS :
- RESULT TYPE : Must always be set to CONVERSATION TRANSCRIPTION (AZURE AI)
- LANGUAGE CODE : BCP-47 Language Code, e.g. en-US for American English. See Event triggered when an error occurs.
- WEBSITE URL (NATIVE MOBILE ONLY) : Must be your Website Home URL.
6) Add a Repeating Group and set as data source the CONVERSATION TRANSCRIPT state of this element.
7) Integrate the logic into your application using the following AZURE AI - REAL-TIME TRANSCRIBE CONVERSATION (FRONT-END DESKTOP & NATIVE MOBILE), states and actions:
EVENTS :
- TRANSCRIPT CHANGED : Event triggered when the value of the transcribed text has changed.
- ERROR : Event triggered when an error occurs.
EXPOSED STATES:
Use any element able to show/process the data of interest (such as a Group with a Text field) stored within the result of the following states of the AZURE AI - REAL-TIME TRANSCRIBE CONVERSATION (FRONT-END DESKTOP & NATIVE MOBILE) element :
- CONVERSATION TRANSCRIPT : List of transcribed conversations with speaker ID and content.
- IS LISTENING : Boolean set to yes when transcription is in progress, otherwise set to no.
- ERROR : Error message upon Error event trigger
ELEMENT ACTIONS - TRIGGERED IN WORKFLOW:
- START TRANSCRIPTION : Start Conversation Transcription.
- STOP TRANSCRIPTION : Stop Conversation Transcription.
IMPLEMENTATION EXAMPLE
======================
Feel free to browse the app editor in the Service URL for an implementation example.
ADDITIONAL INFORMATION
======================
N/A
TROUBLESHOOTING
================
Any plugin related error will be posted to the the Logs tab, "Server logs" section of your App Editor.
Make sure that "Plugin server side output" and "Plugin server side output" is selected in "Show Advanced".
> Server Logs Details:
https://manual.bubble.io/core-resources/bubbles-interface/logs-tab#server-logsPERFORMANCE CONSIDERATIONS
===========================
N/A
QUESTIONS ?
===========
Contact us at
[email protected] for any additional feature you would require or support question.