## About this dataset

This is another dataset in Defined.ai's collection of “live” (unscripted or unsimulated) speech data. The dataset features English (US) speakers talking to their voice assistants, with a similar dataset in Portuguese (Portugal) coming soon. The recordings are made via far-field devices. 

The inquiries are initiated by the users themselves and are not pre-scripted or simulated, and the data is cleansed of any personally identifiable information. Every inquiry has a precise, and valuable NLP annotations. Each inquiry has precise, and valuable NLP annotations. The data includes diverse accents and background noises.

This dataset is covered by our standard [Data license agreement](https://www.defined.ai/dataset/data-license-agreement). The license agreement is perpetual and allows for the commercialization of all models built on the data.

Tell us about yourself, and get access to a sample of live voice assistant inquiries dataset

## Samples

Download a sample of live interactions with voice assistant [here](https://stgstrapimediastorage.blob.core.windows.net/stgstrapimediastorage/assets/Live_voice_assistant_inquiries_sample_d798ed7b1e.zip?updated_at=2023-06-01T13:53:54.682Z). The archive contains 5 recordings and a JSON file with metadata.

Download Sample

Speech

Portuguese Scripted Monologue

English Spontaneous Dialogue

Portuguese (Brazil) Spontaneous Dialogue

Bengali Spontaneous Dialogue

You might also be interested in:

Live Voice Assistant Inquiries

## About the Dataset
### 3345 hours

This audio dataset contains 3345 hours of English Speech Data in various domains, recorded by native speakers from the UK, the US, Ireland, Australia, and India.

There are **1309 hours of English (US)** human-to-human audio with the following domain distribution per dataset:
- 321.37 hours of Banking
- 192.03 hours of Insurance
- 51.32 hours of Retail
- 45.68 hours of Telecommunication
- 198.62 hours of Generic domain
- 500.22 hours of Healthcare / Retail

There are **996 hours of English (UK)** human-to-human audio with the following domain distribution per dataset:
- 225.53 hours of Banking
- 196.05 hours of Insurance
- 189.67 hours of Retail
- 203.67 hours of Telecommunication
- 181.38 hours of Generic domain

There are **702 hours of English (India)** human-to-human audio with the following domain distribution per dataset:
- 173.55 hours of Banking
- 187.08 hours of Insurance
- 168.62 hours of Retail
- 173.4 hours of Telecommunication

There are **304 hours of English (AU)** human-to-human audio with the following domain distribution per dataset:
- 86.03 hours of Banking
- 76.35 hours of Insurance
- 79.37 hours of Retail
- 62.73 hours of Telecommunication

There are **34 hours of English (Ireland)** human-to-human audio with the following domain distribution per dataset:
- 28.3 hours of Insurance
- 6.58 hours of Generic domain

Defined.ai creates scenarios for our crowd members to follow, which they study beforehand. They then record a conversation, one speaker playing the agent, the other speaker “playing out” the scenario with spontaneous content. The recording is done via telephony and is saved in 8khz 16 bit per channel. That content is then transcribed.

The dataset is covered by [Defined.ai's standard license agreement](https://www.defined.ai/dataset/data-licence-agreement). The license agreement is perpetual and allows for the commercialization of all models built on the data.

Other characteristics:

- Audio format: WAV
- Recording environment: noisy, silent
- Bits per sample: 16
- Communication band: broadband
- Sample rate: 8Hz

## Metadata Distribution
### Australia
![Spontaneous_En_Au_Gender.png](https://prdstrapimediastorage.blob.core.windows.net/prdstrapimediastorage/assets/Spontaneous_En_Au_Gender_91b267a1cc.png)
![Spontaneous_En_Au_Age.png](https://prdstrapimediastorage.blob.core.windows.net/prdstrapimediastorage/assets/Spontaneous_En_Au_Age_60e48eeca6.png)
![Spontaneous_En_Au_Accents.png](https://prdstrapimediastorage.blob.core.windows.net/prdstrapimediastorage/assets/Spontaneous_En_Au_Accents_e683db2545.png)

## Short Audio Samples
- [English (UK)](https://defineddata.blob.core.windows.net/samples/AFI_en-gb_multi-spontaneous_banking_30m_v01_Sample/Audio/a2d24fc5-da9d-4ffe-aba3-5b73dccf5237.wav?se=2024-06-15T16%3A49%3A44Z&sp=r&sv=2020-06-12&ss=b&srt=o&sig=a%2B2BmW0bflObwTrc0Xli6Blg/yyKxqrCwyqNkg9rWeo%3D). Transcription for the sample is also [available](https://prdstrapimediastorage.blob.core.windows.net/prdstrapimediastorage/assets/Spontaneous_English_UK_Banking_Short_Transcription_42d5aaed87.tsv)
- [English (India)](https://defineddata.blob.core.windows.net/samples/AFI_en-in_multi-spontaneous_banking_30m_v01_Sample/Audio/5bb7a3eb-db5e-4cc0-a3d2-6f11f00711b2.wav?se=2024-07-13T22%3A32%3A34Z&sp=r&sv=2020-06-12&ss=b&srt=o&sig=mZy7yOT4039to6Uqr3RE4R8XjhnWZ6sAZ2EiaJx/0sI%3D). Transcription for the sample is also [available](https://prdstrapimediastorage.blob.core.windows.net/prdstrapimediastorage/assets/Spontaneous_English_India_Short_Transcription_679275bf52.txt?updated_at=2023-06-06T15:22:23.708Z)
- [English (AU)](https://defineddata.blob.core.windows.net/samples/AFI_en-au_multi-spontaneous_banking_30m_v01_Sample/Audio/dd8bfb26-003a-4da5-ba07-5acde431b0c0.wav?se=2024-06-15T15%3A20%3A19Z&sp=r&sv=2020-06-12&ss=b&srt=o&sig=wiIvr8sC5QPZh77G%2Bl0D40XaaOwBft7Dcui66MA3aFI%3D). Transcription for the sample is also [available](https://prdstrapimediastorage.blob.core.windows.net/prdstrapimediastorage/assets/Spontaneous_English_Australia_Short_Transcription_7301ed0f39.tsv?updated_at=2023-06-06T14:54:56.892Z)
- [English (Ireland)](https://defineddata.blob.core.windows.net/samples/AFI_en-ie_multi-spontaneous_insurance_B1_v01_30m_Sample/Audio/afe8facd-9c34-48fe-a2a5-7d8ce377807b.wav?se=2025-07-06T13%3A12%3A14Z&sp=r&sv=2020-06-12&ss=b&srt=o&sig=ZY%2BhyzDxhmtJG80KR0lCLwOPVjVK2Z9RW3IyM4AXf2Y%3D). Transcription for the sample is also [available](https://prdstrapimediastorage.blob.core.windows.net/prdstrapimediastorage/assets/Spontaneous_English_Ireland_Short_Transcription_877343e4a7.tsv?updated_at=2023-06-06T15:26:39.452Z)
- [English (US)](https://defineddata.blob.core.windows.net/samples/JPT_en-us_multi-spontaneous_banking_30m_v01_Sample/Audio/b213bc4f-4f61-463e-837a-fe6bd00df5f9.wav?se=2024-06-15T22%3A49%3A38Z&sp=r&sv=2020-06-12&ss=b&srt=o&sig=zneqq2xQ73KK9l9ehzqVO4qdfj8er56vclSMhJ7HDK8%3D). Transcription for the sample is also [available](https://prdstrapimediastorage.blob.core.windows.net/prdstrapimediastorage/assets/Spontaneous_English_US_Banking_Short_Transcription_b667de8c76.tsv)




3345 hours recorded by speakers from the UK, the US, Ireland, Australia, and India

## About the Dataset
### 312 hours

This audio dataset contains 312 hours of Portuguese (Brazil) Speech Data in various domains, recorded by speakers from Brazil.

Domain distribution per dataset:

- 87.98 hours of Banking
- 68.23 hours of Insurance
- 75.58 hours of Retail
- 80.9 hours of Telecommunication

Defined.ai creates scenarios for our crowd members to follow, which they study beforehand. They then record a conversation, one speaker playing the agent, the other speaker “playing out” the scenario with spontaneous content. The recording is done via telephony and is saved in 8kHz 16 bit per channel. That content is then transcribed.

The dataset is covered by [Defined.ai's standard license agreement](https://www.defined.ai/dataset/data-license-agreement). The license agreement is perpetual and allows for the commercialization of all models built on the data.

Other characteristics:

- Audio format: WAV
- Recording environment: noisy, silent
- Bits per sample: 16
- Communication band: broadband
- Sample rate: 8kHz

## Metadata Distribution

![Spontaneous_PT_BR_Gender.png](https://prdstrapimediastorage.blob.core.windows.net/prdstrapimediastorage/assets/Spontaneous_PT_BR_Gender_4314f42e1c.png)
![Spontaneous_PT_BR_Age.png](https://prdstrapimediastorage.blob.core.windows.net/prdstrapimediastorage/assets/Spontaneous_PT_BR_Age_088d265e1c.png)

## Samples

Check this 5-minute audio sample [here](https://defineddata.blob.core.windows.net/samples/AFI_pt-br_multi-spontaneous_banking_30m_v01_Sample/Audio/02bdbab6-a247-42ed-a588-fbb01b5acb77.wav?se=2024-06-15T15%3A40%3A49Z&sp=r&sv=2020-06-12&ss=b&srt=o&sig=VY1ECZgyUNxPWwu8AP8XYOLHLip1ilSg3nVYvH8yqr4%3D). Transcription for the sample is also [available](https://prdstrapimediastorage.blob.core.windows.net/prdstrapimediastorage/assets/Spontaneous_Portuguese_Brazil_Banking_Short_Transcription_f058e0259c.tsv)

## About the Dataset
### 1091 hours

This audio dataset contains 720 hours of Portuguese Speech Data recored by native Portuguese speakers from Portugal, and 371 hours recorded by speakers from Brazil.

There are 720 hours of Portuguese (Portugal) scripted monologue, generic domain.

There are 371 hours of Portuguese (Brazil) scripted monologue with the following domain distribution per dataset:
- 56.58 hours of Banking
- 150.52 hours of Generic domain
- 69.52 hours of Insurance
- 43.12 hours of Retail
- 51.92 hours of Telecommunication

The speakers are presented with a prompt (script) and asked to read it out loud and record. Our clients will receive an audio recording, the prompt and information about the speaker. The audio is recorded on-device, typically in 16Khz 16 bit. We also provide information on which device each record was recorded.

The dataset is covered by [Defined.ai's standard license agreement](https://www.defined.ai/dataset/data-licence-agreement). The license agreement is perpetual and allows for the commercialization of all models built on the data.
## Metadata Distribution
### Portuguese (Portugal)
![Scripted_PT_PT_Gender.png](https://prdstrapimediastorage.blob.core.windows.net/prdstrapimediastorage/assets/Scripted_PT_PT_Gender_1a41618410.png)
![Scripted_PT_PT_Age.png](https://prdstrapimediastorage.blob.core.windows.net/prdstrapimediastorage/assets/Scripted_PT_PT_Age_9724a546a2.png)

### Portuguese (Brazil)
![Scripted_PT_BR_Gender.png](https://prdstrapimediastorage.blob.core.windows.net/prdstrapimediastorage/assets/Scripted_PT_BR_Gender_273fecc695.png)
![Scripted_PT_BR_Age.png](https://prdstrapimediastorage.blob.core.windows.net/prdstrapimediastorage/assets/Scripted_PT_BR_Age_f13ce05db2.png)

## Short Audio Samples
- [5-minutes sample PT_PT](https://defineddata.blob.core.windows.net/samples/DDM_pt-pt_single-scripted_generic_30m_v01_Sample/Audio/251372118.wav?se=2024-06-15T15%3A49%3A26Z&sp=r&sv=2020-06-12&ss=b&srt=o&sig=TQ3Gl9NTdf//mlsClfJcx%2B60R8rnmqy29HZQi9MINFs%3D). Transcription for the sample is also [available](https://prdstrapimediastorage.blob.core.windows.net/prdstrapimediastorage/assets/Scripted_Portuguese_Portugal_Short_Transcription_351c74702f.tsv)
- [5-minutes sample PT_BR](https://defineddata.blob.core.windows.net/samples/DDM_pt-br_single-scripted_generic_30m_v01_Sample/Audio/175935347.wav?se=2024-06-15T17%3A23%3A14Z&sp=r&sv=2020-06-12&ss=b&srt=o&sig=nfU%2BXRmSANOoILD7TVxc3QtLKjDBsArJHcCI5HIGKB0%3D). Transcription for the sample is also [available](https://prdstrapimediastorage.blob.core.windows.net/prdstrapimediastorage/assets/Scripted_Portuguese_Brazil_Short_Transcription_084baee550.tsv)

720 hours of Portuguese (Portugal), 371 hours of Portuguese (Brazil)

## About the Dataset
### 256 hours

This audio dataset contains 256 hours of Bengali Speech Data in Banking, Telecommunication, Insurance and Retail domains, recored by native Bengali speakers from India.

Domain distribution per dataset:

- 102.93 hours of Banking
- 86.98 hours of Insurance
- 29.32 hours of Retail
- 36.93 hours of Telecommunication

Defined.ai creates scenarios for our crowd members to follow, which they study beforehand. They then record a conversation, one speaker playing the agent, the other speaker “playing out” the scenario with spontaneous content. The recording is done via telephony and is saved in 8kHz 16 bit per channel. That content is then transcribed.

The dataset is covered by [Defined.ai's standard license agreement](https://www.defined.ai/dataset/data-licence-agreement). The license agreement is perpetual and allows for the commercialization of all models built on the data.

Other characteristics:

- Audio format: WAV
- Recording environment: noisy, silent
- Bits per sample: 16
- Communication band: broadband
- Sample rate: 8kHz

## Metadata Distribution
![Spontaneous_Bengali_Accents.png](https://prdstrapimediastorage.blob.core.windows.net/prdstrapimediastorage/assets/Spontaneous_Bengali_Accents_419d27c9bf.png)
![Spontaneous_Bengali_Gender.png](https://prdstrapimediastorage.blob.core.windows.net/prdstrapimediastorage/assets/Spontaneous_Bengali_Gender_f58aebc312.png)
![Spontaneous_Bengali_Age.png](https://prdstrapimediastorage.blob.core.windows.net/prdstrapimediastorage/assets/Spontaneous_Bengali_Age_1355f95eec.png)

## Samples

Check this 5-minute audio sample [here](https://defineddata.blob.core.windows.net/samples/AFI_bn-in_multi-spontaneous_banking_30m_v01_Sample/Audio/ffac8a94-58cc-41ea-88a4-49ef48b182d4.wav?se=2024-11-30T12%3A51%3A34Z&sp=r&sv=2020-06-12&ss=b&srt=o&sig=FvbczXwxp46wbqUOYCTLjvfkAvf3xA9flOW78RYlv0s%3D). Transcription for the sample is also [available](https://prdstrapimediastorage.blob.core.windows.net/prdstrapimediastorage/assets/Spontaneous_Bengali_Short_Transcription_4261ca8bab.tsv?updated_at=2023-06-05T16:32:18.221Z).