Speech dataset resources

From MSc Voice Technology
Revision as of 13:01, 27 September 2023 by Xinyi Ma (talk | contribs)
Jump to navigation Jump to search

This table summarizes dataset resources available

Note: You have editing rights to the table, so you can edit/adjust it to your needs*. Your instructors will clean it up afterwards.

Dataset name Type of data Annotation remarks License Metadata Name/s of people who are entering the data
LibriSpeech Audio books (clean, flac format)
  • Text is converted into upper-case, removed punctuation, expanding common abbreviations and non-standard words.
  • The transcriptions are aligned and segmented automatically.
Creative Commons Attribution 4.0 International License.
  • Language: English
  • The dataset is split into 3 sections with 100.6, 363.6, 496.7 hours of speech.
  • The gender ratio of speakers is about half and half.
  • Dataset is made by Vassil Panayotov.
  • Guoguo Chen , Daniel Povey , Sanjeev Khudanpur are also contributed to the dataset and article below.
LibriVoxDeEn Audio based on audio books (.wav file format)

German text and English translation (.tsv file format)

Creative Commons Attribution 4.0 Non-Commercial ShareAlike Internation License
  • German audio and transcription, with English translation.
  • >100 hours of audio material and >50k parallel sentences.
  • Quality of audio and text has been evaluated manually.
Europarl-ASR
  • Language: English
SAF (Short Answer Feedback Dataset)(Hugging Face) Audio based on audio books from LibriVox (.wav
SPEECH-COCO Creative Commons Attribution 4.0 License.
ASR-ETELECSC: AN ENGLISH TELEPHONE CONVERSATIONAL SPEECH CORPUS ASR speech corpus This open-source dataset consists of 5.04 hours of transcribed English conversational speech beyond telephony, where 13 conversations were contained. MAGIC DATA OPEN-SOURCE LICENSE 5.04 hours of transcribed English conversational speech beyond telephony
TED-LIUM 3 Creative Commons BY-NC-ND 3.0 XINYI MA

*) this means: you may also add additional pages and link to them in this table

Notes on LibriSpeech

  • We only used the development set to test our ASR code in Python;
  • The names of the speakers who recorded all the audiobooks contained in this corpus are also available in a separate text file;
  • Exhaustive information about this dataset can be found in this article;
  • This dataset was included in the Kaldi speech recognition toolkit.