Editing Librispeech (section)

== Comparison Between Transcriptions and Original Transcript using whisper ==

=== Xueying LIU ===
https://drive.google.com/file/d/1jrPuAcyzeAFT4cg0Lc1nJg115sqP5yCu/view?usp=drive_link
{| class="wikitable"
|
|'''Whisper WER'''
|'''Whisper transcription'''
|-
|1272-128104-0000.flac
|100
|감사합니다.
|-
|1272-128104-0001.flac
|10.0
|Nor is Mr. Culture's manner less interesting than his matter.
|-
|1272-128104-0005.flac
|5.56
|It is obviously unnecessary for us to point out how luminous these criticisms are, how delicate and expression.
|-
|1272-128104-0006.flac
|16.67
|On the general principles of art, Mr. Kult writes with equal lucidity.
|-
|1272-128104-0007.flac
|5.26
|Painting, he tells us, is of a different quality to mathematics and finish in art is a more fact.
|-
|1272-128104-0010.flac
|13.33
|Near the fire and the ominous, Fred brought home from India on the mental board.
|-
|1272-128104-0012.flac
|0.0
|Only unfortunately his own work never does get good.
|-
|1272-128104-0013.flac
|11.11
|Mr. Quilter has missed his chance for he has failed even to make himself the tougher of painting.
|}
Recording Device: iPhone13

Recording Environment: Noisy, normal speed

It is surprising to see that 0000 was transcribed into Korean. Compared with the WER of original audio recognized by Whisper, 5 out of 8 sentences from this speaker had the same WER with original audio, and 3 had higher WER than original audio. Reasons for the low performance could be that first, these audios were recorded under noisy environment with people talking in the background; second, some words in the sentences are uncommon and might be mispronounced by the speaker.  

=== Jingxuan YUE ===
https://drive.google.com/file/d/1UYOKGkM0cli9htQ6ry6SLuE2Wa2_b3-U/view?usp=drive_link
{| class="wikitable"
|
|'''Whisper WER'''
|'''Whisper transcription'''
|-
|1272-128104-0000.flac
|35.29
|Mr. Krueger is a parcel of the middle classes and we're glad to welcome his gospel.
|-
|1272-128104-0001.flac
|30
|Nor is Mr. Quotor's manner less interesting than his manner.
|-
|1272-128104-0002.flac
|18.75
|He tells us that at this festive season of the year, with Christmas and Rosebeef looming before us, similarly drowned from 18 and its resounds occur most readily to the mind.
|-
|1272-128104-0003.flac
|37.5
|He has graved out the weather, so Frederick Lydon's work is really great after all and can discover the internet but little of Rocky Ithaca.
|-
|1272-128104-0004.flac
|30.88
|The Niles pictures are a sort of op-cards and atom paintings and maisons. Equasites, idols are as national as a jingle poem. Mr. Borke Foster's landscapes smile at one mudge in the same way that Mr. Cocker used to flash his teeth and Mr. Drong. Cocker gives his sitter a cheerful slap on the back before he says like shampoo in a Turkish bath next to man.
|-
|1272-128104-0005.flac
|11.11
|It is obviously a necessary for us to point out how luminous these criticisms are, how delicate in expression.
|-
|1272-128104-0006.flac
|16.67
|On the general principles of art, Mr. Quilter writes word equal lucidity.
|-
|1272-128104-0007.flac
|10.53
|Painting he tells us is of a different quality to mathematics and finishing art is adding more fact.
|-
|1272-128104-0008.flac
|9.09
|As for addings, they are of two kinds, British and foreign.
|-
|1272-128104-0009.flac
|0
|He laments most bitterly the divorce that has been made between decorative art and what we usually call pictures makes the customary appeal to the last judgment and reminds us that in the great days of art. Michael Angelo was the furnishing upholsterer.
|-
|1272-128104-0010.flac
|20
|Near the fire and ornaments fled brought home from India on the mental board.
|-
|1272-128104-0011.flac
|17.65
|In fact, he is quite severe on Mr. Ruskin for not recognizing that a picture should denote the frailty of men and remarks with pleasing courtesy and the felicitous grace that many faces a feeling.
|-
|1272-128104-0012.flac
|0
|Only, unfortunately, his own work never does get good.
|-
|1272-128104-0013.flac
|11.11
|Mr. Quilter has missed his chance for he has failed even to make himself the tougher of painting.
|-
|1272-128104-0014.flac
|40
|by Harry Quilter, M.A.
|}
Recording device: iPhone XR

Environment: relatively quiet corridor with occasional background noise, standard speech rate

Notes:

In general, the WER in this transcription is considerably higher than that of the original audiobook transcribed by Whisper. The primary reason behind this discrepancy lies in the fact that this recording was made by a native Mandarin speaker, and there are instances where the pronunciation of certain phonetics is not entirely accurate when speaking in continuous sentences. For example, words like 'man' and 'men,' which have similar pronunciations, lead to a higher WER.

However, there are a few exceptions to this trend. Notably, the WER for segments 0008 and 0009 in this transcription is lower than that of the original recording. This is especially evident in segment 0009, which features a lengthy sentence with no transcription errors. This indicates that Whisper's Large Vocabulary Continuous Speech Recognition (LVCSR) system performs admirably in specific cases.

There are instances where Whisper faces challenges. Firstly, it struggles when dealing with words that share the same or similar pronunciations. For instance, in segment 0003, the original word 'WHETHER' is transcribed as 'weather.' Another instance occurs in segment 0011, where 'PHASES' is transcribed as 'faces.' This highlights the need for improvement in the system's ability to transcribe within the context of the language model.

Additionally, the transcription quality suffers when it comes to liaison. For example, in segment 0000, the original transcript reads 'apostle,' but the transcription results in 'a parcel.' A similar situation arises in segment 0004, where 'AT EM' is transcribed as 'atom.'

=== M.Tepei ===
https://drive.google.com/file/d/1ysPduZXsf_pUziEq_-p1cqUv8EGULc03/view?usp=drive_link
{| class="wikitable"
|
|'''Whisper WER'''
|'''Whisper transcription'''
|-
|1272-128104-0000.flac
|41.18
|The answer is the question of the middle classes and we are going to let the well-composed gospel.
|-
|1272-128104-0001.flac
|20
|Nor is Mr. Quilter's manner less interesting than this matter.
|-
|1272-128104-0002.flac
|18.75
|The process that at this festive season of the year with Christmas and roast beef looming before us, similes drawn from eating and its result occur more spreadly to the mind.
|-
|1272-128104-0003.flac
|20.83
|He has graved out sweater Sir Frederick Layton's work is really Greek after all and can discover in it but little Rocky Ithaca.
|-
|1272-128104-0004.flac
|17.65
|The pictures are a sort of upgarts and at paintings and mason's exquisite idls are as national as a jingle poem Mr. Burkid Foster's landscape smile. At one much in the same way that Mr. Carker used to flash his teeth and Mr. John Collier gives his sitter a cheerful slap on the bag before he says like a shampooer in a Turkish bath next man.
|-
|1272-128104-0005.flac
|5.56
|It is obviously unnecessary for us to point out how luminous these criticisms are, how delicate and expression.
|-
|1272-128104-0006.flac
|33.33
|The general principles of art, Mr. Quilder, rise with equal lucidity.
|-
|1272-128104-0007.flac
|15.79
|I think he tells us as of a different quality to mathematics and finish in art is adding more fact.
|-
|1272-128104-0008.flac
|0
|As for etchings, they are of two kinds, British and foreign.
|-
|1272-128104-0009.flac
|6.98
|He laments most bitterly the divorce that has been made between decorative art and what we usually call pictures makes the customary appeal to the last judgment and reminds us that in the great days of art Michelangelo was the furnishing upholster.
|-
|1272-128104-0010.flac
|40
|The entire empire and ornaments thread brought home from India on the mental board.
|-
|1272-128104-0011.flac
|11.76
|In fact, he is quite severe on Mr. Ruskin for not recognizing that a picture should denote the frailty of men and remarks with pleasing courtesy and felicitous grace that many faces of feeling.
|-
|1272-128104-0012.flac
|0
|Only unfortunately his own work never does get good.
|-
|1272-128104-0013.flac
|16.67
|Mr. Guilter has missed his chance for he has failed even to make himself the upper of painting.
|-
|1272-128104-0014.flac
|60
|by every quilter ma.
|}
Recording device: Dell XPS 13

Environment: quiet, modal voice, standard (natural) speech rate.

Notes: Interesting to see that 'Mr. Quilter' is transcribed correctly once, and with different minor errors for the rest of the cases. Did not expect 'etchings' to be transcribed correctly, as I hesitated/stuttered when I pronounced it.