Speech AI Preferences Test

Preference test between speech synthesis models

Overall

model1_0410 (Model A)

2.88

model2_1114 (Model B)

Answers

5. B is strongly preferred

4. B is preferred

3. About the same

2. A is preferred

1. A is strongly preferred

37 (10.00%)

93 (25.14%)

69 (18.65%)

131 (35.41%)

40 (10.81%)

Deep analysis

5. B is strongly preferred

4. B is preferred

3. About the same

2. A is preferred

1. A is strongly preferred

		Statistics
00:00 --:-- Nathan_Miller_Male_IN-Hindi_1735840713785_chunk5.wav 00:00 --:-- Nathan_Miller_Male_IN-Hindi_1735840713785_chunk5.wav	model1_0410 model2_1114	2.90 0.79 0.35
00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk1.wav 00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk1.wav	model1_0410 model2_1114	2.10 0.79 0.35
00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk2.wav 00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk2.wav	model1_0410 model2_1114	3.70 1.01 0.45
00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk3.wav 00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk3.wav	model1_0410 model2_1114	2.60 0.97 0.43
00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk4.wav 00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk4.wav	model1_0410 model2_1114	2.50 0.77 0.34
00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk5.wav 00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk5.wav	model1_0410 model2_1114	3.20 0.66 0.29
00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk6.wav 00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk6.wav	model1_0410 model2_1114	3.60 0.90 0.40
00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk7.wav 00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk7.wav	model1_0410 model2_1114	3.40 0.69 0.31

Overall

model1_0410 (Model A)

2.90

model2_1114 (Model B)

Answers

5. B is strongly preferred

4. B is preferred

3. About the same

2. A is preferred

1. A is strongly preferred

38 (10.27%)

70 (18.92%)

118 (31.89%)

106 (28.65%)

38 (10.27%)

Deep analysis

5. B is strongly preferred

4. B is preferred

3. About the same

2. A is preferred

1. A is strongly preferred

		Statistics
00:00 --:-- Nathan_Miller_Male_IN-Hindi_1735840713785_chunk5.wav 00:00 --:-- Nathan_Miller_Male_IN-Hindi_1735840713785_chunk5.wav	model1_0410 model2_1114	3.20 0.94 0.42
00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk1.wav 00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk1.wav	model1_0410 model2_1114	3.30 0.83 0.37
00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk2.wav 00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk2.wav	model1_0410 model2_1114	3.10 0.71 0.31
00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk3.wav 00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk3.wav	model1_0410 model2_1114	3.00 1.01 0.45
00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk4.wav 00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk4.wav	model1_0410 model2_1114	3.00 0.75 0.33
00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk5.wav 00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk5.wav	model1_0410 model2_1114	3.10 0.79 0.35
00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk6.wav 00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk6.wav	model1_0410 model2_1114	3.60 0.90 0.40
00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk7.wav 00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk7.wav	model1_0410 model2_1114	3.30 0.76 0.33

Overall

model1_0410 (Model A)

2.88

model2_1114 (Model B)

Answers

5. B is strongly preferred

4. B is preferred

3. About the same

2. A is preferred

1. A is strongly preferred

37 (10.00%)

93 (25.14%)

69 (18.65%)

131 (35.41%)

40 (10.81%)

Deep analysis

5. B is strongly preferred

4. B is preferred

3. About the same

2. A is preferred

1. A is strongly preferred

		Statistics
00:00 --:-- Nathan_Miller_Male_IN-Hindi_1735840713785_chunk5.wav 00:00 --:-- Nathan_Miller_Male_IN-Hindi_1735840713785_chunk5.wav	model1_0410 model2_1114	2.90 0.79 0.35
00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk1.wav 00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk1.wav	model1_0410 model2_1114	2.10 0.79 0.35
00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk2.wav 00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk2.wav	model1_0410 model2_1114	3.70 1.01 0.45
00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk3.wav 00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk3.wav	model1_0410 model2_1114	2.60 0.97 0.43
00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk4.wav 00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk4.wav	model1_0410 model2_1114	2.50 0.77 0.34
00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk5.wav 00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk5.wav	model1_0410 model2_1114	3.20 0.66 0.29
00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk6.wav 00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk6.wav	model1_0410 model2_1114	3.60 0.90 0.40
00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk7.wav 00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk7.wav	model1_0410 model2_1114	3.40 0.69 0.31

Overall

model1_0410 (Model A)

2.90

model2_1114 (Model B)

Answers

5. B is strongly preferred

4. B is preferred

3. About the same

2. A is preferred

1. A is strongly preferred

38 (10.27%)

70 (18.92%)

118 (31.89%)

106 (28.65%)

38 (10.27%)

Deep analysis

5. B is strongly preferred

4. B is preferred

3. About the same

2. A is preferred

1. A is strongly preferred

		Statistics
00:00 --:-- Nathan_Miller_Male_IN-Hindi_1735840713785_chunk5.wav 00:00 --:-- Nathan_Miller_Male_IN-Hindi_1735840713785_chunk5.wav	model1_0410 model2_1114	3.20 0.94 0.42
00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk1.wav 00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk1.wav	model1_0410 model2_1114	3.30 0.83 0.37
00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk2.wav 00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk2.wav	model1_0410 model2_1114	3.10 0.71 0.31
00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk3.wav 00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk3.wav	model1_0410 model2_1114	3.00 1.01 0.45
00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk4.wav 00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk4.wav	model1_0410 model2_1114	3.00 0.75 0.33
00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk5.wav 00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk5.wav	model1_0410 model2_1114	3.10 0.79 0.35
00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk6.wav 00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk6.wav	model1_0410 model2_1114	3.60 0.90 0.40
00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk7.wav 00:00 --:-- Hetkuamr_Ahir_Male_IN-Gujarati_1735226813971_chunk7.wav	model1_0410 model2_1114	3.30 0.76 0.33