Audio Preference Evaluation

Overall

Model 2 (Model B)

-0.13

Model 1 (Model A)

By Tag

Model 2 (Model B)

Model 1 (Model A)

Answers

2. A is strongly preferred

1. A is preferred

0. About the same

-1. B is preferred

-2. B is strongly preferred

188 (9.35%)

374 (18.61%)

720 (35.82%)

439 (21.84%)

289 (14.38%)

Tags

All tags

Model 1

Model 2

188 (9.35%)

Deep analysis

2. A is strongly preferred

1. A is preferred

0. About the same

-1. B is preferred

-2. B is strongly preferred

		Tags	Statistics
00:00 --:-- 1\00000101_259892.wav 00:00 --:-- 2\00000101_259892.wav	Model 1 Model 2	model1 synthesized model2 synthesized	-0.10 0.92 0.41
00:00 --:-- 1\00000102_260555.wav 00:00 --:-- 2\00000102_260555.wav	Model 1 Model 2	model1 synthesized model2 synthesized	-0.30 0.68 0.30
00:00 --:-- 1\00000103_256771.wav 00:00 --:-- 2\00000103_256771.wav	Model 1 Model 2	model1 synthesized model2 synthesized	0.30 0.96 0.42
00:00 --:-- 1\00000104_260511.wav 00:00 --:-- 2\00000104_260511.wav	Model 1 Model 2	model1 synthesized model2 synthesized	0.90 0.92 0.41
00:00 --:-- 1\00000105_258305.wav 00:00 --:-- 2\00000105_258305.wav	Model 1 Model 2	model1 synthesized model2 synthesized	-0.30 0.68 0.30
00:00 --:-- 1\00000105_259604.wav 00:00 --:-- 2\00000105_259604.wav	Model 1 Model 2	model1 synthesized model2 synthesized	-0.30 0.48 0.21
00:00 --:-- 1\00000105_259649.wav 00:00 --:-- 2\00000105_259649.wav	Model 1 Model 2	model1 synthesized model2 synthesized	0.00 0.95 0.42
00:00 --:-- 1\00000105_259989.wav 00:00 --:-- 2\00000105_259989.wav	Model 1 Model 2	model1 synthesized model2 synthesized	-0.30 0.83 0.37

Overall

Model 2 (Model B)

-0.22

Model 1 (Model A)

By Tag

Model 2 (Model B)

Model 1 (Model A)

Answers

2. A is strongly preferred

1. A is preferred

0. About the same

-1. B is preferred

-2. B is strongly preferred

146 (7.26%)

303 (15.07%)

807 (40.15%)

480 (23.88%)

274 (13.63%)

Tags

All tags

Model 1

Model 2

146 (7.26%)

Deep analysis

2. A is strongly preferred

1. A is preferred

0. About the same

-1. B is preferred

-2. B is strongly preferred

		Tags	Statistics
00:00 --:-- 1\00000101_259892.wav 00:00 --:-- 2\00000101_259892.wav	Model 1 Model 2	model1 synthesized model2 synthesized	-0.20 0.94 0.42
00:00 --:-- 1\00000102_260555.wav 00:00 --:-- 2\00000102_260555.wav	Model 1 Model 2	model1 synthesized model2 synthesized	-0.20 0.56 0.25
00:00 --:-- 1\00000103_256771.wav 00:00 --:-- 2\00000103_256771.wav	Model 1 Model 2	model1 synthesized model2 synthesized	-0.10 0.71 0.31
00:00 --:-- 1\00000104_260511.wav 00:00 --:-- 2\00000104_260511.wav	Model 1 Model 2	model1 synthesized model2 synthesized	0.80 0.88 0.39
00:00 --:-- 1\00000105_258305.wav 00:00 --:-- 2\00000105_258305.wav	Model 1 Model 2	model1 synthesized model2 synthesized	-0.10 0.86 0.38
00:00 --:-- 1\00000105_259604.wav 00:00 --:-- 2\00000105_259604.wav	Model 1 Model 2	model1 synthesized model2 synthesized	0.00 0.67 0.30
00:00 --:-- 1\00000105_259649.wav 00:00 --:-- 2\00000105_259649.wav	Model 1 Model 2	model1 synthesized model2 synthesized	0.50 0.97 0.43
00:00 --:-- 1\00000105_259989.wav 00:00 --:-- 2\00000105_259989.wav	Model 1 Model 2	model1 synthesized model2 synthesized	-0.60 0.77 0.34

Overall

Model 2 (Model B)

-0.25

Model 1 (Model A)

By Tag

Model 2 (Model B)

Model 1 (Model A)

Answers

2. A is strongly preferred

1. A is preferred

0. About the same

-1. B is preferred

-2. B is strongly preferred

139 (6.92%)

303 (15.07%)

764 (38.01%)

519 (25.82%)

285 (14.18%)

Tags

All tags

Model 1

Model 2

139 (6.92%)

Deep analysis

2. A is strongly preferred

1. A is preferred

0. About the same

-1. B is preferred

-2. B is strongly preferred

		Tags	Statistics
00:00 --:-- 1\00000101_259892.wav 00:00 --:-- 2\00000101_259892.wav	Model 1 Model 2	model1 synthesized model2 synthesized	-0.30 0.68 0.30
00:00 --:-- 1\00000102_260555.wav 00:00 --:-- 2\00000102_260555.wav	Model 1 Model 2	model1 synthesized model2 synthesized	-0.40 0.37 0.16
00:00 --:-- 1\00000103_256771.wav 00:00 --:-- 2\00000103_256771.wav	Model 1 Model 2	model1 synthesized model2 synthesized	-0.10 0.92 0.41
00:00 --:-- 1\00000104_260511.wav 00:00 --:-- 2\00000104_260511.wav	Model 1 Model 2	model1 synthesized model2 synthesized	0.60 0.84 0.37
00:00 --:-- 1\00000105_258305.wav 00:00 --:-- 2\00000105_258305.wav	Model 1 Model 2	model1 synthesized model2 synthesized	0.00 0.75 0.33
00:00 --:-- 1\00000105_259604.wav 00:00 --:-- 2\00000105_259604.wav	Model 1 Model 2	model1 synthesized model2 synthesized	-0.20 0.66 0.29
00:00 --:-- 1\00000105_259649.wav 00:00 --:-- 2\00000105_259649.wav	Model 1 Model 2	model1 synthesized model2 synthesized	-0.10 0.71 0.31
00:00 --:-- 1\00000105_259989.wav 00:00 --:-- 2\00000105_259989.wav	Model 1 Model 2	model1 synthesized model2 synthesized	-0.60 0.77 0.34

Overall

Model 2 (Model B)

-0.22

Model 1 (Model A)

By Tag

Model 2 (Model B)

Model 1 (Model A)

Answers

2. A is strongly preferred

1. A is preferred

0. About the same

-1. B is preferred

-2. B is strongly preferred

130 (6.47%)

242 (12.04%)

990 (49.25%)

358 (17.81%)

290 (14.43%)

Tags

All tags

Model 1

Model 2

130 (6.47%)

Deep analysis

2. A is strongly preferred

1. A is preferred

0. About the same

-1. B is preferred

-2. B is strongly preferred

		Tags	Statistics
00:00 --:-- 1\00000101_259892.wav 00:00 --:-- 2\00000101_259892.wav	Model 1 Model 2	model1 synthesized model2 synthesized	0.30 0.76 0.33
00:00 --:-- 1\00000102_260555.wav 00:00 --:-- 2\00000102_260555.wav	Model 1 Model 2	model1 synthesized model2 synthesized	-0.40 0.50 0.22
00:00 --:-- 1\00000103_256771.wav 00:00 --:-- 2\00000103_256771.wav	Model 1 Model 2	model1 synthesized model2 synthesized	-0.30 0.83 0.37
00:00 --:-- 1\00000104_260511.wav 00:00 --:-- 2\00000104_260511.wav	Model 1 Model 2	model1 synthesized model2 synthesized	0.90 0.79 0.35
00:00 --:-- 1\00000105_258305.wav 00:00 --:-- 2\00000105_258305.wav	Model 1 Model 2	model1 synthesized model2 synthesized	-0.10 0.86 0.38
00:00 --:-- 1\00000105_259604.wav 00:00 --:-- 2\00000105_259604.wav	Model 1 Model 2	model1 synthesized model2 synthesized	0.10 0.63 0.28
00:00 --:-- 1\00000105_259649.wav 00:00 --:-- 2\00000105_259649.wav	Model 1 Model 2	model1 synthesized model2 synthesized	-0.10 0.86 0.38
00:00 --:-- 1\00000105_259989.wav 00:00 --:-- 2\00000105_259989.wav	Model 1 Model 2	model1 synthesized model2 synthesized	-0.50 0.70 0.31

Overall

Model 2 (Model B)

-0.17

Model 1 (Model A)

By Tag

Model 2 (Model B)

Model 1 (Model A)

Answers

2. A is strongly preferred

1. A is preferred

0. About the same

-1. B is preferred

-2. B is strongly preferred

153 (7.61%)

274 (13.63%)

839 (41.74%)

565 (28.11%)

179 (8.91%)

Tags

All tags

Model 1

Model 2

153 (7.61%)

Deep analysis

2. A is strongly preferred

1. A is preferred

0. About the same

-1. B is preferred

-2. B is strongly preferred

		Tags	Statistics
00:00 --:-- 1\00000101_259892.wav 00:00 --:-- 2\00000101_259892.wav	Model 1 Model 2	model1 synthesized model2 synthesized	-0.20 0.81 0.36
00:00 --:-- 1\00000102_260555.wav 00:00 --:-- 2\00000102_260555.wav	Model 1 Model 2	model1 synthesized model2 synthesized	-0.50 0.38 0.17
00:00 --:-- 1\00000103_256771.wav 00:00 --:-- 2\00000103_256771.wav	Model 1 Model 2	model1 synthesized model2 synthesized	0.00 0.89 0.39
00:00 --:-- 1\00000104_260511.wav 00:00 --:-- 2\00000104_260511.wav	Model 1 Model 2	model1 synthesized model2 synthesized	0.80 0.66 0.29
00:00 --:-- 1\00000105_258305.wav 00:00 --:-- 2\00000105_258305.wav	Model 1 Model 2	model1 synthesized model2 synthesized	-0.10 0.71 0.31
00:00 --:-- 1\00000105_259604.wav 00:00 --:-- 2\00000105_259604.wav	Model 1 Model 2	model1 synthesized model2 synthesized	-0.20 0.56 0.25
00:00 --:-- 1\00000105_259649.wav 00:00 --:-- 2\00000105_259649.wav	Model 1 Model 2	model1 synthesized model2 synthesized	0.00 0.75 0.33
00:00 --:-- 1\00000105_259989.wav 00:00 --:-- 2\00000105_259989.wav	Model 1 Model 2	model1 synthesized model2 synthesized	-0.30 0.83 0.37