Book a demo
Feedback
Overview
Analysis
Dialog vs Eleven preview eval
Small sample size in preparation for comparing Dialog vs Multilingual V2
Loading...
Loading...
Question 1. Listen to the speech/audio samples and rate which one you prefer.
Comparison | 5 steps
Overall
Multilingual V2 (Model B)
0.15
PlayDialog (Model A)
Answers
2
.
PlayDialog (Model A)
is better
1
0
-1
-2
.
Multilingual V2 (Model B)
is better
369 (41.00%)
84 (9.33%)
62 (6.89%)
87 (9.67%)
298 (33.11%)
Deep analysis
Distribution
Mean
Files
2
.
PlayDialog (Model A)
is better
1
0
-1
-2
.
Multilingual V2 (Model B)
is better
MAX 2
1
0
-1
MIN -2
MAX 2
1
0
-1
MIN -2
Tags
Filename
Model
Tags
Statistics
x̅
CI
σ
x̅
00:00
--:--
180.wav
00:00
--:--
180.wav
PlayDialog
Multilingual V2
x̅
-0.50
CI
1.40
σ
x̅
0.62
00:00
--:--
181.wav
00:00
--:--
181.wav
PlayDialog
Multilingual V2
x̅
-1.40
CI
0.90
σ
x̅
0.40
00:00
--:--
182.wav
00:00
--:--
182.wav
PlayDialog
Multilingual V2
x̅
-0.50
CI
1.27
σ
x̅
0.56
00:00
--:--
183.wav
00:00
--:--
183.wav
PlayDialog
Multilingual V2
x̅
-0.30
CI
1.31
σ
x̅
0.58
00:00
--:--
184.wav
00:00
--:--
184.wav
PlayDialog
Multilingual V2
x̅
0.40
CI
1.36
σ
x̅
0.60
00:00
--:--
185.wav
00:00
--:--
185.wav
PlayDialog
Multilingual V2
x̅
0.50
CI
1.27
σ
x̅
0.56
00:00
--:--
186.wav
00:00
--:--
186.wav
PlayDialog
Multilingual V2
x̅
0.70
CI
1.22
σ
x̅
0.54
00:00
--:--
187.wav
00:00
--:--
187.wav
PlayDialog
Multilingual V2
x̅
0.50
CI
1.08
σ
x̅
0.48
1
2
3
4
5
...
12
Question 2. What was the main factor behind your preferred sample?
Single select | No-scored | 5 radio buttons
Answers
A1. Expressiveness
A2. Audio quality
A3. Pacing (e.g. rhythm, tempo, speed)
A4. Voice accuracy (e.g. pronunciation)
A5. Hallucinations
A6. Other...
414 (46.00%)
118 (13.11%)
297 (33.00%)
64 (7.11%)
1 (0.11%)
6 (0.67%)
Deep analysis
Distribution
Files
A1. Expressiveness
A2. Audio quality
A3. Pacing (e.g. rhythm, tempo, speed)
A4. Voice accuracy (e.g. pronunciation)
A5. Hallucinations
A6. Other...
Tags
Answers
Expressiveness
Audio quality
Pacing (e.g. rhythm, tempo, speed)
Voice accuracy (e.g. pronunciation)
Hallucinations
Other...
Filename
Model
Tags
00:00
--:--
180.wav
00:00
--:--
180.wav
PlayDialog
Multilingual V2
Expressiveness
Audio quality
Voice accuracy (e.g. pronunciation)
00:00
--:--
181.wav
00:00
--:--
181.wav
PlayDialog
Multilingual V2
Expressiveness
Audio quality
b is less hyperbolic 'sounding' to me
2 more...
00:00
--:--
182.wav
00:00
--:--
182.wav
PlayDialog
Multilingual V2
Pacing (e.g. rhythm, tempo, speed)
Audio quality
Expressiveness
00:00
--:--
183.wav
00:00
--:--
183.wav
PlayDialog
Multilingual V2
Expressiveness
A's more exasperated sounding voice is more appropriate for the content
Audio quality
2 more...
00:00
--:--
184.wav
00:00
--:--
184.wav
PlayDialog
Multilingual V2
Expressiveness
Voice accuracy (e.g. pronunciation)
very engaging
2 more...
00:00
--:--
185.wav
00:00
--:--
185.wav
PlayDialog
Multilingual V2
Expressiveness
A sounds more convincing, slightly more authentic to me
Audio quality
1 more...
00:00
--:--
186.wav
00:00
--:--
186.wav
PlayDialog
Multilingual V2
Expressiveness
Pacing (e.g. rhythm, tempo, speed)
Voice accuracy (e.g. pronunciation)
00:00
--:--
187.wav
00:00
--:--
187.wav
PlayDialog
Multilingual V2
Voice accuracy (e.g. pronunciation)
Pacing (e.g. rhythm, tempo, speed)
Expressiveness
1
2
3
4
5
...
12
