rime_coda_clementine_vs_openai_4ominitts_coral_demo_cmos_v1

Demo CMOS: Rime Coda (clementine) vs OpenAI gpt-4o-mini-tts (coral), stratified 25-pair subset. Alphanumerics conditioned: spell() for Rime, plain-text spelling standard for OpenAI (no SSML support). Both sides 24kHz mono 16-bit WAV.

Overall

rime_coda_clementine (Model B)

-1.18

openai_4ominitts_coral (Model A)

By Tag

rime_coda_clementine (Model B)

openai_4ominitts_coral (Model A)

Answers

2. openai_4ominitts_coral (Model A) is much better

-1

-2. rime_coda_clementine (Model B) is much better

6 (3.43%)

9 (5.14%)

24 (13.71%)

45 (25.71%)

91 (52.00%)

Deep analysis

2. openai_4ominitts_coral (Model A) is much better

-1

-2. rime_coda_clementine (Model B) is much better

		Tags	Statistics
00:00 --:-- openai_4ominitts_coral/addresses_contact-0008.wav 00:00 --:-- rime_coda_clementine/addresses_contact-0008.wav	openai_4ominitts_coral rime_coda_clementine	cat_addresses_contact sub_email utt_addresses_contact-0008 campaign_demo_cmos_v1 cat_addresses_contact sub_email utt_addresses_contact-0008 campaign_demo_cmos_v1	-1.57 0.49 0.20
00:00 --:-- openai_4ominitts_coral/amounts_units-0100.wav 00:00 --:-- rime_coda_clementine/amounts_units-0100.wav	openai_4ominitts_coral rime_coda_clementine	cat_amounts_units sub_percentage utt_amounts_units-0100 campaign_demo_cmos_v1 cat_amounts_units sub_percentage utt_amounts_units-0100 campaign_demo_cmos_v1	-1.00 1.07 0.44
00:00 --:-- openai_4ominitts_coral/support_dialogue-0197.wav 00:00 --:-- rime_coda_clementine/support_dialogue-0197.wav	openai_4ominitts_coral rime_coda_clementine	cat_support_dialogue sub_retail utt_support_dialogue-0197 campaign_demo_cmos_v1 cat_support_dialogue sub_retail utt_support_dialogue-0197 campaign_demo_cmos_v1	-0.71 1.28 0.52
00:00 --:-- openai_4ominitts_coral/dates_times-0053.wav 00:00 --:-- rime_coda_clementine/dates_times-0053.wav	openai_4ominitts_coral rime_coda_clementine	cat_dates_times sub_date utt_dates_times-0053 campaign_demo_cmos_v1 cat_dates_times sub_date utt_dates_times-0053 campaign_demo_cmos_v1	-1.71 0.45 0.18
00:00 --:-- openai_4ominitts_coral/support_dialogue-0105.wav 00:00 --:-- rime_coda_clementine/support_dialogue-0105.wav	openai_4ominitts_coral rime_coda_clementine	cat_support_dialogue sub_healthcare utt_support_dialogue-0105 campaign_demo_cmos_v1 cat_support_dialogue sub_healthcare utt_support_dialogue-0105 campaign_demo_cmos_v1	-0.71 1.28 0.52
00:00 --:-- openai_4ominitts_coral/phone_numbers-0178.wav 00:00 --:-- rime_coda_clementine/phone_numbers-0178.wav	openai_4ominitts_coral rime_coda_clementine	cat_phone_numbers sub_local utt_phone_numbers-0178 campaign_demo_cmos_v1 cat_phone_numbers sub_local utt_phone_numbers-0178 campaign_demo_cmos_v1	-1.14 1.46 0.59
00:00 --:-- openai_4ominitts_coral/alphanumerics-0140.wav 00:00 --:-- rime_coda_clementine/alphanumerics-0140.wav	openai_4ominitts_coral rime_coda_clementine	cat_alphanumerics sub_policy_case_id utt_alphanumerics-0140 campaign_demo_cmos_v1 cat_alphanumerics sub_policy_case_id utt_alphanumerics-0140 campaign_demo_cmos_v1	-1.71 0.45 0.18
00:00 --:-- openai_4ominitts_coral/alphanumerics-0111.wav 00:00 --:-- rime_coda_clementine/alphanumerics-0111.wav	openai_4ominitts_coral rime_coda_clementine	cat_alphanumerics sub_policy_case_id utt_alphanumerics-0111 campaign_demo_cmos_v1 cat_alphanumerics sub_policy_case_id utt_alphanumerics-0111 campaign_demo_cmos_v1	-1.14 0.83 0.34

Overall

rime_coda_clementine (Model B)

-1.18

openai_4ominitts_coral (Model A)

By Tag

rime_coda_clementine (Model B)

openai_4ominitts_coral (Model A)

Answers

2. openai_4ominitts_coral (Model A) is much better

-1

-2. rime_coda_clementine (Model B) is much better

6 (3.43%)

9 (5.14%)

24 (13.71%)

45 (25.71%)

91 (52.00%)

Deep analysis

2. openai_4ominitts_coral (Model A) is much better

-1

-2. rime_coda_clementine (Model B) is much better

		Tags	Statistics
00:00 --:-- openai_4ominitts_coral/addresses_contact-0008.wav 00:00 --:-- rime_coda_clementine/addresses_contact-0008.wav	openai_4ominitts_coral rime_coda_clementine	cat_addresses_contact sub_email utt_addresses_contact-0008 campaign_demo_cmos_v1 cat_addresses_contact sub_email utt_addresses_contact-0008 campaign_demo_cmos_v1	-1.57 0.49 0.20
00:00 --:-- openai_4ominitts_coral/amounts_units-0100.wav 00:00 --:-- rime_coda_clementine/amounts_units-0100.wav	openai_4ominitts_coral rime_coda_clementine	cat_amounts_units sub_percentage utt_amounts_units-0100 campaign_demo_cmos_v1 cat_amounts_units sub_percentage utt_amounts_units-0100 campaign_demo_cmos_v1	-1.00 1.07 0.44
00:00 --:-- openai_4ominitts_coral/support_dialogue-0197.wav 00:00 --:-- rime_coda_clementine/support_dialogue-0197.wav	openai_4ominitts_coral rime_coda_clementine	cat_support_dialogue sub_retail utt_support_dialogue-0197 campaign_demo_cmos_v1 cat_support_dialogue sub_retail utt_support_dialogue-0197 campaign_demo_cmos_v1	-0.71 1.28 0.52
00:00 --:-- openai_4ominitts_coral/dates_times-0053.wav 00:00 --:-- rime_coda_clementine/dates_times-0053.wav	openai_4ominitts_coral rime_coda_clementine	cat_dates_times sub_date utt_dates_times-0053 campaign_demo_cmos_v1 cat_dates_times sub_date utt_dates_times-0053 campaign_demo_cmos_v1	-1.71 0.45 0.18
00:00 --:-- openai_4ominitts_coral/support_dialogue-0105.wav 00:00 --:-- rime_coda_clementine/support_dialogue-0105.wav	openai_4ominitts_coral rime_coda_clementine	cat_support_dialogue sub_healthcare utt_support_dialogue-0105 campaign_demo_cmos_v1 cat_support_dialogue sub_healthcare utt_support_dialogue-0105 campaign_demo_cmos_v1	-0.71 1.28 0.52
00:00 --:-- openai_4ominitts_coral/phone_numbers-0178.wav 00:00 --:-- rime_coda_clementine/phone_numbers-0178.wav	openai_4ominitts_coral rime_coda_clementine	cat_phone_numbers sub_local utt_phone_numbers-0178 campaign_demo_cmos_v1 cat_phone_numbers sub_local utt_phone_numbers-0178 campaign_demo_cmos_v1	-1.14 1.46 0.59
00:00 --:-- openai_4ominitts_coral/alphanumerics-0140.wav 00:00 --:-- rime_coda_clementine/alphanumerics-0140.wav	openai_4ominitts_coral rime_coda_clementine	cat_alphanumerics sub_policy_case_id utt_alphanumerics-0140 campaign_demo_cmos_v1 cat_alphanumerics sub_policy_case_id utt_alphanumerics-0140 campaign_demo_cmos_v1	-1.71 0.45 0.18
00:00 --:-- openai_4ominitts_coral/alphanumerics-0111.wav 00:00 --:-- rime_coda_clementine/alphanumerics-0111.wav	openai_4ominitts_coral rime_coda_clementine	cat_alphanumerics sub_policy_case_id utt_alphanumerics-0111 campaign_demo_cmos_v1 cat_alphanumerics sub_policy_case_id utt_alphanumerics-0111 campaign_demo_cmos_v1	-1.14 0.83 0.34