ABx Testing

French (Canada)
English (US)
Portuguese (Portugal)
Spanish (Mexico)
English (UK)

Compare outputs between AI model iterations with direct, head-to-head preference testing to validate statistically significant improvements between versions, and to determine user preferences between models.

We offer direct, head-to-head preference testing that occurs when comparing two different speech model versions to validate statistically significant user preference for one over the other.

  • This way of agreeing, creating, and analyzing different model versions eliminates language issues leading to better final version outcomes.
  • The process of ABx testing model versions is straightforward and the outcomes are transparent.
  • Randomized presentation of AB pairs (A -> B vs B -> A) across users reduces ordering bias

Check our API Documentation to know more.

Contact Us

All fields are required

By clicking on the appropriate button or by downloading, installing, accessing, and/or using the data sample, you are agreeing with Defined.ai Privacy Policy, Terms of Use, and Data License Agreement.

You might also be interested in:

Portuguese (Brazil) Spontaneous Dialogue

312 hours
DAI logo
Defined.ai hosts the leading online marketplace for buying and selling AI data, tools and models, and offers professional services to help deliver success in complex machine learning projects. Defined.ai is a community of AI professionals building fair, accessible and ethical AI of the future.
1201 3rd Avenue, STE 2200, Seattle WA
[email protected]
Wired logo
Forbes 2019 AI50 logo
CB insights logo
Forbes 2020 logo
Inc. 5000 logo
PME logo

© 2023 DefinedCrowd. All rights reserved.