iMerit launches a platform for specialist human evaluation of AI

The EXL company is organising expert recruitment, assignments and payments around model training and validation.

iMerit, an EXL company, launched its Scholars platform on October 26 to organise specialist participation in AI training, evaluation and validation. The announcement describes a unified system for recruiting experts, matching them to projects, managing engagements and arranging payments.

The company says its existing community includes more than 30,000 vetted professionals across 118 countries and 106 languages. The platform is designed to support a much larger network; that capacity ambition should be distinguished from its current community size.

Expertise as part of the workflow

The platform uses iMerit’s Ango Hub tooling for multimodal data and feedback workflows, with Trolley providing global payout capabilities. EXL positions it for fields where specialised judgement matters, including healthcare, finance and physical AI.

The underlying task is more demanding than deciding whether an answer reads naturally. An expert may need to identify a technically plausible mistake, explain why it matters and supply evidence that helps improve a model or its surrounding workflow.

Challenging a model, not only labelling data

EXL names reinforcement learning from human feedback, red-teaming, question-and-answer work, reasoning traces and evaluation among the community’s activities. The platform matches projects to domain specialisation and cognitive skills, with integrated feedback tools rather than a standalone contact list.

That matters in a clinical or financial task where the error may be technically subtle. A specialist can challenge the model’s reasoning and help turn the correction into a useful training or evaluation artefact. The company is selling infrastructure for an ongoing expert relationship. Whether that relationship improves a particular application depends on how clearly the work is scoped and how corrections reach the responsible team.

Sources

- [iMerit launches Scholars platform](https://www.exlservice.com/about/newsroom/imerit-an-exl-company-launches-imerit-scholars-platform-as-ai-talent-war-shifts-to-domain-expertise) — EXL