The Universal Human Relevance System (UHRS) is a crowdsourcing platform managed by Microsoft, focusing on data labeling tasks to enhance AI systems. Through partnerships with vendors, it connects workers—known as "judges"—who perform microtasks such as evaluating search relevance, transcribing audio, and annotating images or videos. This work is crucial for training machine learning models across various AI applications. UHRS operates globally and provides flexible work opportunities, with tasks accessible via partner platforms like Clickworker and Appen. Workers typically earn by completing short, repetitive tasks (called “HitApps”), and although earnings vary, some tasks can yield decent hourly rates when available. However, task availability fluctuates, and the platform has strict confidentiality rules, requiring users to follow specific guidelines to maintain their accounts and earnings access. For those interested, signing up through platforms like Clickworker is often the easiest entry point, though passing assessments is required before accessing tasks on UHRS.

To become a UHRS judge, no fees are required—access is entirely free. The first step is to register through one of UHRS’s partner platforms, such as Clickworker, Appen, OneForma, Datavio, or Yandex Toloka. The registration process differs slightly between these platforms; in some cases, users may need to complete preliminary tasks before receiving an invitation to join UHRS. Once registered, applicants must pass an initial UHRS assessment on the vendor platform to determine which types of microtasks, or “HitApps,” they qualify for. These assessments ensure that judges possess the necessary skills for the tasks they will perform, such as data labeling or search relevance evaluation.