Online Generalist

About The Role

Online generalist jobs at Rex.zone are remote, full-time AI data operations roles supporting LLM training pipelines through data labeling, RLHF evaluation, prompt evaluation, QA evaluation, and content safety labeling. You will follow clear rubrics and annotation guidelines to deliver high-quality training and evaluation data.

Key Responsibilities

• Perform data labeling across NLP and computer vision tasks (text classification, NER, image tagging)
• Complete RLHF and QA evaluation on model responses using scoring rubrics
• Conduct prompt evaluation for helpfulness, correctness, tone, and safety
• Apply content safety labeling policies (hate, harassment, self-harm, sexual content) as needed
• Maintain training data quality via spot checks, peer review, and escalation of edge cases
• Track throughput, accuracy, and rework rates; support dataset auditing and de-duplication checks

Required Qualifications

• Experience in remote operations, QA, moderation, data annotation, or structured review workflows
• Strong written communication and policy-based decision making
• Comfort switching between task types (classification, ranking, extraction, evaluation)
• Reliable internet access and ability to meet full-time availability expectations

Preferred Qualifications

• Exposure to RLHF, prompt evaluation, or LLM evaluation
• Experience with annotation tools, taxonomy design, or NER workflows
• Understanding of common NLP/CV tasks and trust & safety policy enforcement

How Work Is Evaluated

• Annotation guidelines compliance and training data quality
• Consistency in RLHF scoring and evaluation rationales
• Turnaround time, reliability, and escalation quality