Remote Literary AI Evaluation Specialist

OpenTrain AI, Inc. is seeking an Aerospace Engineering Expert to create and review difficult problems used to evaluate AI models. This remote, part-time role pays $85–$185 per hour and requires advanced aerospace knowledge and sound engineering judgment.You will work with a distributed team, design problems across aero domains, provide verifiable analyses,...

OpenTrain AI, Inc. seeks an Enterprise Operations Domain Analyst to design expert scenarios and grading rubrics for evaluating AI models in supply chain, finance, and compliance.This remote, contract, part-time role requires extensive enterprise operations experience and professional English fluency. The work focuses on creating reference solutions, detailed...

RemoteJobsOne is seeking Medical Evaluation Specialists (students, residents, physicians) to contribute advanced clinical insights for training AI systems. This fully remote contractor role is open to candidates based in the United Arab will design and verify high-quality medical questions and answers to probe reasoning in frontier AI. Responsibilities...

RemoteJobsOne in the United Arab Emirates invites PhD-level researchers to join as Research Evaluation Specialists on a remote, contractor basis. You will develop high-difficulty questions and ensure quality with primary sources, citations, and rigorous reasoning.Ideal candidates have a PhD or active candidacy, strong English writing, and a track record in...

YO AI Labs is seeking an AI Evaluation Specialist to remotely assess enterprise AI outputs. The contractor will use detailed rubrics to judge accuracy, relevance, and adherence to guidelines, and provide clear feedback to help improve systems. You will work independently on high-volume evaluations, identify gaps in reasoning or tool use, and contribute to...

YO AI Labs is seeking experienced Product Managers and Product Owners for a remote evaluation project focused on assessing AI-generated content and documentation. You will analyze specifications, release notes, and stakeholder communications, providing detailed rationales and actionable feedback.Prior AI experience is not required; strong product management...

OpenTrain AI, Inc. is seeking a Philosophy Expert to design and evaluate AI reasoning tasks. You will craft scenarios, write reference answers, and assess model responses for logic, ethics, validity, and fairness.The role requires deep philosophy training and precise written English, with remote work and flexible hours. Salary ranges from $50 to $100 per...

Aptura is seeking Subject Matter Experts to design and test Excel-based tasks for evaluating AI in Sales Ops. You will craft ARR waterfalls, commission models, and territory plans, drawing from real-world work to challenge AI systems.This is a remote contractor role with immediate start and a 4–6 week duration, paying per task on a weekly cadence. Ideal...

We are seeking an LLM Evaluation Assistant to help our team verify the logic and accuracy of model generated financial insights. This role focuses on the careful review of automated outputs to ensure they meet our standards for factual discipline and economic reasoning.About Blue Oak ConsultingBlue Oak Consulting provides independent advisory on pricing,...