Graphic Designer - AI Image Evaluation Remote
Outlier Experts work on a variety of projects, from generating training data to evaluating the performance of models. About the opportunity: We are seeking detail-oriented English speakers to review AI-generated media. Responsibilities: • Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural, useful, and clear each one sounded • Comparing pairs of AI-generated images and videos and judging which one better follows the prompt • Inspecting outputs closely, including zooming in and replaying, to spot problems like distorted anatomy, flickering or unnatural motion, text errors, and audio that doesn't match the video • Rating each output across dimensions like adherence, quality, and realism, then writing a specific explanation in English that points to what you saw or heard Some tasks rank edited images against the original. • Video evaluations: Rank AI-generated videos against a text prompt, or edited videos against their source clip.