SCALE AIAbout this role
Outlier is an innovative AI training platform operated by Scale AI, and we are looking for detail-oriented individuals to join our pool of Outlier Experts. As an evaluator, you will engage in a range of exciting projects, from generating training data to assessing the performance of AI models.
About the Opportunity:
We're on the lookout for English speakers who are passionate about AI to review and analyze AI-generated media. Your tasks will include conducting live, roleplay conversations with an AI voice model, rating the interactions, comparing generated images and videos for accuracy, and articulating in writing what aspects were flawed or impressive, all from the comfort of your own home and on your flexible schedule.
At Outlier, your contributions play a crucial role in refining how advanced AI systems learn, reason, and evolve. Your evaluations and feedback are vital in transforming cutting-edge research into AI that performs effectively in real-world scenarios.
Key Responsibilities:
Engage in live, scenario-based conversations in English with AI voice models and provide ratings on their clarity and usefulness.Compare pairs of AI-generated images and videos, assessing which aligns better with given prompts.Conduct detailed inspections of outputs, scrutinizing for issues such as distorted elements, audio-visual mismatches, and any errors.Evaluate outputs based on adherence, quality, and realism, providing concise written explanations of your observations.Common Tasks:
Image Evaluations: Compare two AI-generated images based on the same prompt, assessing adherence to instructions, visual quality, and any visible artifacts.Video Evaluations: Assess AI-generated videos against prompts for accuracy and quality.Video Captioning: Label actions in first-person videos, correcting captions based on AI drafts.Audio Evaluations: Rate AI-generated speech on factors like naturalness and pronunciation, occasionally recording explanations.Ideal Qualifications:
Fluent in English with excellent communication skills and comfort in conversational scenarios.Highly attentive to detail with the ability to conduct thorough evaluations and identify issues.Able to think spontaneously and converse naturally in varied real-life situations.Experience writing concise, evidence-based analysis.Comfortable making decisions when both options present weaknesses.Preferred: Currently pursuing or have completed a Bachelor's degree or higher.Requirements for Sign-Up:
A valid ID and mobile phone from your country of residence.A resume that highlights your skills and expertise.A LinkedIn profile showcasing your educational background and work experience.Compensation:
Project Rate: Earn up to USD $15 per hour.Incentives: Typically, contributors gain an additional 7.5% through Missions, with top earners increasing their earnings by an average of 11%.Payment Schedule: Payments are processed weekly on Tuesdays, covering tasks completed the previous week, sent via PayPal, AirTM, or ACH transfer.Rates may vary based on expertise and project needs. Certain projects may offer additional incentive payments.Why You Should Join Outlier:
Enjoy flexible work arrangements from anywhere, with no minimum hour requirements.Access premium LLMs valued at over $200 per month at no cost.Be part of a global community of 900K+ Outlier Experts, with over $600M paid to contributors.Collaborate with professionals in your field to help advance pre-release AI models.How to Apply:
Create an account on Outlier.Upload your resume.Upload your valid ID.Start earning by completing tasks.Currently Accepting Applicants From: Australia, Canada, Ireland, New Zealand, United Kingdom, and United States.
Please Note: This is a 1099 contract position. You will work as a freelancer/independent contractor on the Outlier.ai platform. Because this is freelance work, no internships, sponsorship, or employment are offered. You must be authorized to work in your country of residence. If you are an international student, you may be eligible for Outlier if you have an appropriate visa. For specific questions regarding your situation, please consult your tax or immigration advisor.
Company:
Scale AI
Level of experience (years):
Senior (5+ years of experience)
How to apply:
Please mention NLP People as a source when applying