AI Evaluator

13 hours ago

Italy Remote Nairobi Nairobi Kenya Sama Full time $40,000 - $50,000 per year

About the role:

We are looking for highly skilled AI Evaluators to support the development of advanced AI tools for grammar correction and proofreading. This project focuses on creating a rich and diverse dataset of written Italian text, annotated and corrected by humans.

Responsibilities:

Respond to a set of prompts simulating realistic business or casual communication.Write clear, plausible short texts (3–4 sentences for business settings, 1–2 sentences for casual chat).Generate responses with intentional but realistic grammar, spelling, and structural errors.Review annotated message pairs (input text + corrected/proofread version) to ensure:All grammar/spelling/preposition/punctuation errors are corrected appropriatelyMeaning is preserved between input and corrected textError types are classified correctlyExplanations are clear and linguistically sound

Qualifications:

Italian as a first language - C1 Italian proficiency English as a second language - B2 English proficiency.Ability to follow linguistic and situational writing prompts.Good written communication and creativity.2 years working experience in a corporate/ business environment.1 year working experience working as an AI Evaluator, data annotator, or similar role Strong computer literacy and fast, accurate typing skills are essential for navigating annotation tools and maintaining efficiency in text-based tasks.Strong logic, intuitive problem-solving and critical thinking; adaptability to the needs of the task. The candidate needs to be open-minded and welcome different viewpoints or solutions.Proactiveness, confidence to work independently without constant support. Reliability and being able to make good decisions on their own.Be a thought partner to delivery managers, input into the project delivery strategies, and share quality best practices to aid in achieving the project goals.Adapt quickly to evolving guidelines, new task types, and AI model updates in a fast-paced, iterative environment. Access to your own laptop for work 

Preferred Qualifications:

C1 or C2 English preferred Experience working with NLP/GenAI models is a plus 

NB: This is a temporary, project-based position with the possibility of renewal. While this role will be on payroll, please note that benefits are not included as part of this position.

About Sama 

Sama provides high-quality training data that powers AI technology for Fortune 2000 companies such as Google, Walmart, Ford, Microsoft, and Marriott. We're experts in data annotation, supporting text, 2D, 3D image, video, and sensor data for machine learning algorithms and generative AI models. Sama offers the highest quality SLAs in the industry, along with cutting-edge ML-assisted annotation tools, QA processes, and security and compliance standards.

Founded in 2008 on the belief that "talent is equally distributed, but opportunity is not", Sama is driven by the mission to expand opportunities for those who are underprivileged. As a certified B-Corp, Sama has provided worker training programs to increase economic opportunity for more than 15,000 people from underserved communities. By connecting our customers with amazing talent in East Africa, we've impacted more than 69,000 workers and their dependents.

Today, our vision is to provide data scientists, ML engineers, and data operations teams with an indispensable, integrated platform for AI data preparation, labeling, and collection. 

For more information, visit

More information can be found at:

Featured in Forbes: How Ethical Is Your AI?Sama Honored on Inc. Magazine's Annual List of America's Fastest-Growing Private Companies — the Inc. 5000Reversing Poverty - Ted Talk by our founder Leila Janah

Our Culture:

Sama is quite unique. We are a technology company with a social mission. People that thrive in a high-growth environment, love working on the bleeding edge of technology, and really care about having a positive impact on the world are a great fit for the Sama culture. Our core values are One Team, One Goal - Deliver. Period. - Trust & Transparency - Customer First - Humanity.

Our Benefits:

Sama offers competitive compensation commensurate with experience and a full benefits package, including: medical, dental, and vision insurance, long-term disability insurance, life, and AD&D insurance, employer-matching Group RRSP, generous holiday and vacation policies, a monthly fitness stipend, monthly cell phone reimbursement and professional development opportunities. Our Talent Acquisition team would be happy to discuss our benefits packages with you in more detail during the interview process.

At Sama, we pride ourselves in being a diverse and equal opportunity employer.

  • AI Evaluator

    13 hours ago

    Germany Remote; Nairobi, Nairobi, Kenya Sama Full time €30,000 - €60,000 per year

    About the role:We are looking for highly skilled AI Evaluators to support the development of advanced AI tools for grammar correction and proofreading. This project focuses on creating a rich and diverse dataset of written German text, annotated and corrected by humans.Responsibilities:Respond to a set of prompts simulating realistic business or casual...

  • Swahili AI Content Experts

    13 hours ago

    Kenya (Remote) LILT Full time $30,000 - $60,000 per year

    About LILTAI is changing how the world communicates — and LILT is leading that transformation.We're on a mission to make the world's information accessible to everyone, regardless of the language they speak. We use cutting-edge AI, machine translation, and human-in-the-loop expertise to translate content faster, more accurately, and more cost-effectively...

  • Automation Engineer

    13 hours ago

    Nairobi, Nairobi Area, Kenya RAY AI Full time $60,000 - $120,000 per year

    A Message from Our CEO: We are hiring full-time Automation Engineers to support entrepreneurs and founders across the US and Europe. As an Automation Engineer, you will be the operational backbone behind visionary leaders—leveraging your technical expertise, organizational excellence, and proactive mindset to help them reclaim their time and focus on what...

  • Remote AI Training Contributor

    13 hours ago

    Kenya FreshTalent Full time 240,000 - 480,000 per year

    Join a fast-growing remote platform that connects subject-matter experts, students, and professionals with flexible, paid opportunities to support the development of cutting-edge AI systems. Whether you're a curious learner or a seasoned specialist, this role offers a chance to contribute meaningfully to the future of artificial intelligence—on your own...

  • AI Engineer

    13 hours ago

    Nairobi, Nairobi Area, Kenya CloudPlexo Full time $60,000 - $90,000 per year

    Company DescriptionCloudPlexo is a global cloud technology company and an advanced AWS Partner. Our mission is to help businesses leverage technology efficiently on the cloud. We provide a range of cloud-native services and products, including cloud storage, application development, and cloud migration. At CloudPlexo, we believe the cloud is for everyone and...

  • LLM & AI Engineer

    13 hours ago

    Nairobi, Nairobi Area, Kenya Crafted Systems Full time 900,000 - 1,200,000 per year

    About the RoleCrafted Systems is seeking a LLM & AI Engineer passionate about building intelligent, autonomous systems. You'll design, prototype and deploy advanced autonomous AI agents powered by large language models (LLMs), integrating them into our products to automate reasoning, decision-making and workflows.We're looking for a hands-on engineer who...

  • Rust Software Engineer – Large Language Model Evaluation

    13 hours ago

    Nairobi, Nairobi Area, Kenya beBeeLLM Full time $40,000 per year

    Job Opportunity: LLM Evaluation SpecialistWe are seeking a skilled and experienced software engineer to join our team in building evaluation and training datasets for large language models.The successful candidate will work closely with researchers to design and select repositories and tasks that challenge large language models.This is an exciting...

  • Monitoring & Evaluation Manager

    13 hours ago

    Nairobi, Nairobi Area, Kenya Jacaranda Health Full time 1,440,000 - 2,880,000 per year

    About Us  Jacaranda Health's mission is to improve maternal and newborn health outcomes in the public health system. Through innovative AI-driven technology and human-centered solutions, we partner with governments to scale impactful, data-driven interventions. These solutions include PROMPTS, an AI-enabled platform for mothers, and MENTORS, a...

  • Python Intern

    2 days ago

    Nairobi, Kenya M365Connect Full time

    Python Intern (AI-Driven Recruitment Automation) Company: M365ConnectLocation: RemoteDuration: 3 months (with potential for extension)Commitment: Full-time, 40 hours per week About M365Connect M365Connect is an innovative IT recruitment company based in Latvia, specializing in connecting top-tier Microsoft professionals with leading tech organizations....

  • Python Intern

    13 hours ago

    Nairobi, Nairobi Area, Kenya M365Consult Full time 450,000 - 750,000 per year

    Company:M365ConnectLocation:RemoteDuration:3 months (with potential for extension)Commitment:Full-time, 40 hours per weekAbout M365ConnectM365Connect is an innovative IT recruitment company based in Latvia, specializing in connecting top-tier Microsoft professionals with leading tech organizations. Leveraging advanced tools likeManatal(our Applicant Tracking...