Back to Jobs

Conversational Speech AI Evaluator; Australia (English)

Remote, USA Full-time Posted 2026-06-06

Join the Appen team as an Independent Contractor for Project Astra. Project Astra is seeking individuals for an ongoing, ad-hoc project focused on improving real-time conversational AI. In this project, participants will converse with a speech-to-speech AI model and evaluate its performance across speech recognition, audio output quality, conversation flow, and content accuracy. Help improve real-time conversational AI by evaluating multilingual voice interactions for accuracy, quality, and natural flow. Key Responsibilities: - Engage in conversations with a real-time speech-to-speech AI model - Evaluate performance based on speech recognition, audio quality, conversation flow, and content accuracy - Provide accurate and consistent ratings based on project guidelines - Complete assigned tasks within the given timelines - Each conversation will last approximately 8 to 10 minutes. Key Requirements: - Must be a native English speaker residing in Australia - Must have a strong understanding of grammar and localization - Keen attention to detail - Access to a stable internet connection and a computer This role is a project-based opportunity with CrowdGen, where you will join the CrowdGen Community as an Independent Contractor. If selected, you will receive an email from CrowdGen regarding the creation of an account using your application email address. You will need to log in to this account and reset the password, complete the setup requirements, and proceed with your application for this project-based role. If you enjoy engaging in conversations and paying attention to detail, this is a great opportunity to help improve AI systems that deliver natural, multilingual voice interactions. Slots are limited — apply through CrowdGen and start conversing and evaluating! #crowdgen \n \n$19 - $19 an hour \n Apply To This Job

Similar Jobs

Prompt Systems Engineer

Remote, USA Full-time

VP, Data and AI Strategy

Remote, USA Full-time

Senior Marketing Manager

Remote, USA Full-time

Director Commercial Finance

Remote, USA Full-time

Director, Global Pre-Approval Patient Access

Remote, USA Full-time

HR Analyst

Remote, USA Full-time

Advanced Practice Provider - New York (Part-time)

Remote, USA Full-time

Commercial Account Executive - GCR

Remote, USA Full-time

Advanced Practice Provider - New York (Part-time)

Remote, USA Full-time

Psychiatric Nurse Practitioner - New York (Part-time)

Remote, USA Full-time

Experienced Customer Service Agent – Luxury Tours and Vacation Packages

Remote, USA Full-time

Experienced Full Stack Product Manager – Customer Loyalty (Remote)

Remote, USA Full-time

Adjunct PE/Health (TX, MI and PA) - Teaching Services

Remote, USA Full-time

Mortgage Loan Officer / Home Loan Specialist

Remote, USA Full-time

Experienced Customer Service Representative - Insurance - San Diego, CA

Remote, USA Full-time

Experienced Full Stack Customer Service Manager – Remote Operations and Client Experience

Remote, USA Full-time

Experienced Full Stack Customer Service Representative – Remote Customer Support

Remote, USA Full-time

Experienced Customer Service Representative - Remote Opportunity with arenaflex

Remote, USA Full-time

Product Lead – GIS & Geospatial AI (Remote)

Remote, USA Full-time

Experienced Full Stack Remote Live Chat Support Specialist – Night Shift – Customer Service Representative

Remote, USA Full-time