This is a remote, hourly-paid contractor role where you will interact with a speech-based AI model through short, natural conversations and then evaluate the model’s performance. You’ll speak to the model in everyday scenarios (e.g., acting as a customer while the model plays a flower shop) for approximately 5 minutes per session, then answer structured questions about response quality, accuracy, helpfulness, and conversational naturalness. SME Careers is a fast-growing AI Data Services company and a subsidiary of SuperAnnotate, providing AI training data for many of the world’s largest AI companies and foundation-model AI labs. Your work directly helps improve cutting-edge speech and conversational AI systems through rigorous testing and clear, high-quality feedback.
Key Responsibilities:
• Conduct Speech-Based Scenario Conversations: Speak with the AI model in guided real-world use cases (e.g., shopping, customer support, making appointments), maintaining a natural conversation...