Senior Software Engineer - AI Interaction Evaluator (up to $200/hr)

About the role

We are seeking a senior‑level software engineer to evaluate the quality of interactions with modern AI coding agents such as OpenAI Codex and Claude Code. This contract position focuses on judging whether the model’s responses reflect the reasoning and judgment of a strong engineer, rather than writing production code.

Key responsibilities

• Assess AI‑generated coding interactions end‑to‑end for usefulness, correctness, and alignment with expert engineering thinking.
• Judge the quality of explanations, reasoning, and preambles, not just the final code output.
• Distinguish between different levels of response quality and provide clear, opinionated feedback.
• Help define standards for what great AI‑assisted coding interactions look like.

Required profile

• Staff‑ or principal‑level engineer (or equivalent experience) with a strong engineering taste.
• Comfortable making subjective but rigorous judgments about code quality and developer experience.
• Experience mentoring senior engineers or defining engineering standards is a plus.

Required skills

• TypeScript
• JavaScript
• Python
• Hands‑on experience with OpenAI Codex
• Hands‑on experience with Claude Code
• Familiarity with the Cursor AI‑first IDE or similar tools

What we offer

• Hourly compensation up to $200 (US/Canada), $150 (EU/Latam), $100 (other regions).
• Flexible workload of 10–20 hours per week.
• Remote work with a short start‑up timeline (ASAP through early May, possible extension).