Senior Software Engineer - AI Interaction Evaluator (up to $200/hr)

About the role

We are seeking a senior‑level software engineer to evaluate the quality of interactions with modern AI coding agents such as OpenAI Codex and Claude Code. This contract position focuses on assessing whether the model’s responses reflect the judgment of a strong engineer, rather than writing production code.

Key responsibilities

• Evaluate end‑to‑end AI‑generated coding interactions.
• Judge whether outputs are useful, high‑level correct, and aligned with strong engineering thinking.
• Assess the quality of explanations, reasoning, and overall interaction feel.
• Distinguish between different levels of response quality and provide clear, opinionated feedback.
• Help define standards for great interactions with AI‑first tools like Cursor.

Required profile

• Staff or principal‑level engineer (or equivalent experience).
• Strong background in TypeScript/JavaScript or Python.
• Hands‑on experience with OpenAI Codex, Claude Code, and AI‑first IDEs such as Cursor.
• Deep familiarity with modern AI‑assisted development workflows.
• Ability to evaluate code without fully executing every line.
• Comfortable giving direct, opinionated feedback and maintaining a high bar for engineering quality.

Required skills

• TypeScript
• JavaScript
• Python
• OpenAI Codex
• Claude Code
• Cursor IDE

What we offer

• Hourly rate up to $200 (US/Canada), $150 (EU/Latam), $100 (other locations).
• 10–20 hours per week, contract through early May with possible extension.
• Remote work arrangement.
• Take‑home evaluation exercise and one behavioral interview.