Senior Software Engineer - AI Interaction Evaluator (up to $200/hr)

About the role

We are seeking a senior‑level software engineer to evaluate the quality of interactions with modern AI coding agents such as OpenAI Codex and Claude Code. This short‑term contract focuses on assessing how well the model mimics the reasoning of an experienced developer, rather than writing production code.

Key responsibilities

• Review end‑to‑end AI‑generated coding interactions and judge their usefulness, correctness, and alignment with strong engineering judgment.
• Assess the quality of explanations, reasoning, and preambles provided by the model.
• Distinguish between different levels of response quality and assign consistent ratings.
• Provide clear, opinionated feedback on what works, what feels off, and how trust can be built.
• Help define standards for great interactions with AI‑first development tools.

Required profile

• Staff or principal‑level engineer (or equivalent experience) with a high bar for good engineering.
• Strong background in TypeScript/JavaScript or Python.
• Hands‑on experience with OpenAI Codex, Claude Code, and AI‑first IDEs such as Cursor.
• Deep familiarity with modern AI‑assisted development workflows.
• Ability to evaluate code without fully executing every line and to give direct, rigorous feedback.

Required skills

• TypeScript
• JavaScript
• Python
• OpenAI Codex
• Claude Code
• Cursor (AI‑first IDE)

What we offer

• Hourly rates up to $200 for US/Canada, $150 for EU/Latam, $100 for other locations.
• 10–20 hours per week, remote work.
• Engagement through early May with possible extension.