Skip to content
New Job?Nejo!

Your personal AI career agent

G2G2i Eng Team

Senior Engineer - AI Evaluator(m/w/x)

Wien
from USD 100 - 200 / hour
Full-time, Part-timeRemoteSenior
AI/ML

Evaluating AI coding interactions and assessing response relevance. Strong engineering judgment and TypeScript/Python background required. Hands-on OpenAI Codex experience a plus.

Requirements

  • Highly experienced software engineer (SR+)
  • Staff/Principal-level engineer or equivalent experience
  • TypeScript/JavaScript background
  • Python background
  • Hands-on experience with OpenAI Codex
  • Hands-on experience with Claude Code
  • Hands-on experience with Cursor
  • Deep familiarity with modern AI-assisted dev workflows
  • Able to evaluate code without full execution
  • Comfortable giving direct, opinionated feedback
  • High bar for good engineering
  • Experience with AI-first IDEs like Cursor
  • Prior exposure to prompt design or evaluation workflows
  • Experience mentoring senior engineers or defining engineering standards
  • Comfortable making subjective but rigorous judgments

Tasks

  • Evaluate AI coding interactions
  • Assess response relevance and usefulness
  • Judge high-level correctness of AI outputs
  • Determine alignment with strong engineering judgment
  • Evaluate quality of explanations and reasoning
  • Distinguish between different response quality levels
  • Provide clear, opinionated feedback
  • Identify what worked and what didn’t
  • Highlight misleading or off-putting elements
  • Define standards for great AI interactions
  • Assess whether interactions build or erode trust
  • Ensure AI guidance is helpful and not just technically correct

Work Experience

  • approx. 4 - 6 years

Education

  • Bachelor's degreeOR
  • Master's degree

Languages

  • EnglishBusiness Fluent

Tools & Technologies

  • TypeScript
  • JavaScript
  • Python
  • OpenAI Codex
  • Claude Code
  • Cursor
Find the original job posting in its most current version here. Nejo automatically captured this job from the website of G2i Eng Team and processed the information on Nejo with the help of AI for you. Despite careful analysis, some information may be incomplete or inaccurate. Please always verify all details in the original posting! Content and copyrights of the original posting belong to the advertising company.

Like this job?

Beta

Your Career Agent finds similar jobs for you every day.


  • Hostaway

    Staff Backend Engineer, AI Platform(m/w/x)

    Full-timeRemoteSenior
    Wien, Berlin
  • Canva

    Machine Learning Engineering Manager - Evaluations(m/w/x)

    Full-timeWith HomeofficeManagement
    Wien
  • Hostaway

    Principal FrontEnd Engineer(m/w/x)

    Full-timeRemoteSenior
    Wien, Berlin
  • Canva

    Senior Machine Learning Engineer - Multimodal Data(m/w/x)

    Full-timeWith HomeofficeSenior
    Wien
  • Avomind

    Senior AI Product Engineer / AI Workflow Architect(m/w/x)

    Full-timeWith HomeofficeSenior
    Wien
View all 100+ similar jobs

Nejo is an AI – results may be incomplete or contain mistakes