Skip to content
New Job?Nejo!

Your personal AI career agent

G2G2i

Senior Software Engineer - AI Interaction Evaluator(m/w/x)

Wien
from USD 50 - 200 / hour
Part-timeFreelanceRemoteSenior
AI/ML

Evaluating AI coding agents for real-world scenarios and assessing response logic. Highly experienced software engineer with strong TypeScript/JavaScript or Python background required. Work from home, 4-day work week.

Requirements

  • Highly experienced software engineer (SR+)
  • Comfortable making subjective but rigorous judgments
  • Staff / Principal-level engineer or equivalent experience
  • Strong background in TypeScript/JavaScript or Python
  • TypeScript / JavaScript
  • Python
  • Hands-on experience using OpenAI Codex, Claude Code, or Cursor
  • OpenAI Codex
  • Claude Code
  • Cursor
  • Deep familiarity with modern AI-assisted dev workflows
  • Able to evaluate code without full execution
  • Comfortable giving direct, opinionated feedback
  • High bar for good engineering
  • Experience with AI-first IDEs like Cursor
  • Prior exposure to prompt design or evaluation workflows
  • Experience mentoring senior engineers or defining standards

Tasks

  • Evaluate AI coding agents in real-world scenarios
  • Assess whether AI responses make sense
  • Judge the usefulness of AI preambles and reasoning
  • Determine if AI output reflects strong engineering judgment
  • Evaluate if AI interactions feel right to an experienced developer
  • Assess the quality of AI explanations and reasoning
  • Distinguish between different levels of response quality
  • Provide clear, opinionated feedback on what worked and what didn’t
  • Identify what felt off or misleading in AI interactions
  • Help define what great interactions look like with tools like Cursor
  • Answer whether AI responses feel like a strong engineer’s
  • Determine if explanations are helpful, not just technically correct
  • Assess if the AI is guiding users well or just dumping output
  • Evaluate if interactions build or erode trust

Work Experience

  • approx. 4 - 6 years

Education

  • Bachelor's degreeOR
  • Master's degree

Languages

  • EnglishBusiness Fluent

Tools & Technologies

  • TypeScript
  • JavaScript
  • Python
  • OpenAI Codex
  • Claude Code
  • Cursor
Find the original job posting in its most current version here. Nejo automatically captured this job from the website of G2i and processed the information on Nejo with the help of AI for you. Despite careful analysis, some information may be incomplete or inaccurate. Please always verify all details in the original posting! Content and copyrights of the original posting belong to the advertising company.

Like this job?

Beta

Your Career Agent finds similar jobs for you every day.


  • SKAD

    Senior Consultant Automation & AI(m/w/x)

    Full-time/Part-timeWith HomeofficeSenior
    Berlin, Wien, Hamburg, München, Frankfurt am Main, Düsseldorf, Stuttgart, Dresden, Bonn, Mannheim
  • Becton, Dickinson and Company

    Senior Machine Learning Engineer(m/w/x)

    Full-time/Part-timeWith HomeofficeSenior
    Wien
    from 52,136 / year
  • SKAD

    Senior Consultant - AI Governance(m/w/x)

    Full-time/Part-timeWith HomeofficeSenior
    Berlin, Wien, Hamburg, München, Frankfurt am Main, Düsseldorf, Stuttgart, Dresden, Bonn, Mannheim
  • SKAD

    Senior Consultant – Automation & AI in Construction(m/w/x)

    Full-time/Part-timeWith HomeofficeSenior
    Berlin, Wien, Hamburg, München, Frankfurt am Main, Düsseldorf, Stuttgart, Dresden, Bonn, Mannheim
  • SKAD

    Senior Consultant - Automation AI & EU Research(m/w/x)

    Full-time/Part-timeWith HomeofficeSenior
    Berlin, Wien, Hamburg, München, Frankfurt am Main, Düsseldorf, Stuttgart, Dresden, Bonn, Mannheim
View all 100+ similar jobs

Nejo is an AI – results may be incomplete or contain mistakes