Research Engineer / Research Engineeress

Research Engineer COMPL-AI

100%, Zurich, fixed-term

The Secure, Reliable, and Intelligent Systems (SRI) Lab is a research group in the Department of Computer Science at ETH Zurich. Our current research focus is on reliable, secure, robust, and fair machine learning, large language models, probabilistic and quantum programming, and machine learning for code. Our work has led to six ETH spin-offs, including LatticeFlow AI.

LatticeFlow AI enables organizations to build high-performance, trustworthy AI applications. As a pioneer in AI validation, LatticeFlow has developed COMPL-AI, the industry's first comprehensive EU AI Act mapping in partnership with ETH Zurich and INSAIT, helping AI teams align with regulatory standards.

We are looking for Research Engineers to research and integrate state-of-the-art benchmarks into the codebase, add documentation, and improve the overall usability of the benchmark suite with the greater goal of encouraging adoption and integration within a broader GenAI compliance and evaluation ecosystem.

This Research Engineer role will start with a 4-month contract, with the possibility of extension for an additional year. Join us in building the next generation of trustworthy AI.

Project Background

AI safety and compliance are fundamental to ensuring that artificial intelligence (AI) systems are safe and aligned with societal values. COMPL-AI is the world's first open-source compliance-centered evaluation framework for Generative AI models, allowing companies and users worldwide to understand how their models stack up against the EU AI Act. The open-source framework includes a benchmark suite with 27 state-of-the-art benchmarks and an evaluation engine.

Job Description

As a Research Engineer, your main responsibilities will include:

• Developing, testing, maintaining, and contributing to the GitHub COMPL-AI benchmark suite codebase.
• Integrating relevant public state-of-the-art benchmarks as they become available to increase coverage of the EU AI Act requirements.
• Collaborating with researchers at ETH Zurich and LatticeFlow AI to scope new features and capabilities.
• Working alongside the wider evaluation ecosystem to enhance interoperability and integration with existing tools.
• Staying up-to-date with the latest LLM evaluation research, industry trends, and LLMOps.

Profile

• Preferably holding a BSc/MSc in Computer Science, Engineering, Mathematics, or a related technical/scientific field. A PhD would be beneficial but is not required.
• Experience and proficiency in Python, PyTorch, and the ability to write clean and maintainable code.
• Solid theoretical and practical background in machine learning and computer science.
• Strong communication and collaboration skills.
• Previous experience with LLMOps, LLM evaluation, and LLM testing frameworks (e.g., OpenAI's evals, Stanford's HELM) is a plus.
• Active involvement in contributing to or managing open-source projects is a plus.
• Eligibility to work in Switzerland is required.

If this role and our mission resonate with you, but you're hesitant because you don't meet all the criteria, don't let that hold you back. Apply online using the form below; we'd love to meet you and discuss more!

We Offer

• Be part of a keystone project contributing towards AI Safety and Compliance.
• Freedom to engage with a wider open-source community and the university ecosystem.
• Pursue an intellectually challenging job with a real impact.
• Work with domain experts and leaders in their fields. LatticeFlow is a spin-off from ETH Zurich, one of the world's top 10 universities.

We Value Diversity

In line with our values, ETH Zurich encourages an inclusive culture. We promote equality of opportunity, value diversity, and nurture a working and learning environment in which the rights and dignity of all our staff and students are respected. Visit our Equal Opportunities and Diversity website to find out how we ensure a fair and open environment that allows everyone to grow and flourish.

Curious? So Are We.

We look forward to receiving your online application using the form below. Only applications matching the job profile will be considered.

For further information about SRI Lab and LatticeFlow, please visit our websites. Questions regarding the position should be directed to Dr. Velko Vechev at email: Show e-mail (no applications).

About ETH Zurich

ETH Zurich is one of the world's leading universities specializing in science and technology. We are renowned for our excellent education, cutting-edge fundamental research, and direct transfer of new knowledge into society. Over 30,000 people from more than 120 countries find our university to be a place that promotes independent thinking and an environment that inspires excellence. Located in the heart of Europe, yet forging connections all over the world, we work together to develop solutions for the global challenges of today and tomorrow.