Job description
Member of Technical Staff (Software Engineer / Product Engineer)
AI Evaluation & Data Infrastructure Company (Stealth Stage)
London | Full-time, On-site.
Very Competitive + up to 0.5% equity (depending on level).
Omnis Partners is working with an early-stage, stealth AI infrastructure company building the foundational layer that determines how frontier AI systems are evaluated, trusted, and improved in real-world use.
This is not a model-building role. Instead, the focus is on the systems behind model performance, the infrastructure that defines evaluation standards, generates high-quality datasets, and enables rigorous testing in high-stakes domains such as finance, healthcare, and law.
At its core, the company is building the “truth layer” for AI: structured evaluation environments, expert-driven annotation workflows, and tooling that makes it possible to consistently measure and improve model behaviour over time.
⚙ The Opportunity
As a Member of Technical Staff, you’ll take full ownership of the internal platform that powers everything the company does.
You’ll be designing and building the systems that allow small teams of experts and engineers to produce high-quality structured data at scale, including workflow orchestration, annotation tooling, review pipelines, and data validation systems.
This is a hands-on, product-heavy engineering role with real influence from day one. You’ll work directly with founders and domain specialists to translate manual, often messy processes into scalable, reliable software systems.
Expect to operate across the stack and be deeply involved in both technical design and product decisions as the company evolves.
What You’ll Be Doing
• Own and build the end-to-end workflow platform used for data creation and evaluation.
• Design systems for task routing, expert assignment, review cycles, and quality assurance.
• Develop pipelines that integrate LLMs for assisted annotation and automated checking.
• Convert real-world, manual workflows into scalable internal products.
• Collaborate closely with founders and subject-matter experts on product direction.
• Help define engineering standards, architecture, and tooling choices as the team scales.
What They’re Looking For
This is a high-ownership environment where execution matters more than credentials.
They’re looking for engineers who:
• Have a track record of owning and delivering complex systems end-to-end.
• Are comfortable working without fully defined requirements.
• Can operate across frontend, backend, and data systems.
• Are already actively using AI tools in their development workflow.
• Enjoy working close to users and iterating quickly in high-ambiguity environments.
Ideal Background
Candidates often come from:
• Early-stage startups or founding engineering teams.
• Product-focused full-stack roles with strong systems thinking.
• Infrastructure-heavy engineering environments.
• Experience building internal tools, workflow systems, or data platforms.
• Exposure to LLMs, evaluation systems, or AI-assisted products is a strong plus.
Extra information
- Status
- Open
- Education Level
- Secondary School
- Location
- London Area
- Type of Contract
- Full-time jobs
- Published at
- 03-05-2026
- Full UK/EU driving license preferred
- No
- Car Preferred
- No
- Must be eligible to work in the EU
- No
- Cover Letter Required
- No
- Languages
- English
Get similar vacancies sent to your mailbox
Fill in below which area you are searching in for a similar function and don't forget your e-mail address!