nineDots.ioAbout this role
AI Research Engineer – Frontier Models & Benchmarking
Dublin | 5 Days Onsite
We’re working with a well-funded AI company building training and evaluation environments for some of the world’s leading AI labs.
They’re growing a small research team in Dublin and are looking for people who are genuinely deep into frontier AI models.
This is a deliberately specialised role.
If your LLM experience is mainly building RAG applications, chatbots, agent orchestration or integrating models into existing products, this probably isn’t the right role for you.
They’re looking for people who study the models themselves.
You’ll be working on problems like:
Designing and building benchmarks for frontier LLMsComparing how different models perform and behaveBuilding difficult tasks and datasets to expose model strengths and weaknessesAdversarially testing models and finding where they breakDesigning rigorous evaluation methodologiesWorking with synthetic training and evaluation dataInvestigating model reasoning, reliability and unexpected behaviourWorking on post-training and reinforcement learningRunning experiments across multiple frontier modelsThe people we particularly want to hear from have experience in one or more of:
Building or contributing to recognised/public LLM benchmarksLLM benchmarking or model capability evaluationAdversarial LLM testing or red teamingAI safety / model safety researchLLM post-training or reinforcement learningSynthetic data generation for model training/evaluationDesigning evaluation frameworks, metrics or model judgesResearch into LLM behaviour and failure modesWorking deeply across multiple models such as Claude, GPT, Gemini, Llama or DeepSeekStrong research credentials are highly valued. That could mean a PhD in a relevant area, significant research experience, publications at conferences such as NeurIPS, ICML or ICLR, or demonstrably strong work building benchmarks and evaluation systems.
Most importantly, we’re looking for people who have actually done this work, rather than simply used the terminology.
If your experience is predominantly:
RAGLangChainVector databasesPrompt engineeringBuilding chatbotsAgent orchestrationCalling LLM APIsAdding GenAI features to existing products...without deeper model evaluation, benchmarking or research experience, this role is unlikely to be a fit.
This is also 5 days per week onsite in Dublin city centre. It’s a small, ambitious team that moves quickly and works hard, so it’ll suit someone who actively wants that kind of start-up environment rather than a traditional 9-to-5.
If you’re the sort of person who sees a new frontier model released and immediately wants to test it, break it, compare it and understand why it behaves differently from the others, we’d like to hear from you.
Company:
nineDots.io
Level of experience (years):
Senior (5+ years of experience)
How to apply:
Please mention NLP People as a source when applying