AI Assurance Lead (LLM Evaluation, Fine Tuning and Model Risk)

About IntelanceIntelance is an independent technology, AI and cyber assurance firm based in the UK. We help organisations check, govern and improve their technology through enterprise architecture, AI governance, cyber assurance and data governance work. We are building a small panel of senior associates to deliver technology and AI due diligence on company sales and investments. The roleYou will check how AI systems are built, tested and governed, for clients who are selling, buying or investing in AI companies. You will test whether the AI does what the company claims, whether it is safe to rely on, and whether the data behind it is used lawfully. Our first engagements are with AI workflow platforms in regulated sectors that combine plain code, classic machine learning and fine tuned open source language models. You report to an Intelance engagement partner and work with our technology due diligence lead, who brings your findings into the final report. What you will doMap where AI sits in a product: which steps are plain code, which use machine learning and which use language models. Review how open source models are fine tuned, what data they learn from, and whether client contracts allow that use. Test the evaluation approach: test suites, accuracy measures, human review rules and how failures are caught and fixed. Check controls against prompt injection, data leaking between clients and tampering with models. Check reliance on outside AI providers, and what data, if any,