Know how your AI can fail before someone else finds out.
The challenge
Many orÂgaÂniÂzaÂtions now have an AI polÂiÂcy and an AI comÂmitÂtee. Far fewer can show that each use case was asÂsessed for risk, that senÂsiÂtive data stays where it beÂlongs, or that someÂone acted when a model's beÂhavÂior changed. AI also opens new ways in. A craftÂed prompt can pull data out of a chatÂbot. An AI agent can end up with more acÂcess than any emÂployÂee. Internal audit teams are being asked to cover all of this with methÂods built for traÂdiÂtionÂal sysÂtems, and audit comÂmitÂtees want anÂswers they can rely on.
How we help
Policies deÂscribe what should hapÂpen. We test what acÂtuÂalÂly does. We asÂsess AI risk use case by use case, reÂview the seÂcuÂriÂty conÂtrols around your AI, and audit whether your govÂerÂnance works in pracÂtice. You can start with any one of the three.
Our risk asÂsessÂments apply your criÂteÂria to how each sysÂtem is reÂalÂly built and used: the data it touchÂes, the deÂciÂsions it inÂfluÂences, the peoÂple it afÂfects, and the venÂdors beÂhind it. We look for the risks speÂcifÂic to AI, inÂcludÂing unÂreÂliÂable or fabÂriÂcatÂed outÂputs, bias, weak exÂplainÂabilÂiÂty, unÂapÂproved "shadÂow AI," and heavy deÂpenÂdence on outÂside model providers.
Our seÂcuÂriÂty reÂviews cover the conÂtrols that proÂtect AI sysÂtems: deÂfensÂes against prompt inÂjecÂtion and data leakÂage, acÂcess to modÂels and trainÂing data, the perÂmisÂsions given to AI agents, logÂging of prompts and outÂputs, and the modÂels, plug-ins, and venÂdors in your AI supÂply chain. We exÂamÂine how those conÂtrols are deÂsigned and whether the evÂiÂdence shows they opÂerÂate.
Our auÂdits run the way an inÂterÂnal audit funcÂtion would, with a risk-based scope, clear criÂteÂria, and conÂcluÂsions tied to evÂiÂdence. We trace a samÂple of use cases from inÂtake to proÂducÂtion and check that each step left a record. We also test human overÂsight, checkÂing whether reÂviewÂers acÂtuÂalÂly chalÂlenge outÂputs or simÂply apÂprove them. Findings are ranked by risk and writÂten so that both the audit comÂmitÂtee and the model owner can act on them. If your inÂterÂnal audit team is buildÂing its own AI covÂerÂage, we can help write the audit proÂgram and train the peoÂple who will run it.
Standards we work with: The NIST AI Risk Management Framework, ISO/IEC 42001, ISO/IEC 23894, the OWASP Top 10 for LLM Applications, MITRE ATLAS, the EU AI Act, ISACA's AI audit guidÂance, and the IIA Global Internal Audit Standards.
This is a conÂtrol asÂsessÂment, not a penÂeÂtraÂtion test or AI red team exÂerÂcise. We evalÂuÂate conÂtrols against statÂed criÂteÂria. We don't cerÂtiÂfy a sysÂtem or guarÂanÂtee how it will beÂhave. We don't audit or asÂsess an AI proÂgram, sysÂtem, or use case we deÂsigned for the same client.
Good fit if your audit comÂmitÂtee wants AI in the audit plan, your seÂcuÂriÂty team has quesÂtions about AI tools it didn't choose, or your AI govÂerÂnance proÂgram has been runÂning for a year and noÂbody has checked whether it works.
Related topics
- AI risk assessment
- AI security assessment
- AI audit
- AI controls testing
- Generative AI audit
- Prompt injection controls
- AI agent access review
- AI audit program