ISO/IEC 42001: the operations manual for the AI system — how the AIMS fits over the on-premise LLM platform described in this blog
Contents
This post closes an asymmetry the blog had been accumulating: we have described in detail the technical platform (seven stack layers, seven deployment phases, five maturity levels), the operational pipeline (six LLMOps stages), the data pieces (corpus curation, versioning), the eval / safety pieces (evals, guardrails, LLM Guard) and the observe pieces (OTel GenAI tracing). What had not appeared is the governance layer a regulated client asks for on top of all that. ISO/IEC 42001 is that layer.
TL;DR
ISO/IEC 42001:2023 is the first certifiable international standard that defines how an AI system is managed. It is not a technical standard (it does not say “use this inference engine” or “this safety threshold”): it is a management standard, a cousin of ISO 27001 and ISO 9001. From both it inherits the Annex SL structure, seven mandatory clauses running through context, leadership, planning, support, operation, performance evaluation and improvement, and it adds an Annex A with 38 AI-specific controls in 9 sections: policies, internal organisation, resources, impact assessment, lifecycle, data, information to interested parties, use, third parties. The thesis of this post is that the technical architecture described in this blog directly covers between 60% and 80% of the A controls with no extra work. The LLMOps pipeline materialises A.6, versioning and curation materialise A.7, guardrails and evals materialise A.9, OTel tracing materialises A.8. The rest is governance discipline that does not appear in the code (a written AI policy, impact assessments per system, a stakeholder register, role decisions between provider/producer/customer, mandatory documentation), and that is precisely what separates a real certification from performative compliance. The post maps the correspondence control by control, cross-references it with the EU AI Act (seven articles directly aligned with 42001: 9, 10, 11, 12, 13, 14, 17), with NIS2 (asset register, incident notification, supply chain) and with ENS (Esquema Nacional de Seguridad, Spain’s national security framework, RD 311/2022, Basic/Medium/High categories), lists the seven mandatory minimum documents an auditor asks for, presents the blog’s multi-tenant chatbot as a live 42001 checklist, and closes with the five usual traps (confusing 42001 with EU AI Act compliance, over-documenting without measuring, ignoring A.5 until the audit, assuming 27001 covers the AI part, thinking certification is a one-off project rather than a living system).
The analogy: the aircraft operations manual
A modern aircraft, an A350, a Boeing 787, a drone certified for urban delivery, does not fly because it has good engines. It flies because the organisation that operates it has an Operations Manual approved by the aviation authority (EASA in Europe, the FAA in the US, AESA in Spain as a delegated body). The manual does not contain the engine blueprints, which the manufacturer certifies; it contains the procedures: who is captain on each flight, which checklist is run before each take-off, which periodic inspections happen at 100, 500 and 2,000 flight hours, which external suppliers are authorised to touch which components, what is documented after each incident, what to do when a new alert appears on the panel. The authority does not sit in on every flight: it reads the manual, randomly audits the traceability of past flights against the manual, and if everything adds up, it keeps the certification in place.
An AI system in production, the multi-tenant chatbot from the forensic post, a copilot for lawyers, a credit scoring system, is exactly the same. It flies because the model is good, the LLMOps pipeline is well built, the guardrails catch the bad cases. But it certifies because the organisation operating it has an AIMS (AI Management System) described in an auditable manual. ISO/IEC 42001 is that manual: its mandatory table of contents (Annex SL, seven clauses) and its catalogue of AI-specific controls (Annex A, 38 controls). The auditor does not sit next to the MLOps engineer: they read the AI policy, review the impact assessments of the most recently deployed systems, check that incident retrain is documented, verify third-party contracts, audit a sample of Langfuse traces cross-checked against dataset_hash and prompt_id. And if everything adds up, they certify.
The analogy matters because it frames the right question: 42001 does not certify the model or the code. It certifies the way of operating the complete system. A team can have the best OSS stack in the world and fail the audit because it has no written AI policy and no documented decision about which role (provider vs producer vs customer) it occupies towards its clients. And the reverse: a team with a modest model but with operations-manual discipline can certify without acrobatics.
ISO/IEC 42001 in 15 seconds
- Publication: December 2023, ISO/IEC JTC 1/SC 42 (the ISO/IEC subcommittee for AI).
- Status in 2026: an active standard, certifiable by accredited bodies (BSI, AENOR, TÜV, Bureau Veritas, A-LIGN, Schellman). Not yet formally recognised as a harmonised standard under the EU AI Act, but it provides the management base to lean on.
- Compatibility: it shares the Annex SL structure with ISO 9001 (quality), 27001 (information security), 27701 (privacy), 22301 (continuity), 20000-1 (IT services). Organisations with integrated management systems (IMS) add it with 20-40% of the effort it would take to implement from scratch.
- Applicability: any organisation that develops, provides, deploys or uses AI systems. It is not limited to developers: a company that consumes a hosted LLM and integrates it into its own product is within scope.
- Certification: a 3-year cycle with an initial audit (Stage 1: documentation review + Stage 2: on-site audit) and annual surveillance audits. Typical cost: 15,000-60,000 € for the initial one depending on size; 6,000-20,000 € per annual surveillance.
What 42001 does not do:
- It does not say which models to use or which thresholds to apply.
- It does not certify the individual model (that is done by specific evaluations such as a NIST AI RMF profile or EU AI Act technical documentation).
- It does not replace the EU AI Act or the GDPR: it is complementary. Implementing it well makes legal compliance easier but does not guarantee it.
- It is not a technical standard for explainability or robustness (those are ISO/IEC 25059, 24029, 23894 and others in the SC 42 family).
Distinction from neighbouring frameworks
| Framework | Nature | Scope | Certifiable | Overlap with 42001 |
|---|---|---|---|---|
| ISO/IEC 42001:2023 | Management standard | AIMS for any AI system | Yes | — |
| EU AI Act (Reg. 2024/1689) | Binding legal regulation | AI systems in the EU, risk-categorised | No (it is law) | Arts 9, 10, 11, 12, 13, 14, 17 |
| NIS2 (Dir. 2022/2555) | Cybersecurity directive | Essential/important entities | Via the national scheme | Asset register, incident, supply chain |
| ENS (RD 311/2022) | Spanish security regulation | Public sector and its suppliers | Yes (B/M/A categories) | Traceability, incident management |
| ISO/IEC 27001 | Management standard | Information security | Yes | Annex SL structure + Annex A overlap |
| ISO/IEC 27701 | Management standard | Privacy (extends 27001) | Yes | PII in training data |
| NIST AI RMF 1.0 | Voluntary framework | AI risk management | No | Conceptually aligned, not identical |
| ISO/IEC 23894 | Technical standard | AI risk management | No | Input to A.5 (impact assessment) |
| ISO/IEC 5259 | Family | Data quality for AI | No | Input to A.7 (data) |
Three distinctions that matter operationally and are a recurring source of confusion with clients:
- ISO 42001 ≠ EU AI Act compliance. Holding the 42001 certification makes it easier to demonstrate articles 9-17 of the European Regulation, but the Regulation requires things 42001 does not cover directly (CE marking of high-risk systems, registration in the European database, declaration of conformity, specific post-market monitoring). Implementing 42001 first and then filling the AI Act gaps is the standard route.
- ISO 27001 is not enough. 27001 covers confidentiality, integrity and availability of information. The AI side is missing: bias, opacity, model drift, training corpus quality, human evaluation, impact on affected persons. 42001 is a complement, not a substitute. Organisations that already have 27001 in place have an advantage because they share half the documentation.
- NIS2 ≠ AI safety. NIS2 requires registering critical assets, notifying incidents within 24 h, and managing the digital supply chain. AI systems can be within NIS2 scope if they form part of the critical asset (an LLM serving customer support in a financial entity is), but NIS2 does not audit model quality. 42001 does.
The seven clauses (Annex SL): the mandatory table of contents
The seven clauses, from clause 4 to clause 10, are common to all modern management standards (Annex SL, also called the “High Level Structure”). That means an organisation with ISO 9001 or 27001 already in place recognises the structure. Clauses 1-3 are introductory (scope, normative references, terms).
Clause 4 — Context of the organisation
Identify the external context (applicable regulation, customer expectations, social risks) and the internal context (strategy, culture, capabilities). Identify the interested parties and their expectations: customers, regulators, affected persons, employees, suppliers. Define the scope of the AIMS: which AI systems are in and which are out.
The usual gap: organisations that say “all our AI systems are in scope” without having enumerated them. The auditor asks for the list. Without a list, there is no scope.
Clause 5 — Leadership
Top management must approve and publish an AI policy, assign roles and responsibilities (typically AI lead, AI risk owner, data officer), and demonstrate commitment through resources, communication and oversight. The policy is an auditable document and must be made available to staff and interested parties.
The usual gap: a generic AI policy copied off the internet, with no measurables and no concrete objectives. The auditor asks how compliance with it is measured. Without metrics, the policy is theatre.
Clause 6 — Planning
Identify risks and opportunities of the AIMS (not of the individual model). Define measurable AI objectives, with deadlines and owners. Plan changes to the AIMS.
The usual gap: confusing AIMS risks (what happens if we do not document correctly?) with model risks (what happens if the model is biased?). The first belongs here; the second goes to A.5.
Clause 7 — Support
Resources: human, technical, financial, infrastructure. Competence of personnel (documented training). Awareness of the policy among personnel. Internal and external communication. Documented information (the backbone of the management system: policy, procedures, records, evidence).
The usual gap: documentation scattered across Confluence/Notion/Drive with no version control and no recorded approvals. The auditor asks about the last change: who approved it? when? on what grounds?
Clause 8 — Operation
The most operational clause. It requires:
- Operational planning and control: how the AI system’s lifecycle is managed day to day. → Covered in the blog by the six-stage LLMOps pipeline.
- Impact assessment (linked to A.5).
- AI system lifecycle management (linked to A.6).
- Data for AI systems (linked to A.7).
This is the clause that materialises in controls A.5, A.6 and A.7. On its own it adds no new requirements: it links to Annex A.
Clause 9 — Performance evaluation
Monitoring, measurement, analysis, evaluation. Internal audits (planned, with criteria, scope, frequency, recorded results). Management review (typically quarterly or half-yearly, with a mandatory agenda: inputs, evidence, decisions, actions).
The usual gap: there is OTel tracing + Langfuse + Grafana and plenty of data, but there is no formal management review agenda with documented minutes. The auditor asks for the minutes. Without minutes, there is no review.
Clause 10 — Improvement
Nonconformity and corrective action: when something fails, it is recorded, root cause is analysed, a correction is agreed, effectiveness is verified. Continual improvement: the system evolves deliberately.
The usual gap: Jira tickets with technical post-mortems but no formal “ISO nonconformity” record closed out with an effectiveness check. They are two distinct artefacts, even if they can be integrated.
The 38 Annex A controls: the AI-specific catalogue
Unlike Annex SL (which is common), Annex A is 42001’s AI-specific signature. The 38 controls are organised into 9 sections (A.2 to A.10; A.1 is the introduction) covering the AI-specific risks: opacity, bias, drift, corpus quality, impact on affected persons, third-party dependency. Each control has an objective (what it aims to achieve) and implementation guidance in Annex B.
| Section | Focus | # controls |
|---|---|---|
| A.2 | AI-related policies | 2 |
| A.3 | Internal organisation | 3 |
| A.4 | Resources for AI systems | 6 |
| A.5 | Impact assessment | 5 |
| A.6 | AI system lifecycle | 4 |
| A.7 | Data for AI systems | 5 |
| A.8 | Information for interested parties | 4 |
| A.9 | Use of AI systems | 3 |
| A.10 | Third parties and customer relationships | 4 |
| Total | — | 38 |
What follows is the section-by-section mapping of the controls onto material we have already covered in the blog. The editorial intent is to show which gaps remain once the technical architecture is in place, so that the road to certification does not start from zero.
Cross-mapping: 38 controls ↔ blog posts
A.2 — AI policies (2 controls): PARTIAL
- A.2.2 AI policy: the organisation must have a documented AI policy, approved by management, reviewed periodically, communicated and available. It covers principles, scope and commitments.
- A.2.3 Alignment with other policies: the AI policy is not an orphan, it aligns with existing security, privacy, quality and ethics policies.
Gap: this is not a code matter. The AI policy is a document that the organisation’s management approves and signs. The blog teaches a neutral, technical editorial stance (no hype, sovereignty, OSS by default under ENS/NIS2), but that is not any specific organisation’s AI policy. Each client has to draft and sign their own.
Minimum template: 1-2 pages with: principles (transparency, human oversight, fairness, accountability, sustainability), scope (which systems), measurable commitments (annual review, impact assessment before deployment, team training), governance (who approves what).
A.3 — Internal organisation (3 controls): GAP
- A.3.2 AI roles and responsibilities: roles defined, non-overlapping, communicated. Typically: AI lead, AI risk owner, data steward, AI ethics officer (which may be a single person in small organisations).
- A.3.3 Reporting of AI incidents/concerns: a channel for anyone (internal or external) to report a problem with an AI system, with documented follow-up.
- A.3.4 Identification of stakeholders: a maintained list of stakeholders (customers, affected persons, regulators, partners) and their expectations.
Gap: also not technical. An organisational decision. The usual way to cover it is to appoint an AI lead (which may be the CIO, the CTO or a new role depending on size), reuse the security reporting channel (typically already in place because of 27001) by extending it to AI, and maintain a live stakeholder register.
A.4 — Resources (6 controls): COVERED
- A.4.2 Documented information: documentation of the AIMS.
- A.4.3 Data resources: identification and management of the data available for training, evaluation and operation.
- A.4.4 Tooling resources: development, validation and monitoring tools.
- A.4.5 System resources: hardware, infrastructure, compute.
- A.4.6 Human resources: competent personnel.
- A.4.7 Financial resources: budget.
Covered by the blog in the three architectural posts:
- Anatomy of the stack: seven layers: A.4.5 system resources, A.4.4 tooling.
- Seven deployment phases: A.4.5 + A.4.7 (budget implicitly).
- Five maturity levels: A.4.5 + A.4.6 (team maturity).
- OSS tooling catalogue: A.4.4 tooling.
- Data versioning with DVC and lakeFS: A.4.3 data resources.
A.5 — Impact assessment (5 controls): PARTIAL
- A.5.2 AI impact assessment process: a documented impact assessment procedure.
- A.5.3 Documentation of AI impact assessments: records of the assessments carried out.
- A.5.4 Alignment with AI risk treatment: the impact assessment’s decisions feed risk treatment.
- A.5.5 Impacts on individuals: specific dimensions covering affected persons (rights, discrimination, privacy).
- A.5.6 Societal impacts: dimensions covering society (information, social rights).
Partial: the method exists in the ISO/IEC SC 42 family. ISO/IEC 23894:2023 is the technical standard for AI risk management and NIST AI RMF 1.0 is the freely usable American equivalent. But the organisation has to write its procedure and run it per system before deployment. It is not code, it is discipline.
Minimum template for the impact assessment (3-5 pages per system):
- Description of the system (what it does, who it serves, underlying model and stack).
- Stakeholders identified.
- Potential impacts (intended and unintended) on people, groups and society.
- Fairness and robustness metrics applied, with thresholds and results.
- Mitigations applied (guardrails, evals, human oversight, rate limiting).
- Accepted residual risks, with signed justification.
- Review cadence (typically annual, or on substantial change).
A.6 — AI system lifecycle (4 controls): COVERED
- A.6.2.2 Objectives for responsible development of AI: responsible development objectives defined per system.
- A.6.2.3 Processes for responsible AI design and development: design and development procedures.
- A.6.2.4 AI system requirements and specifications: formal specification of the system.
- A.6.2.5 Verification and validation: V&V before and during operation.
- A.6.2.6 Deployment: deployment procedures.
- A.6.2.7 Operation and monitoring: continuous operation and monitoring.
- A.6.2.8 Documentation: lifecycle documentation.
Covered by the blog:
- The six-stage LLMOps pipeline: the complete master map of the lifecycle.
- Anatomy of an LLM request: the forensic version of how it runs in production.
- Continuous fine-tuning in production: the A.6.2.3 + A.6.2.5 + A.6.2.6 + A.6.2.7 discipline in real operation.
- Evals: the layer after tracing: A.6.2.5 verification and validation.
- Retrain: A.6.2.7 operation + continuous iteration.
- Modern alignment: DPO, KTO, ORPO, SimPO: A.6.2.3 responsible design.
- MLOps landscape 2026: the tooling landscape.
A.7 — Data for AI systems (5 controls): COVERED
- A.7.2 Data for development and enhancement of AI: data management policy and procedures for development and improvement.
- A.7.3 Acquisition of data: acquisition procedures (origin, authorisation, quality).
- A.7.4 Quality of data for AI systems: measurable quality criteria.
- A.7.5 Data provenance: data lineage.
- A.7.6 Data preparation: preparation procedures (chunking, anonymisation, labelling).
Covered by the blog:
- RAG corpus curation: the active librarian: A.7.4 + A.7.5 + A.7.6 in detail (five layers: schema, dedup, PII, anti-contamination, lineage).
- Data versioning: DVC and lakeFS: A.7.2 + A.7.5 (the four data artefacts versioned with lineage).
- Reranker and hybrid retrieval: A.7.6 preparation + filtering.
- LLM Guard: A.7.6 runtime anonymisation with Vault.
A.8 — Information for interested parties (4 controls): COVERED
- A.8.2 System documentation and information for users: technical documentation available.
- A.8.3 External reporting: the capacity to report to authorities where applicable.
- A.8.4 Communication of incidents to users: notification to users when there is an incident.
- A.8.5 Information for interested parties: information for other stakeholders.
Covered by the blog:
- LLM tracing with OpenTelemetry GenAI: A.8.2 per-request traceability, A.8.3 the capacity to extract forensic reporting.
- Prompt versioning with Langfuse and MLflow: A.8.2 documented versioning.
- Guardrails and safety in LLMs: A.8.4,
gen_ai.guardrail.*spans as the basis for incident notification. - LLM Guard: A.8.4 incident events for retrain.
A.9 — Use of AI systems (3 controls): COVERED
- A.9.2 Processes for responsible use of AI: responsible use procedures.
- A.9.3 Objectives for responsible use of AI: objectives.
- A.9.4 Intended use of AI systems: documentation of the intended use.
Covered by the blog:
- Guardrails and safety in LLMs: A.9.2 + A.9.3 (the four lines of defence).
- LLM Guard: A.9.2 operational detail.
- Evals: the layer after tracing: A.9.3 measurement of objectives.
- Retrain: A.9.2 closed loop.
A.10 — Third parties and customer relationships (4 controls): COVERED
- A.10.2 Allocation of responsibilities: distribution of responsibilities between AI roles.
- A.10.3 Suppliers: procedures for AI suppliers.
- A.10.4 Customers: procedures towards customers.
- A.10.5 Third parties: procedures for third parties.
Covered by the blog:
- The parallel catalogue: OSS vs hyperscalers: A.10.3 supplier assessment with lock-in and contractual sovereignty analysis.
- The OSS catalogue for LLMOps: A.10.5 third-party inventory (OSS components with licences and governance).
- Anatomy of an LLM request: A.10.2 + A.10.4 in the multi-tenant case.
The roles defined by the standard
ISO/IEC 22989:2022 (AI vocabulary, complementary to 42001) defines six roles. Each organisation has to decide which ones it occupies and document it:
| Role | Definition | Main responsibility | Example |
|---|---|---|---|
| AI provider | Organisation that provides the AI system to others | Makes the system available | OpenAI provides GPT-5 via API |
| AI producer | Organisation that develops the AI system | Design, development, validation | Meta produces Llama 4 |
| AI customer | Organisation that acquires the AI system | Selection, integration, oversight | A consultancy integrating an LLM into its own product |
| AI partner | Organisation collaborating with another AI role | Shared | A GPU hardware manufacturer |
| AI subject | Person or group affected by the system | Recipient of the impact | The chatbot’s end user |
| Relevant authority | Regulator with jurisdiction | External oversight | AEPD, CNMC, EU AI Act authorities |
An organisation can occupy several roles at once, which changes the applicable controls. A common pattern in consultancy is: producer + customer + provider towards the end client. The A.10 responsibilities are modulated by the roles.
Example role mapping for the multi-tenant chatbot from the forensic post:
- Base model manufacturer (Llama 4): AI producer of the base model.
- OSS stack operator (the consultancy): AI producer of the LoRA adapter + AI provider of the chatbot to its clients + AI customer of Meta’s base model.
- End client (the insurer): AI customer of the chatbot + AI provider of the customer support service.
- The policyholder: AI subject.
- AEPD + EU AI Act authority: relevant authority.
Each box in the table generates different obligations. The consultancy, being producer of the adapter, must document A.6 (lifecycle) and A.7 (data) for the adapter. Being provider of the chatbot, it must document A.10.4 (customers). Being customer of the base model, it must document A.10.3 (suppliers) and validate that Meta does its part.
Impact levels and proportionality
42001 does not demand the same rigour of every system. Clause 6.1.2 and control A.5 introduce impact as a modulator. The standard does not define strict categories (unlike the EU AI Act, which does define “prohibited / high risk / limited risk / minimal”), but it recommends using levels according to severity and probability.
Industry practice in 2026 aligns the 42001 levels with the EU AI Act categories:
| 42001 level | EU AI Act | Examples | Control depth |
|---|---|---|---|
| High | High risk (Annex III) | Credit scoring, HR, health, critical infrastructure | Exhaustive impact assessment, mandatory human oversight, continuous monitoring, adversarial evals, detailed logging, half-yearly management review |
| Medium | Limited risk | Customer service chatbots that do not automate decisions, productivity assistants | Standard impact assessment, complete guardrails, annual review |
| Low | Minimal risk | Spam filters, non-personalised content recommendations | Lightweight impact assessment, basic controls |
This proportionality is operationally key: implementing 42001 at maximum rigour for a low-risk system is waste; relaxing it on a high-risk one is non-compliance.
The seven minimum AIMS documents
An auditor at Stage 1 (documentation review) asks for between seven and ten documents. The seven essentials:
- AI policy (clause 5.2 + A.2.2). 1-2 pages. Approved by management, dated, versioned.
- AIMS scope (clause 4.3). List of AI systems in scope, inclusion criteria.
- Stakeholder register (clause 4.2 + A.3.4). A maintained list with expectations.
- AIMS risk register (clause 6.1). Risks of the management system, not of each model.
- Impact assessment procedure (A.5.2) + records of assessments carried out (A.5.3). The procedure plus one or more assessments done.
- AI lifecycle procedure (A.6.2), which can literally read “see the six-stage LLMOps pipeline” with references to technical runbooks.
- Data management procedure (A.7.2), covering acquisition, quality, provenance, preparation, anonymisation.
Common additional documents:
- Responsible use policy (A.9.2) with permitted and non-permitted use types.
- AI third-party management procedure (A.10.3, A.10.5) with assessment criteria for AI suppliers.
- Internal audit plan + management review agenda (clauses 9.2 + 9.3).
For an organisation with a mature OSS stack, documents 6 and 7 are references to technical artefacts that already exist (pipeline runbooks, DVC configurations, the PII policy in LLM Guard). The real documentary effort sits in documents 1, 2, 3, 4 and 5.
Applied case: the blog’s multi-tenant chatbot → 42001 checklist
We take the system described in the forensic post, a multi-tenant customer support chatbot for insurers on an on-premise OSS stack, and walk it as a 42001 auditor would.
Clause 4 — Context. The AIMS scope includes the chatbot and excludes the internal HR system (a different AI). Stakeholders identified: client insurers, affected policyholders, the AEPD, the EU AI Act authority (once it enters into force on 2 Aug 2026), the supplier Meta (base model), the hardware supplier NVIDIA. → Documented.
Clause 5 — Leadership. AI policy signed by the CEO, in force. Roles assigned: AI lead (CTO), AI risk owner (CISO), data steward (Head of Data), quarterly AI ethics committee. → Documented.
Clause 6 — Planning. AIMS risk register: incomplete documentation, team churn, dependency on a single GPU supplier, EU AI Act regulatory change. AIMS objectives for 2026: 42001 certification before Q4, EU AI Act high-risk compliance before 2 Aug. → Documented.
Clause 7 — Support. Resources: a 4×H100 SXM cluster + the seven stack layers. Competence: 2 MLE + 2 SRE + 1 part-time AI ethics, all with documented training. Communication: AI policy on the intranet + handbook. → Documented.
Clause 8 — Operation. Operating procedures = the six-stage LLMOps pipeline. Impact assessment run before deployment + annual review + review on substantial change (defined as: base model change, major adapter change, expansion to a new tenant). → Documented.
Clause 9 — Evaluation. Monitoring: Langfuse + Tempo + VictoriaMetrics + Grafana. Mandatory dashboard metrics: F1 per guardrail category over real traffic, statistical drift, RAG faithfulness, refusal rate. Quarterly internal audit with written criteria. Half-yearly management review with signed minutes. → Documented.
Clause 10 — Improvement. Incident-driven retrain tickets mapped as nonconformities when severity ≥ HIGH. Documented root cause analysis. Effectiveness verified at the next eval gate. → Documented.
Annex A — By section:
- A.2 (Policies): AI policy + responsible use policy. → Documented.
- A.3 (Organisation): roles assigned, reporting channel, stakeholder register. → Documented.
- A.4 (Resources): seven deployment phases + OSS catalogue + training plan + annual budget. → Documented.
- A.5 (Impact): procedure + per-system assessments + fairness metrics applied. → Documented.
- A.6 (Lifecycle): LLMOps pipeline + continuous fine-tuning + retrain. → Documented.
- A.7 (Data): data versioning + RAG corpus curation + LLM Guard Vault + Presidio. → Documented.
- A.8 (Information to parties): OTel tracing + Langfuse +
gen_ai.guardrail.*spans + notification to tenants within SLA. → Documented. - A.9 (Use): guardrails + evals + responsible use policy. → Documented.
- A.10 (Third parties): OSS vs hyperscalers with lock-in analysis + Meta contract for the base model + contracts with tenants. → Documented.
Result of the walkthrough: certifiable. The typical gaps (A.2.2 written policy, A.3 roles, A.5 impact assessment procedure) are covered as formal documents. The operational clauses (8, 9, 10) lean on the blog’s technical architecture. The distance between “having the architecture” and “having certification” is measured in documentary discipline, not in code.
Cross-mapping with the EU AI Act, NIS2 and ENS
EU AI Act (Reg. 2024/1689) — seven directly aligned articles
| EU AI Act article | Topic | Aligned 42001 control | Applies to |
|---|---|---|---|
| Art. 9 | Risk management system | A.5 + clause 6 | High-risk systems |
| Art. 10 | Data and data governance | A.7 (all) | High-risk systems |
| Art. 11 | Technical documentation | A.6 + A.4.2 | High-risk systems |
| Art. 12 | Record-keeping (logs) | A.8.2 + OTel tracing | High-risk systems |
| Art. 13 | Transparency to deployers | A.8.5 + A.10.4 | High-risk systems |
| Art. 14 | Human oversight | A.9.2 + documented oversight | High-risk systems |
| Art. 17 | Quality management system | Clauses 4-10 | High-risk providers |
The main obligations for high-risk systems enter into application on 2 August 2026. Implementing 42001 now builds the management base that deadline demands.
What is missing for EU AI Act compliance that 42001 does not cover:
- CE conformity of high-risk systems (declaration of conformity, marking, registration in the EU database).
- The specific post-market monitoring required by Art. 72.
- Serious incident reporting to authorities within legal deadlines (not only to users).
- Transparency obligations towards users for limited-risk systems (Art. 50): chatbots, deepfakes, generated content.
- The Art. 5 prohibitions (social scoring, manipulation, real-time biometrics with exceptions).
NIS2 (Dir. 2022/2555) — three pillars with overlap
- Asset register (Art. 21.2.f): AI systems within NIS2 scope must be in the asset inventory. → Overlaps with A.4 + clause 4.3 (scope).
- Incident notification (Art. 23): significant incidents are notified within 24 h (initial alert) + 72 h (detailed report). → Overlaps with A.3.3 (reporting) + clause 10 (improvement).
- Supply chain security (Art. 21.2.d): security assessment of the digital supply chain. → Overlaps with A.10.3 (suppliers).
For essential NIS2 entities that also use AI systems, 42001 covers the AI-specific part that NIS2 requires by inference but does not spell out.
ENS (RD 311/2022)
The Spanish Esquema Nacional de Seguridad already expressly addresses AI in its Annex II (ENS controls). The Basic/Medium/High categories align with the 42001 impact levels. The ENS controls on traceability (op.exp.8), activity logging (op.exp.10) and incident management (op.exp.7) are covered by the same technical artefacts as A.8 and A.5 of 42001. An organisation certified at ENS High category with AI systems is a reasonable effort away from adding 42001.
The five usual certification traps
Trap 1 — Confusing 42001 with EU AI Act compliance. Passing the 42001 audit does not imply conformity with the European Regulation. They are distinct universes with a 60-70% overlap. The trap surfaces when the client asks for CE marking of the high-risk system and the organisation produces only the 42001 certificate.
Trap 2 — Over-documenting. Two-hundred-page manuals with procedures copied from templates, with no measurables and no evidence of application. The auditor asks for the last execution of the procedure; with no records, the procedures are ornament. The practical rule: prefer short documents referencing live technical artefacts to long self-contained ones.
Trap 3 — Under-measuring. Defining AIMS objectives with no operational metrics. “Improve model quality” is a null objective; “F1 per guardrail category ≥ 0.85 over real traffic, measured weekly, reviewed quarterly in the management review” is an auditable objective. The blog has insisted on this in every post on evals, guardrails and retrain.
Trap 4 — Ignoring A.5 until audit day. The impact assessment is the most underrated control and the first one the auditor asks for. Without per-system assessments carried out before deployment, there is no way to demonstrate A.5. The trap surfaces when there is no longer time to produce credible retrospective assessments.
Trap 5 — Assuming 27001 covers the AI part. Organisations that already have 27001 sometimes think “we have half of it done”. That is true for Annex SL (structure) and for A.5/A.6/A.7 of 27001 (not of 42001) as far as infosec goes. It is false for A.5 of 42001 (impact assessment), A.7 of 42001 (AI-specific data quality), A.9 (responsible use) and A.10.4 (AI customers). You have to add, not assume.
What we have not covered (upcoming posts)
- Concrete templates of the seven mandatory documents, with drafting examples and metrics. Material for a post along the lines of “The AIMS manual in 7 documents” with a reference frame.
- Detailed article-by-article mapping to the EU AI Act with the checklist of technical evidence derivable from the blog’s OSS stack. Especially Arts 11 (technical documentation), 14 (human oversight) and 72 (post-market monitoring).
- The combined ENS High category + 42001 case: which ENS controls are covered by which AIMS artefacts, avoiding duplication.
- NIST AI RMF 1.0 vs 42001 comparison: many international clients ask for both. How the same artefacts are recycled to satisfy the two frameworks.
- 42001 for LLM agents and MCP: the new dimensions that emerge when the AI system is agentic (excessive agency, tool use, graduated autonomy). The guardrails post introduced line 3 (tool GR); 42001 has open gaps in this terrain and SC 42 is working on addenda.
References
- ISO/IEC 42001:2023 — Information technology — Artificial intelligence — Management system. ISO. https://www.iso.org/standard/81230.html.
- ISO/IEC 22989:2022 — Information technology — Artificial intelligence — Artificial intelligence concepts and terminology. Define los roles AI provider/producer/customer/partner/subject.
- ISO/IEC 23894:2023 — Information technology — Artificial intelligence — Guidance on risk management. Insumo de A.5.
- ISO/IEC 38507:2022 — Governance implications of the use of AI by organizations. Complemento de gobierno.
- ISO/IEC 5259 — Data quality for analytics and machine learning (familia). Insumo de A.7.
- EU AI Act (Regulation 2024/1689) — texto consolidado en EUR-Lex. Entrada en vigor de obligaciones de alto riesgo: 2 ago 2026.
- NIS2 (Directive 2022/2555) — texto consolidado en EUR-Lex.
- ENS — Real Decreto 311/2022 — Esquema Nacional de Seguridad, BOE-A-2022-7191.
- NIST AI RMF 1.0 (2023) — https://www.nist.gov/itl/ai-risk-management-framework.
- EUR-Lex EU AI Act consolidated text — https://eur-lex.europa.eu/eli/reg/2024/1689.
- A-LIGN / BSI / Schellman — blogs sobre experiencia de auditoría 42001 con casos reales 2024-2025.
See also
Hardening and secrets in the sovereign LLM stack: defence in depth — the operational security controls that hold up the AIMS.
The six-stage LLMOps pipeline — the operating procedure that materialises A.6 lifecycle with no extra work.
Anatomy of an LLM request in production — the forensic case walked through as a 42001 checklist in the “applied case” section of this post.
Seven layers of the on-premise LLM inference stack and seven deployment phases — direct material for A.4 resources.
Five maturity levels of the platform — how to justify the proportionality of the controls against the existing maturity level.
Data versioning with DVC and lakeFS and RAG corpus curation — A.7 data covered in detail.
LLM tracing with OpenTelemetry GenAI — A.8 information to interested parties through standardised traceability.
Guardrails and safety in LLMs and LLM Guard — A.9 responsible use.
Evals: the layer after tracing and LLM-as-judge — A.6.2.5 verification and validation.
Retrain: closing the feedback → dataset → adapter loop — clause 10 continual improvement + the incident-driven loop that feeds formal nonconformities.
The parallel catalogue: OSS vs hyperscalers — A.10.3 supplier assessment with a structural analysis of lock-in and contractual sovereignty; a direct input to the AI supplier register.
The OSS catalogue for LLMOps — A.10.5 inventory of OSS third parties with documented licence, governance and maturity.
LLM-specific MLOps in 2026: the landscape — the operational context in which the AIMS runs and is audited.
EU AI Act: the technical dossier, article by article — the sister post on Regulation (EU) 2024/1689; it moves from the management system down to the directly applicable legal obligations, with deadlines, penalties and a control-to-article mapping.
Technical controls: the cross-mapping of ENS × ISO 42001 × EU AI Act — the third post of the governance trilogy; it goes down to the detail of the 25 technical controls common to the three frameworks, with the master table of triple compliance and the labelling of evidence.
Incident response runbooks for LLMs with Keep + Kafka — the operational materialisation of clause 10 (continual improvement) and the WORM trace A.8.2 demands: every incident opens a nonconformity, triggers a postmortem, updates the runbook and is recorded in the Kafka
audit.actionstopic.