Who controls the data: governance and triage

30 min 4 outcomes Quiz + triage exercise

By the end of this module you will be able to:

  • Apply the Data Triage Playbook to classify energy datasets into open, shared, or closed categories
  • Explain the FAIR principles (Findable, Accessible, Interoperable, Reusable) as applied to energy data
  • Assess governance maturity using the 5-level model and identify the maturity gap in GB energy
  • Distinguish the DSI, the Elexon Smart Data Repository and the NESO Data Portal by function and owner

8.1 Data Best Practice Guidance

Ofgem's (DBP) is the overarching framework for data governance in the GB energy sector. The current text is the Data Best Practice Guidance and Supporting Information (2026), which supersedes v3.5 of 30 June 2025; it builds on the earlier versions and sets the principles that licensed energy companies are expected to follow. DBP is not an industry code in the same way as the BSC or SEC, but it is licence-backed for relevant network companies and is assessed through regulatory reporting and price-control processes.

The presumed open principle

The most important principle in the DBP is “”. This means that all energy data should be published openly unless there is a specific reason not to. The burden of proof falls on the organisation holding the data to justify restricting access, not on the party requesting it. This is a deliberate inversion of the traditional default, which was to restrict data unless there was a reason to share it.

The presumed open principle does not mean that all data is published. Three categories of data may legitimately be restricted: personal data (protected by UK GDPR), commercially sensitive data (which could distort markets if disclosed), and security-sensitive data (which could create safety or cyber risks if made public). The Data Triage Playbook provides the structured process for determining which category applies.

The Data Triage Playbook: four steps

The Data Triage Playbook is a decision framework for classifying datasets. It consists of four sequential questions, each of which must be answered before proceeding to the next:

  1. Is it personal data? If the dataset contains information relating to an identified or identifiable natural person (UK GDPR), it cannot be published openly without anonymisation or aggregation that demonstrably prevents re-identification.
  2. Is it commercially sensitive? If publication would give a market participant an unfair advantage or reveal proprietary information (hedging positions, contract prices, forecasting algorithms), it may require restriction. Aggregate market data is generally not commercially sensitive even if it derives from sensitive inputs.
  3. Is it security-sensitive? If the dataset could identify vulnerabilities in critical national infrastructure or enable cyber or physical attacks (e.g., SCADA configurations, substation vulnerability assessments), it requires restriction based on material risk, not theoretical risk.
  4. Default to open. If the dataset passes all three tests - not personal, not commercially sensitive, not security-sensitive - it should be published openly. This includes network capacity data, aggregated demand profiles, and most operational planning data.

Five sensitivity levels

The DBP defines five sensitivity levels that refine the triage outcome:

Level 0, Open. Freely available to anyone without registration or conditions. Published on the organisation's website or a public data portal. Examples: Long-Term Development Statements, aggregated demand data, published network capacity maps.

Level 1, Shared (registered access). Available to anyone who registers and agrees to terms of use. No detailed vetting, but the organisation knows who has accessed the data. Examples: detailed network topology data, substation loading time series, granular weather data.

Level 2, Shared (vetted access). Available to organisations that have been assessed and approved. Access requires a data sharing agreement. Examples: individual meter point data used for network planning (pseudonymised), detailed asset condition data.

Level 3, Restricted. Available only to named individuals within approved organisations, with specific access controls and audit trails. Examples: customer personal data, commercially sensitive contract data.

Level 4, Closed. Not shared outside the holding organisation except under legal compulsion. Examples: active cybersecurity vulnerability data, ongoing investigation data, information subject to legal privilege.

Three exit branches, one default: the GB energy data triage

Restriction is reached only by answering yes to one of the three questions, and every no path runs down to the open band, so the burden falls on whoever wants to withhold a dataset rather than on whoever asks for it.

Personal, commercial, security: three exit branches. Everything else defaults to open. Source: Ofgem Data Best Practice Guidance 2026.

Three exit branches, one default: the GB energy data triage A four-step decision tree drawn vertically. Three question rows ask in turn: is it personal data, is it commercially sensitive, is it security sensitive. A yes answer on any row exits to the right into a brand-red outcome card (personal route, commercial route, security route). A no answer continues downward to the next question. Any dataset that survives all three tests lands in a brand-red default-open band at the bottom, publishing under the Data Best Practice Guidance presumption. Q1 Is it personal data under UK GDPR? If yes, exit right; if no, continue down YES · EXIT Personal route Lawful basis and subject rights YES Q2 Is it commercially sensitive? If yes, exit right; if no, continue down YES · EXIT Commercial route Restricted with audited access YES Q3 Is it security sensitive (CNI risk)? If yes, exit right; if no, continue down YES · EXIT Security route Need-to-know, NCSC OT controls YES NO NO NO DEFAULT OUTCOME Open by default Publish under DBP presumption
Check your understanding

In the Data Triage Playbook, what happens if a dataset passes all three sensitivity tests (not personal, not commercially sensitive, not security-sensitive)?

8.2 FAIR principles and metadata standards

The originated in scientific data management but have been adopted by Ofgem as a standard for energy data governance. FAIR stands for Findable, Accessible, Interoperable, and Reusable. Each principle addresses a different dimension of data usability.

FAIR principles: four publisher tests for GB energy data

A dataset can be online and still fail FAIR: each principle is written as a test a publisher either passes or fails, and no persistent identifier, no open protocol, no shared vocabulary or no clear licence is enough on its own.

F-A-I-R: four principles, four publisher tests. Source: Wilkinson et al. (2016) FAIR Guiding Principles; Ofgem Data Best Practice Supporting Information 2026.

FAIR principles: four publisher tests for GB energy data Two-by-two grid of four cards labelled F, A, I and R. Each card has a brand-red letter block on the left, and on the right the principle word, the requirement, the publisher test and one worked example from energy data. Findable and Interoperable are emphasised because CIM-aligned network data is the strongest interoperability gain for the LTDS programme. F Findable Persistent identifier and rich metadata TEST Can a search find the dataset? EXAMPLE DBP catalogue entry with DOI or stable URL A Accessible Open protocol with authentication when required TEST Can an authorised user retrieve the bytes? EXAMPLE OData or REST endpoint, no proprietary client I Interoperable Shared vocabularies, formal models TEST Does the data carry IEC 61970 or DCAT labels? EXAMPLE CIM-aligned network topology export R Reusable Clear licence and provenance, rich attribution TEST Does the licence permit the consumer's purpose? EXAMPLE OGL licence with method and lineage notes

Findable

Data must be easy to discover. This requires persistent identifiers (every dataset has a unique, stable identifier that does not change over time), rich metadata (descriptions, keywords, dates, ownership, and update frequency), and registration in searchable catalogues. In the energy sector, findability is a major weakness. Many DNOs publish data on their websites, but there is no single catalogue of all published energy data. Finding a specific dataset often requires knowing which organisation holds it and navigating their specific data portal.

Accessible

Data must be retrievable through standardised protocols. This means using common data access methods (HTTPS, APIs, standard download formats), providing clear access conditions (who can access it and what steps are required), and ensuring the access mechanism is reliable and maintained. Accessibility also requires that metadata remains accessible even if the data itself has been removed or restricted.

Interoperable

Data must use shared vocabularies, formats, and standards so it can be combined with other datasets. In the energy sector, is undermined by the code fragmentation described in Module 7. The BSC, REC, SEC, and UNC each define their own data models with different field names, formats, and validation rules for overlapping concepts. The (CIM, covered in Module 13) is the international standard that could solve this, but adoption in GB is still partial.

Reusable

Data must have clear usage licences and provenance information. Users need to know what they are allowed to do with the data (commercial use, redistribution, derivative works), where the data came from (provenance), and how reliable it is (quality metrics). In the energy sector, many datasets are published without clear licences, which creates legal uncertainty for third parties who want to build products and services on top of the data.

Dublin Core metadata

The DBP recommends using Dublin Core as the metadata standard for energy datasets. Dublin Core is a simple, widely adopted standard that defines 15 core metadata elements: Title, Creator, Subject, Description, Publisher, Contributor, Date, Type, Format, Identifier, Source, Language, Relation, Coverage, and Rights. Each published energy dataset should include these elements at minimum, enabling consistent cataloguing and discovery.

DNO publishing decision process

When a DNO decides whether to publish a dataset, the recommended process combines the triage playbook with FAIR assessment. First, the dataset is triaged to determine its sensitivity level. If it can be shared, the DNO applies FAIR principles to determine the best format, metadata requirements, and access mechanism. The dataset is then published through the DNO's data portal with Dublin Core metadata, a clear licence, and a contact point for data users. Quality metrics (completeness, accuracy, timeliness) should be published alongside the data itself.

Common misconception

FAIR means free. If data is FAIR, anyone can access it without restriction.

FAIR is about discoverability and usability, not price or access rights. Data can be FAIR and still require registration, vetting, or payment. The 'Accessible' principle means that access conditions are clear and standardised, not that access is unrestricted. Even Level 3 (restricted) data should have FAIR metadata so that potential users can discover it exists and understand the access process.

8.3 The maturity gap

The five-level maturity model introduced in Module 7 provides a useful lens for assessing governance reality versus aspiration. When Ofgem assessed DNO data governance maturity as part of RIIO-ED2, the results were sobering. Most DNOs self-assessed at Level 2 (Developing) or low Level 3 (Defined). None credibly claimed Level 4 (Managed) across all data domains. Level 5 (Optimising) remains aspirational for the entire sector.

Five maturity rungs and the GB energy data gap

The typical 2024 marker sits one rung below the DBP target and two below LTDS Stage 3, so reaching the FAIR-compliant top rung is not a matter of publishing more datasets: it is the catalogue, the access process and the persistent identifiers that are missing.

Five maturity rungs from accidental collection to FAIR catalogues with API discovery. Source: Ofgem Data Best Practice Guidance 2026; ENA Data and Digitalisation assessments.

Five maturity rungs and the GB energy data gap A vertical ladder of five maturity rungs. The bottom rung is accidental collection with no governance. The next is internal awareness with ad-hoc sharing. The middle is selected open publication. Above that is a catalogue with access process. The top is full FAIR compliance with API discovery. A brand-red marker labels which rung typical organisations occupy in 2024, which rung the DBP target sits on, and which rung LTDS Stage 3 reaches. A rising-maturity axis arrow runs up the left. RISING MATURITY LEVEL 5 FAIR-compliant catalogue with API discovery Persistent IDs, OGL licence, DCAT, API endpoints LTDS STAGE 3 LEVEL 4 Catalogue with metadata and access process Published catalogue, request workflow, refresh cadence DBP TARGET LEVEL 3 Selected datasets published openly Sporadic publication, manual updates, partial metadata TYPICAL · 2024 LEVEL 2 Known internally, shared on request Internal list, ad-hoc sharing, no consumer-facing catalogue LEVEL 1 Accidentally collected, governance absent Data exists in spreadsheets, ownership unclear

The gap between current maturity and the level needed to support the energy transition is significant. Net zero requires data-driven decisions about network investment, flexibility procurement, EV charging infrastructure, and heat pump deployment. These decisions depend on data that is accurate, timely, interoperable, and accessible. A sector operating at Level 2-3 maturity cannot reliably provide this.

Root causes of the maturity gap

Several structural factors explain why maturity is low despite years of regulatory attention. First, data has historically been a byproduct of network operations, not a strategic asset. Network engineers collected data to operate the network, not to publish or share it. The skills, processes, and systems designed for operational use do not translate directly into data governance capabilities.

Second, the regulatory framework has been fragmented. Data obligations are scattered across multiple codes, licence conditions, and guidance documents. No single person or team in most organisations has visibility of all their data obligations, let alone the capability to manage compliance holistically.

Third, investment has been inadequate. RIIO-ED2 included digitalisation funding, but much of it was directed at specific technology projects (monitoring equipment, data platforms) rather than the organisational capabilities (people, processes, governance structures) needed to sustain good data management over time. You can buy a data platform in a year; building a data culture takes a decade.

Fourth, there is no meaningful enforcement mechanism for data governance quality. Ofgem can audit compliance with specific licence conditions, but assessing overall governance maturity is subjective. There is no equivalent of the BSC Performance Assurance Framework for data governance more broadly.

Closing the gap

RIIO-3's inclusion of explicit data quality metrics as regulated outputs is the most promising development. If network companies are assessed and rewarded based on measurable data quality improvements, the incentive structure shifts from compliance to excellence. The Energy Data Taskforce's recommendations also point toward a sector-wide data catalogue and common metadata standards, which would address the findability dimension of FAIR.

But technology and metrics alone will not close the gap. The hardest part is cultural change: convincing network engineers that data is as important as cables, convincing boards that data governance is a strategic capability, and convincing regulators that maturity assessments need teeth. Without all three, the maturity gap will persist even as the technology improves.

Check your understanding

What is the 'presumed open' principle in Ofgem's Data Best Practice Guidance?

8.4 The sharing infrastructure

Sections 8.1 to 8.3 assume a world where each organisation publishes its own data on its own portal and is judged on how well it does so. That world is changing. GB energy is moving from publish-your-own-portal towards shared infrastructure that many parties contribute to and draw from, and control over data is shifting with it.

The (DSI) is the clearest example. Rather than a single database, it is a set of common rules and connective plumbing that lets datasets be discovered and exchanged across organisations under agreed governance. Following Ofgem's governance decision of March 2025, NESO coordinates its delivery to 2028, with early capability piloted inside the programme. There is no fixed public launch date; the governance was settled first, on purpose.

March 2025: the Data Sharing Infrastructure gets an institutional owner

For years a shared data fabric for GB energy sat in taskforce reports with no one owning its delivery. Ofgem's governance decision of March 2025 changed that: it set out who governs the DSI and named NESO as the body coordinating its delivery through to 2028.

The decision deliberately did not fix a public launch date. It settled the governance first, the institution second and the timetable last, which tells you how the regulator reads the risk: a shared piece of national data plumbing fails on trust and accountability long before it fails on technology.

Once data sharing has a named owner and a funded coordinator, the question for a DNO or supplier stops being “what do we publish on our own portal” and becomes “what do we contribute to shared infrastructure, and on whose terms”.

Three GB energy data platforms: legacy backbone, cloud settlement, discovery

Read the governance row across and the three platforms answer to three different regimes. They are not stages of one system; DSI has to discover data that DTS and DIP already hold under codes it does not administer.

Legacy backbone (DTS), cloud event-driven settlement (DIP), discovery layer (DSI). Source: ElectraLink, Elexon DIP, NESO DSI, Ofgem DSI governance decision.

Three GB energy data platforms: legacy backbone, cloud settlement, discovery Three vertical columns labelled DTS (since 1998), DIP (live August 2025) and DSI (in design). DIP is emphasised. Five attribute rows compare status, data handled, protocol, governance and scope. The geometry encodes peer comparison: each platform sits in its own column, every attribute reads across all three. DTS Since 1998 DIP Live August 2025 DSI In design STATUS Live 25+ years STATUS 1bn+ messages STATUS Interim governance DATA HANDLED Change-of-supplier switching DATA HANDLED Half-hourly settlement DATA HANDLED Discovery and catalogue PROTOCOL D-flow file format PROTOCOL Event-driven cloud PROTOCOL Open API (proposed) GOVERNANCE DCUSA · ElectraLink admin GOVERNANCE BSC · Elexon admin GOVERNANCE NESO interim; Ofgem decision SCOPE Industry backbone SCOPE MHHS enabler SCOPE Cross-platform discovery

Three things people confuse: DSI, repository and portal

The DSI is easy to conflate with two other pieces of shared infrastructure that do different jobs and have different owners. Keeping them apart is the point of this section.

The DSI is governance and connective plumbing for organisation-to-organisation data sharing, coordinated by NESO. It does not hold the data itself; it makes distributed datasets findable and exchangeable under common rules.

The Elexon is a specific store, launching in autumn 2026 out of the DESNZ and Ofgem scoping exercise, built to hold smart metering and related data for approved uses. Elexon owns and runs it, and it holds data rather than only pointing to it.

The NESO Data Portal is NESO's own open-data publishing platform: the place NESO puts its system, market and forecasting datasets for anyone to download. It is a publisher of one organisation's data, not a cross-industry sharing layer.

Read together, the three show the direction of travel. A single publisher's portal (the NESO Data Portal) is the old model done well; a shared store (the Smart Data Repository) and a shared exchange fabric (the DSI) are the new model, and both move control away from the individual data holder towards jointly governed infrastructure.

Check your understanding

A DNO wants to make a dataset discoverable and exchangeable with other organisations under common, jointly governed rules, without handing the data to a central store. Which piece of shared infrastructure fits that need?

Core distinctions

  • Ofgem's Data Best Practice Guidance establishes the 'presumed open' principle: energy data should be made available unless there is evidence for reducing availability, such as personal, commercial, legal or security sensitivity. The Data Triage Playbook provides a 4-step classification process.
  • Five sensitivity levels (Level 0 Open through Level 4 Closed) refine the triage outcome. Each level specifies different access conditions, from unrestricted public access to no sharing outside the holding organisation.
  • FAIR principles (Findable, Accessible, Interoperable, Reusable) define data usability standards. FAIR does not mean free - data can be FAIR and still require registration or vetting. Dublin Core provides the recommended 15-element metadata standard.
  • Most GB energy organisations operate at maturity Level 2-3 against the 5-level model. The gap is driven by historical culture (data as byproduct, not asset), regulatory fragmentation, inadequate governance investment, and weak enforcement. RIIO-3 data quality metrics may help, but closing the gap requires cultural change alongside technology.
  • GB energy data is moving from publish-your-own-portal to shared infrastructure. The Data Sharing Infrastructure (DSI), coordinated by NESO to 2028 after Ofgem's March 2025 governance decision, connects distributed datasets under common rules; the Elexon Smart Data Repository (autumn 2026) is a store that holds data; the NESO Data Portal publishes NESO's own datasets. Control is shifting from individual holders to jointly governed infrastructure.

Standards and sources cited in this module

  1. Ofgem, Data Best Practice Guidance and Supporting Information (2026)

    Presumed open principle and Data Triage Playbook

    Source for the triage framework, sensitivity levels, and presumed open principle. Referenced throughout Section 8.1.

  2. GO FAIR Initiative, FAIR Principles

    Findable, Accessible, Interoperable, Reusable definitions

    Original source for the FAIR principles adopted by Ofgem for energy data governance. Referenced in Section 8.2.

  3. Energy Data Taskforce, A Strategy for a Modern Digitalised Energy System (2019)

    Recommendations on data governance, cataloguing, and common digital infrastructure

    Source for the sector-wide data governance recommendations and maturity assessment framework. Referenced in Section 8.3.

  4. Ofgem, Governance of the Data Sharing Infrastructure: Decision (March 2025)

    DSI governance and NESO coordination to 2028

    Source for the Data Sharing Infrastructure governance decision and NESO's coordinating role. Referenced in Section 8.4.

  5. Elexon, Smart Data Repository

    Scope and autumn 2026 launch

    Source for the Elexon Smart Data Repository as a data store launching autumn 2026. Referenced in Section 8.4.

Module 13 of 31 · Energy System Data Applied