Energy Security Board

NEM DATA STRATEGY

CONSULTATION PAPER 20 March 2018

1

Dr Kerry Schott AO INDEPENDENT CHAIR

Energy Security Board

Clare Savage INDEPENDENT DEPUTY CHAIR

Energy Security Board

Paula Conboy CHAIR

Australian Energy Regulator

John Pierce AO CHAIRMAN

Australian Energy Market Commission

Audrey Zibelmen CEO & MANAGING DIRECTOR

Australian Energy Market Operator

2

Contents

Executive summary ........................................................................................................ 3

Objective ................................................................................................................. 4

Scope ................................................................................................................. 4

What do we mean by ‘data’? .......................................................................................... 6

A clearly defined objective will focus strategy development ............................................ 6

Targeting key data dimensions for effective strategy delivery ......................................... 7

1. System and market operations ............................................................................ 7

2. Market transparency ............................................................................................ 7

3. Regulation and performance monitoring .............................................................. 8

4. Planning and investment ..................................................................................... 8

5. Research and policy making ................................................................................ 8

Setting expectations by defining scope .......................................................................... 8

Principles governing design and delivery...................................................................... 10

Sharing your views and next steps ............................................................................... 12

Appendix A – Preliminary view of institutional NEM data holdings ................................ 13

AER ............................................................................................................... 13

AEMC ............................................................................................................... 16

AEMO ............................................................................................................... 18

CER ............................................................................................................... 20

ARENA ............................................................................................................... 21

Appendix B – Other energy data initiatives currently in progress .................................. 22

Energy Use Data Model (EUDM) ........................................................................... 22

Australian Renewal Energy Mapping Infrastructure (AREMI)................................. 22

Data Availability and Use ....................................................................................... 22

Consumer Data Right ............................................................................................ 22

Facilitating access to consumer data ..................................................................... 23

Register of distributed energy resources (DER)..................................................... 23

Developments by other institutions ........................................................................ 23

3

Executive summary

The Energy Security Board (ESB) is developing a data strategy for the National Electricity Market (NEM), as recommended in the Independent Review into the Future Security of the National Electricity Market (‘Finkel review’)1.

The Finkel review highlighted the need to enhance the availability of data and information to support the market in adapting to rapidly changing conditions2. Finkel recognised that data will play a crucial in supporting future security, reliability and affordability as the system moves to more variable, decentralised generation and innovation drives new technologies and services. However, the review also identified a wide range of barriers to effectively accessing data, which are already creating challenges and costs across the market.

The ESB is seeking your views on the development of the strategy, which will set in place principles to guide ESB’s strategic thinking on data related issues and support priority setting and planning in relation to data related projects.

Each of the energy market bodies — AEMO, AEMC and AER — and related government agencies — Clean Energy Regulator (CER), Australian Renewable Energy Agency (ARENA), Department of Environment and Energy (DEE) — (herein referred to as the ‘market institutions’) collect and/or publish energy market data in accordance with their roles and functions. Market participants and service providers also collect, manage and share extensive energy market data. Removing barriers to information sharing between the institutions, and barriers to data access, is critical for any initiative to widen access to data in a consolidated and consistent form.

Data, in the context of the strategy, refers to electricity market data collected by the market institutions for legislative, regulatory or operational purposes, or data provided to the market institutions by market participants, consumers or third parties. It includes raw and unaltered data as well as data that is processed, transformed or enriched to create new datasets or give meaning to existing datasets.

The Finkel review also recommended that the data strategy consolidate and enhance existing data platforms to support policy development and decision making informed by a complete view of the market. This includes supporting an ongoing Energy Use Data Model (EUDM)—currently being developed collaboratively by the DEE, CSIRO and AEMO3.—and a mapping platform combining the features of the EUDM, the Australian Renewable Energy Mapping Infrastructure (AREMI) and AEMO’s interactive network planning map to provide a single view of generation, consumption and networks in the NEM.

These platforms provide access to datasets that enable research and innovation, planning and investment decisions and policy making over the medium to long term. While these projects are underway, they will rely on changes to market Rules, governance and data processes to be successful.

There are also a range of reforms underway which seek to improve aspects of operational data availability and will also require reforms to market Rules, governance, roles and data processes. One key area is in facilitating access to consumer energy data. The DEE is co-ordinating a project on behalf of COAG EC to remove the complexities and improve access to, and sharing of, consumer consumption data to enable consumers to have better information to make decisions. In parallel, the Australian Government Treasury is leading the

1 Independent Review into the Future Security of the National Electricity Market: Blueprint for the Future, Commonwealth of

Australia 2017, p184. 2 Independent Review into the Future Security of the National Electricity Market: Blueprint for the Future, Commonwealth of

Australia 2017, p182. 3 The EUDM pilot release is scheduled for 2018

4

development of an economy-wide Consumer Data Right (to give customers a right to direct that their data be shared with others), to apply first to the banking, energy and telecommunications sectors. While specific to the energy sector, the COAG EC process should be consistent with the broader Consumer Data Right. The DEE is currently working with Treasury and stakeholders to develop the model for implementation of the data right in the energy sector4 in consideration of the common objectives of these processes. Further information about these and other initiatives with links to the data strategy are detailed at Appendix B.

While these projects are ongoing, the data strategy should consider the changes to market Rules, governance and data platforms needed to support these reforms and new data platforms at a higher level, in order to capture synergies and apply consistent open data principles going forward.

The Finkel review recommended the data strategy development begin with a gap analysis and development of a catalogue of energy market data that exists, other relevant datasets that may be required and the effectiveness of current data sharing arrangements, including any barriers that need to be addressed.

The ESB consulted in late 2017 with the energy market institutions and engaged The Brattle Group to undertake this gap analysis. This initial consultation aimed to better understand the data inputs, outputs and barriers to sharing and access between the market institutions. Preliminary findings on the data holdings for each institution are included at Appendix A. The data discovery exercise is ongoing and this current round of consultation seeks to identify other data holdings that exist among stakeholders.

Objective

Following this initial consultation with market institutions, and considering the intent of the Finkel review recommendation, the ESB’s overarching objective guiding the design and development of the strategy is to facilitate access to data that supports delivery of the Finkel review’s key outcomes—increased security, future reliability, affordability and lower emissions.

This objective aims to focus the data strategy, to focus strategic thinking and satisfy data needs in five key dimensions: system and market operations, market transparency, regulation and performance monitoring, planning and investment and research and policy making. While data users have varying needs, the roles and functions of the market institutions, as primary data custodians, are centred on these dimensions.

Scope

Clearly defining scope sets expectations for all stakeholders and sets out what the strategy can and cannot deliver. In particular, the data strategy is not intended to facilitate delivery of new data repositories or platforms. Rather, the strategy seeks to set in place clear principles to guide how data is managed in the energy market—to maximise benefits and the long-term interests of consumers) and coordinate the processes necessary for data custodians to collect, create, share and facilitate access to data in a consistent, efficient, effective and inclusive way.

4 Australian Government Treasury, Consumer Data Right – Fact Sheet, viewed 28 February 2018,

https://static.treasury.gov.au/uploads/sites/1/2018/02/180208-CDR-Fact-Sheet-1.pdf.

5

The strategy is forward looking and will be a strategic framework that provides:

• clear principles to guide how data is managed and accessed

• mechanisms and processes to identify:

o what data is required by who and for what purpose

o how the data should be collected and stored and who should collect or provide it

o where the data should be published and with whom it can be shared

• key priorities to guide how and when data projects could be implemented

This initial consultation paper seeks your feedback on the data strategy’s proposed objective and scope, and the principles guiding its development. This consultation also seeks to initiate the data requirements gathering process, and to develop an understanding of the data needs of a range of data users. Once the objective, scope and principles are set, there will be further opportunities for you to have your say as the strategy is developed.

The Energy Security Board invites comments from interested parties in response to this initial consultation paper by 20 April 2018. All submissions will be published on the COAG Energy Council’s website, subject to claims of confidentiality. All submissions should be sent to info@esb.org.au.

Submission close date 20 April 2018

Lodgement details Email to: info@esb.org.au

Naming of submission document [Company name] Response to Data Strategy

Form of submission Clearly indicate any confidentiality claims by noting “Confidential” in document name and in the body of the email

Late submissions We cannot guarantee that late submissions will be reviewed and considered

Publication All submissions will be published on the COAG Energy Council’s website, following a review for claims of confidentiality.

6

What do we mean by ‘data’?

In the context of the strategy, data is a collection of qualitative and quantitative values that represent and/or relate to the operations and performance of the National Electricity Market (NEM) and any interrelated policies, programs and schemes specific to the electricity sector.

This definition incorporates data that is:

- Raw and unaltered

- Processed, transformed or enriched

For example, generation output data transmitted from a power station to the market systems in real-time is raw data. The same data aggregated to derive a daily generation value is processed data, which becomes a new dataset in its own right.

The market institutions collect and publish data in many forms to perform their functions. Data is collected from a range of entities on a regular frequency, on a schedule prescribed by legislation or market rules, or on an ad-hoc basis for regulatory or operational purposes.

Data may also be provided voluntarily which, as access expands and new datasets are created, may become more prevalent.

A clearly defined objective will focus strategy development The ESB, consulted with the market institutions to discuss the intent of the Finkel recommendation and better understand their expectations for developing the strategy. It was evident that the creation of a data strategy presents a unique opportunity to re-evaluate and redefine the data needs of the electricity sector and design a framework enabling those needs to be met. It is also timely as a critical element in supporting the transformation of the energy market. Stakeholders may have varied expectations for the strategy and interpretations of the Finkel review’s intent. For this reason, it is important to articulate the strategy objective to ensure stakeholders understand the direction the ESB is taking in developing the strategy and its rationale for doing so.

The strategy’s key focus is to facilitate access to data that enables and supports delivery of the four key outcomes of the Finkel review – increased security, future reliability, affordability and lower emissions. It also aims for consistency with the National Electricity Objective (NEO) and National Energy Retail Objective (NERO) in placing emphasis on the long-term interests of consumers.

Data is merely an enabler. By facilitating access to data and increasing transparency and appeal, data users will be empowered to make use of data as they see fit to achieve their desired outcomes.

7

The ESB proposes the following objective for the data strategy: To establish a framework that facilitates ongoing identification of, and access to, data

that will support the transition to a secure, reliable, affordable and sustainable energy future, in the long term interests of consumers, by enabling:

- System and market operations

o Secure, reliable and efficient operation of the electricity system including optimisation of distributed systems and market operations in real-time

- Market transparency

o Timely provision of information to support effective decision making and access to services for all market participants, particularly consumers and new types of service providers, and to support effective competition and innovation

- Regulation and performance monitoring

o Efficient and effective market regulation and performance monitoring

- Planning and investment

o Informed planning and investment decision making, using data that is fit for purpose in both the short and longer term

- Research and policy making

o Research, data analytics and monitoring by policy makers and researchers to identify trends and inform better policy;

Targeting key data dimensions for effective strategy delivery

The strategy objective targets five key data dimensions reflecting the functions of the market institutions, as primary data custodians. It also articulates the types of data that the market may need, users are likely to seek, the purposes for which it is sought, and where opportunities for innovation are likely to exist.

1. System and market operations

Secure, reliable and efficient operation of the electricity system including optimisation of distributed systems and market operations in real-time

AEMO, as the market operator, collects system and market data from market participants including generators and network businesses as well as meter data at the consumer level. AEMO makes much of this data available on its website and to market data subscribers via secure systems.

As the market integrates greater volumes of renewable energy and the system becomes more decentralised, the need for data to manage system and market operations will change.

2. Market transparency

Timely provision of information to support effective decision making and access to services for all market participants, particularly consumers and new types of service providers, and to support effective competition and innovation

Consumer access to data and authorised release to third parties is paramount to enabling effective competition and innovation. Understanding energy usage patterns, and the tariffs and services available, allows consumers to select service providers that suit their needs.

8

Data is also required to signal to the market the types of services that are required. Greater market transparency will support innovation and drive development of the lowest cost solutions to meet market needs.

Third parties can use this information to design services that may facilitate more efficient energy usage (for example, demand management and usage monitoring tools), market operations (for example, services to support system security and reliability) or new retail products and services.

3. Regulation and performance monitoring

Efficient and effective market regulation and performance monitoring

Filling data gaps and removing barriers to access and information sharing may improve regulatory outcomes and performance monitoring, as well as guiding market reform and policy development.

4. Planning and investment

Informed planning and investment decision making, using data that is fit for purpose in both the short and longer term

Network performance and the combination of historical, real-time and forecast supply and demand data, assists planning and investment decisions by enabling the identification of potential future energy needs. Greater transparency of data about networks, loads and planned investments, along with better-informed forecasting based on in-depth understanding of the changing market, will support those seeking to invest in the energy sector and promote future security of supply.

5. Research and policy making

Research, data analytics and monitoring by policy makers and researchers to identify trends and inform better policy

Access to detailed data on historical trends enables researchers and policy makers to model and analyse future impacts of changes in the sector. This research and analysis informs policy development, improving forecasting capability and drives further research and innovation.

Questions for stakeholders

1. Do you agree with the proposed objectives of the data strategy?

2. Are there additional dimensions that should be considered based on a data need, market requirement or use case? If so, what types of data would you consider relevant within those additional dimensions?

Setting expectations by defining scope

The strategy will deliver a strategic framework that facilitates identification of ongoing data needs and access to data. Most critically, it will set in place clear principles to drive decisions on how data is managed and data processes reformed. It will accommodate existing data collection and sharing processes and enhance these where appropriate. Roles and responsibilities of the market institutions and other stakeholders will be defined to support these principles and ensure appropriate governance and management of the strategy.

9

The strategy will provide guidance on data standards and appropriate data sharing platforms. It will also define appropriate processes to support ongoing review and development of data platforms and processes over time as needs progress.

In each strategy target area, the data collected, shared and published will need to be determined. The strategy will incorporate a process for identifying new data needs and reviewing and modifying requirements, on an ongoing basis. To identify data gaps, real or perceived, consider the preliminary data catalogue in Appendix A and the data that you currently access and use.

In order to deliver on the objective, the scope for the data strategy includes defining:

- Principles governing the management of data in the energy market, consistent with the objective

o The principles will be overarching and will guide all decisions made in relation to the strategy

- Management framework

o A framework and supporting processes to consistently manage changing needs for data collection, sharing, publication and access, according to principles of open government, while adhering to privacy, confidentiality and security requirements

- Governance

o Define roles and responsibilities for each energy market institution and related Government bodies in relation to the principles and strategy

o Identify data custodians, data flows and process owners

o Consider how privacy and confidentiality obligations protect data where needed, while not restricting appropriate uses which provide market and consumer benefits

o Wherever possible, data management roles, rights and obligations should be more principles based, flexible and non-prescriptive to be fit-for-purpose in a rapidly changing market

- Data requirements

o Identifying and reviewing data requirements will be an ongoing process and central to governance arrangements, in consultation with government, industry, consumers and other relevant stakeholder groups

o Initial requirements and existing gaps will be informed by the defined objectives and gap analysis

- Data standards

o Processes to define and manage data standards over time, including defining data formats and data communication/exchange methods

o Definition of standards must balance the key elements of data interoperability, reliability, accessibility and security against costs and benefits to stakeholders

- Data collection and sharing mechanisms and platforms

o Determine the platforms and supporting processes needed to make data meaningful and shared openly in an accessible, timely fashion

o Identify mechanisms to collect and share data more freely, while maintaining privacy and confidentiality

10

o Review and amend (where appropriate) the suitability of existing mechanisms where known gaps and/or barriers to access exist, to improve transparency (mechanisms include legislative and regulatory instruments)

- Funding framework

o A framework and supporting processes to determine appropriate funding for the ongoing development and operation of energy data platforms, where such platforms are recognised as being valuable and of benefit to a broad range of stakeholders

- Review and modify process

o To measure the strategy’s performance and so ensure it remains fit for purpose and evolves as necessary

Questions for stakeholders

3. What data do you require and for what purpose?

4. Is this data currently available to you and if not, do you know if it exists?

5. Where would you expect to look to find the data you are interested in?

6. Who currently supports or funds the provision and management of the data that you have access to?

7. Who do you believe should be responsible for funding and/or managing the data that you access? Are there any gaps in the provision of this data/service?

8. Can you identify any barriers to data access? What needs to change for you to be able to access the data?

9. Do you collect and/or create data? If so:

a. describe the data and its purpose

b. could the data be of value to a broader user base?

c. what is the data format and how and where is it stored?

d. do limitations exist on sharing this data and/or making it publicly available?

Principles governing design and delivery

To foster a culture of open data, a set of principles is needed to ensure all institutions responsible for delivery of the strategy have a basis for making decisions on what data is required and how, where and with whom it will be shared. We propose the following principles.

Sharing and transparency is business as usual

Data sharing and transparency should be the default wherever there is value to consumers or to competition, efficiency or market security, and where clear reasons to withhold do not exist. The test should always be the maximising the long term interest of consumers.

Governments, businesses and market institutions should consider opportunities for collecting and sharing data produced in their activities as a matter of course.

11

Commercial advantage is not a reason for withholding data, if customers would benefit from having access (e.g. consumption data), or if there are consumer and market benefits for planning, regulatory and/or monitoring.

There are no commercial reasons why governments, market institutions and businesses subject to economic regulation should withhold data.

There may be privacy or security reasons for withholding some data or limiting the ways it may be accessed.

As simple as possible Processes for requesting and accessing data should be standardised and simplified within organisations (e.g. a retailer or network should have one access point for data requests) and where possible within industry segments (e.g. a single process for customer data requests from retailers and constraint data from networks).

Processes for sharing data should be standardised (e.g. using common data standards and formats).

Data sets should be fit for purpose and presented in a way which supports service delivery (e.g. data on network constraints should include geospatial information which enables integration into mapping tools).

Delivering what the market needs

Data should support what the market needs.

Data requirements will largely be driven by the services that the market needs to deliver and what is needed to ensure those services are delivered efficiently.

Collect once and share often

Duplication should be avoided, although data collected for a specific purpose cannot always be shared for other purposes.

Cost effective Costs for collecting and sharing data should be minimised (e.g. through standardisation of processes and data formats).

Costs incurred by an organisation aren’t a reason for not collecting and sharing data, if there is a net benefit to customers.

Decentralised where possible

In most cases, data users should be able to receive data from the organisation that holds it, unless more cost-effective and efficient alternatives exist

Centralised where advantageous

In many cases, duplication will be avoided and costs will be lower if widely used data is available from a single or shared point of access (e.g. network constraint data visible on a single mapping tool).

Work with existing data hubs, where advantageous, to expand services rather than set up “competing” portals.

Voluntary where possible If there are strong incentives for timely and complete data provision and where there is no commercial or regulatory constraint to sharing data, this should be done voluntarily.

12

However, voluntary processes should not be relied upon where they create access barriers through lack of consistent arrangements or conflicting incentives.

Regulated where necessary

In some cases, regulated data sharing may be required to overcome market failures or to manage perceived risks (such as clarity over privacy).

It could also be established as a compliance requirement.

Data obligations, requirements and related governance arrangements should be principles based and limited in prescription wherever possible, to ensure the market can adjust its need over time without ongoing regulatory intervention

Timely and automated Data provision and access in real-time or near real-time is preferred, where relevant and appropriate.

Manual processes should be avoided where automation is possible. For example, data provision and access through APIs or web interfaces should be encouraged over manual requests and paper forms.

Questions for stakeholders

10. Should other principles guide the strategy’s development and direct future decision making?

11. If you disagree with any of these principles, what is your contrary view and on what basis is that view held? For example, is there evidence that what is proposed may not be feasible or that a better approach exists?

12. Are existing consumer protections (under the National Energy Customer Framework and State and Commonwealth privacy laws – including the protections envisaged under the Consumer Data Right) sufficient to protect against adverse outcomes for consumers in the event that data is shared more easily and extensively between market bodies and participants?

13. What are the implications (positive and negative) for improved data access for competition in the market?

Sharing your views and next steps

The Energy Security Board invites comments from interested parties in response to this initial consultation paper by 20 April 2018. All submissions will be published on the COAG Energy Council’s website, subject to claims of confidentiality. All submissions should be sent to info@esb.org.au.

Following receipt of stakeholder submissions on the consultation paper, the Energy Security Board will consider stakeholder feedback and determine the final objective, scope and principles before moving to a detailed strategy design. Further consultation will take place once a high-level strategy design has been developed.

13

Appendix A – Preliminary view of institutional NEM data holdings

AER

The Australian Energy Regulator (AER) regulates wholesale and retail energy markets and energy networks. AER's functions relate to: 5

• Enforcing the laws for the National Electricity Market and spot gas markets in southern and eastern Australia

• Regulating electricity networks and covered gas pipelines, in all jurisdictions except Western Australia

• Protecting the interests of household and small business consumers by enforcing the Retail Law

5 Australian Energy Regulator, Our Role, viewed 12 December 2017, https://www.aer.gov.au/about-us/our-role.

14

Figure 1. Mapping of AER’s functions, publications, and datasets

Source: The Brattle Group.

15

Figure 2.1 Mapping of AER’s functions, publications, and datasets

Source: The Brattle Group.

16

AEMC

The Australian Energy Market Commission (AEMC) was established in 2005 to promote efficient investment, use and operation of electricity and gas services in the long-term interests of consumers. AEMC makes and amends the National Electricity Rules, the National Gas Rules, and the National Energy Retail Rules which govern the National Electricity Market, elements of natural gas markets and energy retail markets. AEMC also supports the development of these markets by conducting independent reviews and providing advice to the COAG Energy Council (previously the Standing Council on Energy and Resources). For this mapping of functions, we have broadly categorized AEMC's functions into two categories: 6

• Reviews of market issues and design

• Rule making

6 Australian Energy Market Commission, Market governance, viewed 12 December 2017, http://www.aemc.gov.au/Australias-Energy-Market/Markets-Overview/Market-Governance.

17

Figure 3. Mapping of AEMC’s functions, publications, and datasets

Source: The Brattle Group.

Notes: SME refers to Small and Medium-sized Enterprises. RAB refers to Regulatory Asset Base. OTC refers to Over-The-Counter.

18

AEMO

The Australian Energy Market Operator’s (AEMO) electricity functions are prescribed in the National Electricity Law. In addition, the procedures and processes for market operations, power system security, network connection and access, pricing for network services in the National Electricity Market (NEM), and national transmission planning are prescribed in the National Electricity Rules. For this mapping, we have broadly categorized AEMO's functions into two categories: 7

• Operations of the NEM

• Forecasting and national transmission planning

7 Australian Energy Market Operator, AEMO National Electricity Law, viewed 12 December 2017, https://www.aemo.com.au/Datasource/Archives/Archive137.

19

Figure 4. Mapping of AEMO’s functions, publications, and datasets

Source: The Brattle Group.

Notes: MRIM refers to Manually Read Interval Meter. FCAS refers to Frequency Control Ancillary Services. PASA refers to Projected Assessment of System Adequacy.

20

CER

The Clean Energy Regulator (CER) administers schemes legislated by the Australian Government for measuring, managing, reducing or offsetting Australia's carbon emissions. The agency has administrative responsibilities for the: 8

• National Greenhouse and Energy Reporting Scheme and the Safeguard Mechanism, under the National Greenhouse and Energy Reporting Act 2007

• Emissions Reduction Fund, under the Carbon Credits (Carbon Farming Initiative) Act 2011

• Renewable Energy Target, under the Renewable Energy (Electricity) Act 2000

Figure 5. Mapping of CER’s functions, publications, and datasets

Source: The Brattle Group.

Notes: ERF refers to the Emissions Reduction Fund. NGER refers to the National Greenhouse and Energy Reporting Scheme. RET refers to the Renewable Energy Target. REC refers to Renewable Energy Certificates. LGC refers to Large-scale Generation Certificates.

8 Clean Energy Regulator, What we do, viewed 12 December 2017, http://www.cleanenergyregulator.gov.au/About/What-we-do.

We did not include CER’s administrative responsibilities for the Australian National Registry of Emissions Units, under the Australian National Registry of Emissions Units Act 2011, into the mapping as it was deemed to not be sufficiently related to energy data.

21

ARENA

The Australian Renewable Energy Agency (ARENA) was established on 1 July 2012 by The Australian Renewable Energy Agency Act 2011. ARENA's functions can be broadly categorized into three categories:9

• Support the development of local renewable energy technology by providing funding to researchers, developers and businesses

• Share the knowledge, insights and data from ARENA funded projects

• Share knowledge about renewable energy technologies to consumers, market participants and regulators

Figure 6. Mapping of ARENA’s functions, publications, and datasets

Source: The Brattle Group.

Notes: AREMI refers to the Australian Renewable Energy Mapping Infrastructure.

9 Australian Renewable Energy Agency, About, viewed 12 December 2017, https://arena.gov.au/about.

22

Appendix B – Other energy data initiatives currently in progress

Energy Use Data Model (EUDM)

Department of the Environment and Energy, CSIRO, AEMO

The EUDM is a ‘big data’ project being designed and built through a collaboration between the Department of the Environment and Energy, CSIRO and AEMO. It is a repository of data on the way people and businesses use energy and aims to enable better energy market management and infrastructure planning, and support effective policy reform and research. The EUDM seeks to integrate valuable existing and new datasets from across the market and make them more accessible, as well as supporting value-added research. Government intervention was needed to create the EUDM because of existing restrictions on many data sets. Consideration in the strategy of simplified and updated data access arrangements will support greater value and innovation from the EUDM.

The pilot EUDM will be launched by mid-2018. The Government committed funding in the 2017-18 Budget to develop the EUDM from a pilot to a fully operational model and ensure the EUDM is made available for long-term use by regulators, industry and researchers.

Australian Renewal Energy Mapping Infrastructure (AREMI)

Data61 (CSIRO), Australian Renewable Energy Agency (ARENA)

ARENA funds the AREMI project, developed and maintained by CSIRO’s Data61 (shown in Figure 5 in Appendix A). AREMI consolidates open geospatial data from a range of sources, to better inform energy supply and infrastructure investment decisions.10 It currently includes information on renewable energy sources, energy infrastructure and data from network planning reports. Selected data from the EUDM will be made available on AREMI.

Data Availability and Use

Productivity Commission, Department of the Prime Minister and Cabinet (PM&C)

The Productivity Commission’s final report on its inquiry into Data Availability and Use was tabled in parliament and published in May 2017. A taskforce was established within PM&C to advise the Government on its response to the recommendations made in the report. A number of recommendations in the report may, if adopted, affect the data strategy from the perspectives of custodianship, security and access.

One recommendation was to introduce a new right for consumers to have access to, and authorise the release of their data. The Government announced in November 2017 that a national Consumer Data Right will be legislated in 2018, with energy being one of the first sectors in which it will be established.11

Consumer Data Right

Treasury, Australian Competition and Consumer Commission (ACCC)

10 ARENA, Projects, viewed 7 December 2017, https://arena.gov.au/projects/aremi-project. 11 Hon. Angus Taylor MP 2017, Australians to own their own banking, energy, phone and internet data, viewed 7 December

2017, https://ministers.pmc.gov.au/taylor/2017/australians-own-their-own-banking-energy-phone-and-internet-data.

23

The Consumer Data Right (CDR) will give customers a right to direct that their data be shared with others they trust.12 The CDR could eventually be an economy-wide right, though its initial implementation will be in the banking, energy and telecommunications sectors. The final report into the Review of Open Banking in Australia was released for public consultation in February 2018. Open Banking is the implementation of the CDR for the banking sector - the first sector to which it will apply. The report recommends a regulatory framework for the CDR that sees the ACCC as lead regulator supported by the Office of the Australian Information Commissioner (OAIC).

Facilitating access to consumer data

COAG Energy Council, Department of Environment and Energy

A Rule change effective on 1 March 2016 provided consumers and their authorised third parties with the entitlement to obtain their consumption data from their distributor or retailer. Issues still remain however in relation to data formats, timeliness in the delivery of data, and consent and verification processes. The Finkel Review recommended that COAG EC facilitate removing the complexity and improving access to, and sharing of, their energy data.

As part of its commitment to supporting this recommendation, COAG EC has initiated a project that will make recommendations to streamline the processes and facilitate timely access to consumer consumption data13. The Department is co-ordinating this project with the support of consultants, Houston Kemp, with an initial draft report released for public consultation in March 2018. Recommendations are expected to go to COAG Energy Council in the middle of the year and will be closely integrated with subsequent wider work on the Consumer Data Right.

Register of distributed energy resources (DER)

COAG Energy Council, AEMO

On 5 October 2017, COAG EC submitted a rule change request to AEMC seeking to place an obligation on AEMO to establish a register of DER and collect information from distribution network service providers (DNSPs)14. Under the proposal, DNSPs would also be obliged to collect data and provide it to AEMO. The rule change request addresses issues raised by AEMO in a January 2017 report into the visibility of DER in the NEM and identified gaps in data collection. The establishment of a DER register also supports recommendations of the Finkel Review. The rule change process commenced on 6 March 2018.

Developments by other institutions

There are also initiatives being progressed by State governments and industry organisations in addition to those led by the energy market institutions and the Commonwealth. This includes the Victorian Department of Environment, Land, Water and Planning (DELWP) led development of an ‘Energy Data Hub’, and there will continue to be others while the energy market continues to transition.

12 Australian Government Treasury, Consumer Data Right – Fact Sheet, viewed 28 February 2018,

https://static.treasury.gov.au/uploads/sites/1/2018/02/180208-CDR-Fact-Sheet-1.pdf.

13 COAG Energy Council, Facilitating Access to Consumer Energy Data - Consultation Paper, viewed 1 March 2018,

http://www.coagenergycouncil.gov.au/publications/call-submissions-facilitating-access-consumer-energy-data. 14 AEMC, Rule changes - Register of distributed energy resources, viewed 7 March 2018, http://aemc.gov.au/Rule-

Changes/Register-of-distributed-energy-resources.