Data management best practices

22
Data management best practices & CTRM/ETRM challenges By: AJAY KOOMAR

Transcript of Data management best practices

Page 1: Data management best practices

Data management best practices&

CTRM/ETRM challenges

By: AJAY KOOMAR

Page 2: Data management best practices

CTRM/ETRM- THE SCORECARD• Physical position reports for each location and commodity including long

and short status. (Position reports may be for current and forward time periods.).

• Estimated profit and loss on completed transactions and processes forecast present and future cash flows •

• Price risk exposure associated with current and forward positions •• Credit risk exposure associated with current and forward positions •• Operational risk exposure •

• Information required for regulatory compliance in areas such as financial accounting, futures, exchange activity, price transaction reporting, and government reporting.

Page 3: Data management best practices

THE SCORECARD DEPENDENCY-ON MARKET DATA

• ETRM system effectiveness depends on accurate and timely reporting and market information. Successful ETRM utilization involves effective reporting and analysis to navigate and improve trading performance.

Page 4: Data management best practices

The ETRM /CTRM system is a trading organization’s scorecard-Report

• Physical position reports for each location and commodity including long and short status. • (Position reports may be for current and forward time periods.)

• Estimated profit and loss on completed transactions and processes •• Forecast present and future cash flows •

• Price risk exposure associated with current and forward positions •

• Credit risk exposure associated with current and forward positions •

• Operational risk exposure •

• Information required for regulatory compliance in areas such as financial accounting, futures •

• Exchange activity, price transaction reporting, and government reporting.

Page 5: Data management best practices
Page 6: Data management best practices

ETRM/CTRM-DATA CHALLANGES• Maintaining up to date market data overtime

and adding it to when needed is a significant challenge for ETRM/CTRM sys-admin.

• Unexpected data changes.• Market data provider supplies a correlation to

a previously published rate , the ETRM system has to recognize the exception. In many cases

ETRM system finds it difficult to handle.

Page 7: Data management best practices

Data aggregator

CTRM/ETRM –Transaction life cycleCapturing infrastructure, contracts and

counterparties

Pre-deal analysis

Deal capture

Scheduling operations and logistics

Risk analysis.

Settlement and Invoicing.

Market data

Each stage of CTRM/ETRM transaction is dependent on external market data

All commodity transactions companies would ultimately will require the service of an external Data aggregation services to handle multi-

commodity, multi-source and multi-format market data.

Page 8: Data management best practices

External data dependency

Where trading is conducted with an exchange rather than a company, exchange commodity details and contracts have to be captured. These include contract termination dates and delivery timing, as well as broker intermediary details.The quantity of information to be captured and entered into the ETRM system before a transaction occurs varies widely with the business profile of the trading company.

Capturing infrastructure, contracts and counterparties

Page 9: Data management best practices

External data dependency

Before executing a trade and entering the transaction into the ETRM system, pre-deal analysis is usually performed. Traders analyze current market prices and fundamentals to identify optimal timing and pricing mechanisms for the trade. Data requirements for pre-deal analysis, in particular access to historical market prices and fundamental information such as storage and weather data, are not well served in ETRM/CTRM systems. Instead, analysts typically use outside software tools that contain broader market information. Access to market data within ETRM systems is a challenge because the system tends to contain only the market data needed to manage existing trades.

Pre-deal analysis

Page 10: Data management best practices

External data dependency

Deal capture includes all relevant transaction details. Typical details might include trade number, quantity, commodity, units of measure, counterparty, contract, delivery timing, buy or sell, location, financial or physical, trader name, price mechanism, transaction frequency, and link to other trades. Data management challenges arise when deal volume is high and errors in the details creep into the ETRM system, even with automation. Deal entry errors are time consuming to fix, render the scorecard inaccurate and threaten ETRM system integrity.

Deal capture

Page 11: Data management best practices

External data dependency

Scheduling logistics require data interaction (often on paper) with third-party transportation systems. Without up-to-date scheduling and logistics information, the ETRM scorecard cannot present accurate position reports to management. The data management challenge in scheduling and logistics is capturing data from third-party transportation, processing, and scheduling systems. Data may not be available in a timely fashion, and changes or corrections to volumetric measures may occur without notice.

Scheduling operations and logistics

Page 12: Data management best practices

External data dependency

Risk management

RISK MANAGEMENT

1. Market risk(price risk).2. Operational risk.3. Counterparty risk.4. Regulatory risk.

Page 13: Data management best practices

Market data management best practices

• Use straight-throughput processing and automation to eliminate manual efforts •

• Reduce data feeds to a minimum •• Ensure timely data updates •• Perform pro-active data quality control •• Maintain audit trails of data changes and track

corrections •• Manage data permissions to ensure data

integrity

Page 14: Data management best practices

Pre-deal Analysis

• Traders analyze especially historical data.

• Manages only market data required for the trade as against the broader market information.

Pre-deal analysis

Page 15: Data management best practices

Deal capture

• Errors in the details creep into the ETRM system even with automation for high deal volume. Deal entry errors are time consuming to fix, render the scorecard inaccurate and threaten ETRM system integrity.

Deal capture

Data from third party transportation , processing and scheduling systems poses a quite a challenge for the ETRM sys-admin.

Page 16: Data management best practices

Risk management

RISK MANAGEMENT

1. Market risk(price risk).2. Operational risk.3. Counterparty risk.4. Regulatory risk.

• Market data to manage market risk is primarily pricing. Generating daily forward curve prices from market data (mark to market) –Risk reporting.

• A forward curve for each forward position in the trading portfolio.

• Many commodities and in particular for periods further out into the future , no market data is available .

RISK MANAGEMENT CHALLENGES

Market data from multiple sources

Data often poorly organized

Data requiresFurther

massaging

ETRM

Forward curve- built outside

SOLUTION

Import i

nto ETRM

VAR calculation is data intensive where they use simulation method

Data manipulation in excel

Page 17: Data management best practices

Operational risk

• Transportation.• Processing.• Storage.

Primarily all the above mentioned data is coming from a third party and the same needs to be feed into the ETRM system

Challenges

Page 18: Data management best practices

Counter party –credit risk

• Market data from credit rating agencies.

• Financial reports.

Third party data collection.

Challenges

Note : Clearing houses removes counter party credit risk but incur overhead cost to manage the clearing processAnd meet daily margin calls.

Page 19: Data management best practices

Regulatory risk

• To comply with regulation, it is necessary to understand where outside data originates and track any changes occurring en-route to ETRM.

Access to original set of data is an important advantage in this process.

Page 20: Data management best practices

Associated contract

Trading infrastructure

CTRM/ETRM- transaction life cycle

ETRM

Data set-up

Market data

Data Aggregator

Transaction life cycle

CONTRACTS

Credit limit

Qty

Price

Delivery

Standard contracts derived from International swaps and derivatives association (ISDA). NorthAmerica energy standard boards (NAESB).

Page 21: Data management best practices

Best practices of market data management

• Use straight-through processing.• Reduce data feeds to minimum.• Ensure timely data updates are available.• Pro-active data quality control.• Maintain audit trails of data changes and track

corrections.• Manage data permissions.

Page 22: Data management best practices

In a era of “Free fall of crude oil prices , “cost management” has become the priority for energy companies /traders

Scope of cost optimizationCost centers

1.Product and commercial cost 1.Reduce number of product approvals.2.Streamline portfolio (product overlapping activities).3.Standardize front office set up /systems.

2.Support cost(including control requirements)

1.Reduce control and reporting requirements by way of maximum automation.2.Streamline trade process and increase end to end automation.3.Consolidate functions and evaluate near off shoring and outsourcing

3.Information and Technology Cost 1.Eliminate high cost /low benefit projects.2.Streamline application landscape.

4.Location Cost

1.Optimize location set-up/spread of departments.2.Increase building utilization.