Status, Data Transfer Status, Data Transfer and Processingand Processing

Vilas Mandlekar, Nada Hamadeh and Yuri DikhanovVilas Mandlekar, Nada Hamadeh and Yuri DikhanovICP Regional Coordinators MeetingICP Regional Coordinators Meeting7-11 March 2005, Washington DC7-11 March 2005, Washington DC

ICP Tool Pack

AgendaAgenda

1.1. Status Report – ICP Tool Pack Status Report – ICP Tool Pack

2.2. Work Flow and Data Exchange between Work Flow and Data Exchange between Countries and RegionsCountries and Regions

3.3. Data Processing Module – DemoData Processing Module – Demo

4.4. Q & AQ & A

Tool PackTool Pack Status UpdateStatus Update

Price Collection Module (PCM)Price Collection Module (PCM)

Export to Excel -- Price observations once entered can be Export to Excel -- Price observations once entered can be downloaded to Excel for viewing or recording downloaded to Excel for viewing or recording Impact on Data Transfer screen – one new buttonImpact on Data Transfer screen – one new button

““Cut and Paste” of observations from other sources (Excel) Cut and Paste” of observations from other sources (Excel) into the PCM multiple product data entry screeninto the PCM multiple product data entry screen Impact on Multiple Products data entry screen – one Impact on Multiple Products data entry screen – one

new icon on the gridnew icon on the grid Option to recompute converted pricesOption to recompute converted prices

Impact on Data Editing screen – one new button that Impact on Data Editing screen – one new button that appears only if product parameters have changedappears only if product parameters have changed

Tool Pack 1.2 – what’s changed since 1.1?

Price Administration Module (PAM)Price Administration Module (PAM)

No change in the screen layouts or text appearing on No change in the screen layouts or text appearing on screensscreens

Items (products/observations) beyond tolerance are Items (products/observations) beyond tolerance are highlighted in red in the Diagnostics Tables.highlighted in red in the Diagnostics Tables.

Old Excel templates used in PAM 1.1 are NOT useable in Old Excel templates used in PAM 1.1 are NOT useable in 1.21.2 Download blank templates for each of the Master data Download blank templates for each of the Master data

–products lists, characteristics, characteristic values, –products lists, characteristics, characteristic values, specifications, outlets and their mapping etc. specifications, outlets and their mapping etc.

““Cut and Paste” product lists etc. from old templates Cut and Paste” product lists etc. from old templates into the new templatesinto the new templates

Upload into PAM 1.2Upload into PAM 1.2

Tool Pack 1.2 – what’s changed since 1.1?

Data Processing Module (DPM)Data Processing Module (DPM)

New module primarily for regional use, but also used by countries

Region can create templates, i.e. selections of products, locations, attributes etc., and time periods over which the countries provide their data

Enter Exchange rates, population, expenditures, and weights (optional)

Run Quaranta Tables, Index processing, and produce Reports

Tool Pack 1.2 – what’s changed since 1.1?

Data Processing Module (DPM)Data Processing Module (DPM)

For ICP purposes, country use is limited to:

1. Import a template from the Regional Coordinator

2. Export average or raw prices data to Regional Coordinator

Tested by Statistics CanadaTested by Statistics Canada DPM User Manual and DPM Summary Steps preparedDPM User Manual and DPM Summary Steps prepared DPM Substantive Manual / Step-by-Step Guide underwayDPM Substantive Manual / Step-by-Step Guide underway

Tool Pack 1.2 – what’s changed since 1.1?

What do Countries need to know about Tool Pack 1.2 ?What do Countries need to know about Tool Pack 1.2 ?

There’s There’s very little or no changevery little or no change between 1.1 and 1.2 in terms between 1.1 and 1.2 in terms

of functions of price observations data entry and running of functions of price observations data entry and running preliminary diagnostic reportspreliminary diagnostic reports

Countries receive from regions a selection of product lists Countries receive from regions a selection of product lists and time periods over which the price observations are and time periods over which the price observations are requiredrequired

Countries generate average prices data (Excel format) using Countries generate average prices data (Excel format) using the DPM module and send it to the Regional Coordinator the DPM module and send it to the Regional Coordinator

Raw prices (optionally) Raw prices (optionally) cancan be sent by countries to the be sent by countries to the Region for index processingRegion for index processing

Tool Pack 1.2 – what’s changed since 1.1?

How do Countries/Regions upgrade to Tool Pack 1.2 ?How do Countries/Regions upgrade to Tool Pack 1.2 ?

RegionsRegions Install the PAM 1.2 after first un-installing the PAM 1.1 Install the PAM 1.2 after first un-installing the PAM 1.1 Input the product lists and any attributes (location Input the product lists and any attributes (location

attribute such as, Rural/Urban) for their countries, using attribute such as, Rural/Urban) for their countries, using new Excel templates in PAM 1.2new Excel templates in PAM 1.2

Regions DO NOT normally NEED PCM to be installedRegions DO NOT normally NEED PCM to be installed

CountriesCountries If they have a PAM 1.1 already installed, then use the If they have a PAM 1.1 already installed, then use the

patch to upgrade to 1.2. Data entered under 1.1 will not be patch to upgrade to 1.2. Data entered under 1.1 will not be disturbed due to this upgradedisturbed due to this upgrade

They can also install PAM 1.2 afresh if they want to enter They can also install PAM 1.2 afresh if they want to enter their product lists and observations againtheir product lists and observations again

Tool Pack 1.2 – what’s changed since 1.1?

Countries not using PCM can use the Batch Upload Utility Countries not using PCM can use the Batch Upload Utility to upload their data into the PAM to perform data to upload their data into the PAM to perform data validationvalidation

Tried and tested by Statistics Canada in their pilot Tried and tested by Statistics Canada in their pilot collectioncollection

Stand-alone utilityStand-alone utility

File for upload of observations must be in “CSV” formatFile for upload of observations must be in “CSV” format

Batch Upload User guide and CSV file formatBatch Upload User guide and CSV file format

Batch Upload Utility for Price Observations

Countries might require the help of RC team to convert Countries might require the help of RC team to convert their files into the CSV file formattheir files into the CSV file format

Fields in the file must follow a prescribed layout

Product codes, UoM codes, UoM conversions must exist on the PAM before upload

Utility is in English i.e. the screens labels and messages are in English

Batch Upload Utility for Price Observations

Tool Pack 1.2 – Status of implementation

Africa Asia ESCWA LAC CISDelivery of ToolPack 1.2

CD sent Feb 24 CD sent Jan 28. Sent again Feb 28 (via WB Manila office)

Version 1.2 sent on Mar. 8

Sent Jan 19 ??

Documentation DPM user guide and summary steps sent

DPM user guide and summary steps sent

DPM user guide and summary steps to be sent

DPM user guide and summary steps sent

??

Africa Asia ESCWA LAC CISTraining on DPM To be arranged To be arranged To be arranged StatCanada staff

trained in Washington

??

Translation Some PAM and all of DPM strings need to be translated to French

All Chinese translations done

Only DPM strings need to be translated to Arabic

Some PAM and all of DPM strings need to be translated to Spanish

Some PAM and all of DPM strings need to be translated to Russian

Tool Pack 1.2 – Status of implementation

Other news and issues

HHD – ESCWA funded and specified a hand held computer based price collection module. To be finalized in Arabic and English by March end.

Transferring Tool Pack software to Regional Coordinator Offices – use of the World Bank FTP site or website for software upgrades/patches.

Training of Regional Coordinators staff on DPM.

Lessons from LAC pilot data collectionLessons from LAC pilot data collection

3 types of problems:3 types of problems: BugsBugs Erroneous use of the system by countriesErroneous use of the system by countries New functionalities requiredNew functionalities required

Countries have different levels of technological Countries have different levels of technological capabilitiescapabilities

Tool Pack needs close support from regional and Tool Pack needs close support from regional and global officesglobal offices

Troubleshooting capabilitiesTroubleshooting capabilities All documentation should be translatedAll documentation should be translated

Tool PackTool Pack Workflow Workflow and Data Exchangeand Data Exchange

Country PAM / DPM

Country PCM (s)

2- Data Collection

5- Setup

Region PAM / DPM

9- Index Processing

ObservationsSurvey Details

1- Setup 4- Data Validation7- Data Transfer to/from Region

PAM DPM

Average Price

Templates

Individual or Average Prices

8- InterCountry

Validation

6- Data Transfer to/from Country

3- Data Entry and Editing

10- Reports

Country PAM

1- Setup

• ProductsProducts• AttributesAttributes• OutletsOutlets• Price CollectorsPrice Collectors• Mapping Products – Outlets – Price CollectorsMapping Products – Outlets – Price Collectors• SurveysSurveys

Survey DetailsSurvey Details

XML fileXML file Survey products, outlets and price collectors Survey products, outlets and price collectors

detailsdetails

Country PCM (s)

2- Data Collection:

• Printing Data Collection FormsPrinting Data Collection Forms

3- Data Entry and Editing:

• Data EntryData Entry• Data EditingData Editing• Outlier AnalysisOutlier Analysis

ObservationsObservations

XML fileXML file Individual observations (including outliers Individual observations (including outliers

if the country chose to keep the outliers)if the country chose to keep the outliers)

Country PAM

4- Data Validation (Diagnostic Reports)

• Product Level Diagnostics – Table 1Product Level Diagnostics – Table 1• Observation Level Diagnostics – Table 2Observation Level Diagnostics – Table 2

Region PAM / DPM

5- Setup

• ProductsProducts• AttributesAttributes• PopulationPopulation• ExpendituresExpenditures• Exchange RatesExchange Rates

Region PAM / DPM

6- Data Transfer to/from Country

• Send Average Price TemplatesSend Average Price Templates• Receive Average Prices + IndicatorsReceive Average Prices + Indicators• Receive Individual PricesReceive Individual Prices

Average Price TemplatesAverage Price Templates

Analytical template XML fileAnalytical template XML file Means of data selection to ensure data Means of data selection to ensure data

qualityquality Determines timeframe coverage, product Determines timeframe coverage, product

selection, breakdown by outlet types, and selection, breakdown by outlet types, and attributesattributes

Average prices + indicators (coefficient of Average prices + indicators (coefficient of variation)variation)

Country DPM

7- Data Transfer to/from Region

• Receive Average Price Templates• Send Individual prices• Send Average prices + indicators• By outlet types? • By attribute breakdown?

Individual or Average PricesIndividual or Average Prices

Individual prices (preferred) --- xml fileIndividual prices (preferred) --- xml file Average prices + indicators (minimum Average prices + indicators (minimum

requirement to run Quaranta Table) --- requirement to run Quaranta Table) --- Excel fileExcel file

Index processing can be run with individual Index processing can be run with individual prices or with average prices.prices or with average prices.

Region PAM / DPM

8- Inter Country Validation

• Quaranta TableQuaranta Table• Iterations between region and countries Iterations between region and countries

to revisit some average pricesto revisit some average prices

Region PAM / DPM

9- Index Processing

• Multiple price indicesMultiple price indices• PPPs, Average Prices, and Real ExpendituresPPPs, Average Prices, and Real Expenditures

Region PAM / DPM

10- Reports

• Average pricesAverage prices• Price indicesPrice indices• Real and nominal expendituresReal and nominal expenditures• Per capita real and nominal expendituresPer capita real and nominal expenditures

Country PAM / DPM

5- Setup

Region PAM / DPM

9- Index Processing

1- Setup 4- Data Validation7- Data Transfer to/from Region

PAM DPM

Average Price

Templates

Individual or Average Prices

8- InterCountry

Validation

6- Data Transfer to/from Country

10- Reports

Country CPI systems

2- Data Collection3- Data Entry

and Editing

Observations through Batch Upload

Data Processing ModuleData Processing ModuleDemonstrationDemonstration