Data Processing Software for IMTS - United Nations · 2016-09-30 · Introduction •Eurotrace is a...
Transcript of Data Processing Software for IMTS - United Nations · 2016-09-30 · Introduction •Eurotrace is a...
![Page 1: Data Processing Software for IMTS - United Nations · 2016-09-30 · Introduction •Eurotrace is a data management and processing software, usually used for IMTS, in conjunction](https://reader030.fdocuments.in/reader030/viewer/2022040414/5f21955660e4b515954b09ab/html5/thumbnails/1.jpg)
Data Processing Software for IMTS
Markie Muryawan – [email protected]
United Nations Statistics Division
© 2016
![Page 2: Data Processing Software for IMTS - United Nations · 2016-09-30 · Introduction •Eurotrace is a data management and processing software, usually used for IMTS, in conjunction](https://reader030.fdocuments.in/reader030/viewer/2022040414/5f21955660e4b515954b09ab/html5/thumbnails/2.jpg)
2
Reminder: Implementation Plan
Design Understanding IMTS 2010
Input Institutional Arrangement
Process Algorithm Software
Output Dissemination Platform
Evaluate Quality Report Template
![Page 3: Data Processing Software for IMTS - United Nations · 2016-09-30 · Introduction •Eurotrace is a data management and processing software, usually used for IMTS, in conjunction](https://reader030.fdocuments.in/reader030/viewer/2022040414/5f21955660e4b515954b09ab/html5/thumbnails/3.jpg)
Introduction
• Eurotrace is a data management and
processing software, usually used for IMTS, in
conjunction with ASYCUDA
• Eurotrace is Open Source Application (2014)
• Designed for:
– Managing trade data
– Implementing processing and checking algorithm
– Editing and aggregating data
– Calculating derived trade indicators
– And can be extended through modules… 3
![Page 4: Data Processing Software for IMTS - United Nations · 2016-09-30 · Introduction •Eurotrace is a data management and processing software, usually used for IMTS, in conjunction](https://reader030.fdocuments.in/reader030/viewer/2022040414/5f21955660e4b515954b09ab/html5/thumbnails/4.jpg)
4
Derived Data
Source Dataset
Classification
Plan
4. Target of Data
dissemination
Statistical Office
Statistics Users
2. Provider of Data
Trade Statistics data
Supplier,
Customs,
Statistical Office
Data
Editor
3. Validity Check and
Quality Control
Data Coders,
Data Controller
1. Define External Trade
Statistical Database
Expert of Nomenclatures and/or
Trade Information System
![Page 5: Data Processing Software for IMTS - United Nations · 2016-09-30 · Introduction •Eurotrace is a data management and processing software, usually used for IMTS, in conjunction](https://reader030.fdocuments.in/reader030/viewer/2022040414/5f21955660e4b515954b09ab/html5/thumbnails/5.jpg)
Managing Classification
5
WWW
Nomenclatures
DBMS
![Page 6: Data Processing Software for IMTS - United Nations · 2016-09-30 · Introduction •Eurotrace is a data management and processing software, usually used for IMTS, in conjunction](https://reader030.fdocuments.in/reader030/viewer/2022040414/5f21955660e4b515954b09ab/html5/thumbnails/6.jpg)
Flexible storage design
6
Nomenclatures
DBMS
Data
• Free number of dimensions• Free number of datasets
![Page 7: Data Processing Software for IMTS - United Nations · 2016-09-30 · Introduction •Eurotrace is a data management and processing software, usually used for IMTS, in conjunction](https://reader030.fdocuments.in/reader030/viewer/2022040414/5f21955660e4b515954b09ab/html5/thumbnails/7.jpg)
Control Procedure
Nomenclatures
DBMS
Data
Automatic
Correction
Error table
ValidationAlgorithm
Database
Text Files
![Page 8: Data Processing Software for IMTS - United Nations · 2016-09-30 · Introduction •Eurotrace is a data management and processing software, usually used for IMTS, in conjunction](https://reader030.fdocuments.in/reader030/viewer/2022040414/5f21955660e4b515954b09ab/html5/thumbnails/8.jpg)
Data Editing
8
Nomenclatures
DBMS
Data
Error table
Editor
Autonomous extraction filesfor correction and visualisation.
Viewing tools : easily define extractions
![Page 9: Data Processing Software for IMTS - United Nations · 2016-09-30 · Introduction •Eurotrace is a data management and processing software, usually used for IMTS, in conjunction](https://reader030.fdocuments.in/reader030/viewer/2022040414/5f21955660e4b515954b09ab/html5/thumbnails/9.jpg)
Data Aggregation
9
Nomenclatures
DBMS
Data
COMEXTBrowser
Transcodification
![Page 10: Data Processing Software for IMTS - United Nations · 2016-09-30 · Introduction •Eurotrace is a data management and processing software, usually used for IMTS, in conjunction](https://reader030.fdocuments.in/reader030/viewer/2022040414/5f21955660e4b515954b09ab/html5/thumbnails/10.jpg)
Screenshot – data design
10
![Page 11: Data Processing Software for IMTS - United Nations · 2016-09-30 · Introduction •Eurotrace is a data management and processing software, usually used for IMTS, in conjunction](https://reader030.fdocuments.in/reader030/viewer/2022040414/5f21955660e4b515954b09ab/html5/thumbnails/11.jpg)
Screenshot – data validation
11
Together all the
parameters in the
different
Tabs constitute an
algorithm capable of
Making a wide variety
of validations and
actions
![Page 12: Data Processing Software for IMTS - United Nations · 2016-09-30 · Introduction •Eurotrace is a data management and processing software, usually used for IMTS, in conjunction](https://reader030.fdocuments.in/reader030/viewer/2022040414/5f21955660e4b515954b09ab/html5/thumbnails/12.jpg)
More on data validation
12
6 types of rules supported:
� Validation
� Action
� Deletion
� Invariant
� Warning
� Transcodification
![Page 13: Data Processing Software for IMTS - United Nations · 2016-09-30 · Introduction •Eurotrace is a data management and processing software, usually used for IMTS, in conjunction](https://reader030.fdocuments.in/reader030/viewer/2022040414/5f21955660e4b515954b09ab/html5/thumbnails/13.jpg)
But, W.A.I.T
• EUROTRACE is not data dissemination system
• Fortunately …. There are alternatives software
that work in conjuction with EUROTRACE:
– PC: Comext (Eurostat)
– Web: WebComext (Eurostat), PX-Web (Statistics
Sweden)
• Countries have been implementing these data
disseminations system
13
![Page 14: Data Processing Software for IMTS - United Nations · 2016-09-30 · Introduction •Eurotrace is a data management and processing software, usually used for IMTS, in conjunction](https://reader030.fdocuments.in/reader030/viewer/2022040414/5f21955660e4b515954b09ab/html5/thumbnails/14.jpg)
Eurotrace User Community
• In February 2016, UNSD, Eurostat, African Union, CARICOM, COMESA, ECOWAS and other interested parties decided to form EUROTRACE User Community (EUROTRACE-UC).
• The main goals of this user community are as follows:– To identify common issues and agree on setting the
priority on features for improvement and addition
– To maintain list of issues including the status of resolution
– To fulfill the needs of training and capacity building in countries by pooling available resources
14
![Page 15: Data Processing Software for IMTS - United Nations · 2016-09-30 · Introduction •Eurotrace is a data management and processing software, usually used for IMTS, in conjunction](https://reader030.fdocuments.in/reader030/viewer/2022040414/5f21955660e4b515954b09ab/html5/thumbnails/15.jpg)
http://comtrade.un.org/eurotrace/
15
![Page 16: Data Processing Software for IMTS - United Nations · 2016-09-30 · Introduction •Eurotrace is a data management and processing software, usually used for IMTS, in conjunction](https://reader030.fdocuments.in/reader030/viewer/2022040414/5f21955660e4b515954b09ab/html5/thumbnails/16.jpg)
Example: ideas for improvement
16
![Page 17: Data Processing Software for IMTS - United Nations · 2016-09-30 · Introduction •Eurotrace is a data management and processing software, usually used for IMTS, in conjunction](https://reader030.fdocuments.in/reader030/viewer/2022040414/5f21955660e4b515954b09ab/html5/thumbnails/17.jpg)
17