Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández...
Transcript of Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández...
![Page 1: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-](https://reader034.fdocuments.in/reader034/viewer/2022051801/5adf06b47f8b9ad66b8c5416/html5/thumbnails/1.jpg)
Overview of the IDB Analyzer
Andrés Sandoval-Hernández – IEA DPC
Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets
Ispra, Italy- June 24-27, 2014
Note: These slides were prepared as part of the IEA training portfolio with the collaboration of IEA staff and resource persons.
![Page 2: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-](https://reader034.fdocuments.in/reader034/viewer/2022051801/5adf06b47f8b9ad66b8c5416/html5/thumbnails/2.jpg)
Table of contents
• Introduction to the IEA IDB Analyzer
• Installation walkthrough
• Use of the IDB Analyzer
2
![Page 3: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-](https://reader034.fdocuments.in/reader034/viewer/2022051801/5adf06b47f8b9ad66b8c5416/html5/thumbnails/3.jpg)
• What is IEA IDB Analyzer?
– A software program developed by the IEA Data Processing and Research Center for analyzing data from all IEA surveys, (CivED, TIMSS, PIRLS, ICCS, TEDS-M, ICILS, SITES) and OECD studies (PISA, PIAAC, TALIS) and some cross-organizational
studies (IALS, ALLS)
– Handles complex sample designs and makes use of plausible value methodology (not used in TALIS!)
– Calculates correct standard errors when conducting analysis with large-scale surveys
– Uses optimized algorithms for computing means, percentages and regressions and other statistics
Introduction to IEA IDB Analyzer
3
![Page 4: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-](https://reader034.fdocuments.in/reader034/viewer/2022051801/5adf06b47f8b9ad66b8c5416/html5/thumbnails/4.jpg)
• BONUS!
– Easy creation of data sets for use in SPSS
– Merging countries and/or data levels
– Selection of analysis variables
Introduction to IEA IDB Analyzer
4
![Page 5: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-](https://reader034.fdocuments.in/reader034/viewer/2022051801/5adf06b47f8b9ad66b8c5416/html5/thumbnails/5.jpg)
What does it do?
• Compute estimates of percentages, means, percentiles, correlations, and linear regression parameters, including their respective standard errors
• Can handle properly the sampling and study-specific method to compute the correct standard errors
• Possibility to select more than one analysis variable when computing means
• Creates enhanced SPSS output on-screen and SPSS data file and Excel output file in the working folder
• Creates graphs for the descriptive analyses 5
![Page 6: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-](https://reader034.fdocuments.in/reader034/viewer/2022051801/5adf06b47f8b9ad66b8c5416/html5/thumbnails/6.jpg)
Requirements
• Windows XP or higher, SPSS 15 or higher, .NET 4 and Microsoft Excel needs to be installed beforehand
• Administrator rights are required for installation process but not for use
6
![Page 7: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-](https://reader034.fdocuments.in/reader034/viewer/2022051801/5adf06b47f8b9ad66b8c5416/html5/thumbnails/7.jpg)
Very common question: “Why can’t I just do this in SPSS?”
Answer: “Because of the data structure!”
– Sampling is multi-stage, clustered, and stratified which can not be handled correctly by SPSS (remember the sample design presentation!)
– SPSS can not do variance estimation using replication methods
– The plausible values
IDB Analyzer handles these issues and “adds” the missing features to SPSS
Why Do We Need IDB Analyzer?
7
![Page 8: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-](https://reader034.fdocuments.in/reader034/viewer/2022051801/5adf06b47f8b9ad66b8c5416/html5/thumbnails/8.jpg)
Table of contents
• Introduction to the IEA IDB Analyzer
• Installation walkthrough
• Use of the IDB Analyzer
8
![Page 9: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-](https://reader034.fdocuments.in/reader034/viewer/2022051801/5adf06b47f8b9ad66b8c5416/html5/thumbnails/9.jpg)
Installation walkthrough
• Double click on the setup file
(C:\EU_Workshop\Software\IEA_IDBAnalyzer_Setup_v3.1.14.exe)
9
![Page 10: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-](https://reader034.fdocuments.in/reader034/viewer/2022051801/5adf06b47f8b9ad66b8c5416/html5/thumbnails/10.jpg)
Installation walkthrough • Follow through the wizard windows to a successful installation
10
![Page 11: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-](https://reader034.fdocuments.in/reader034/viewer/2022051801/5adf06b47f8b9ad66b8c5416/html5/thumbnails/11.jpg)
Table of contents
• Introduction to the IEA IDB Analyzer
• Installation walkthrough
• Use of the IDB Analyzer
11
![Page 12: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-](https://reader034.fdocuments.in/reader034/viewer/2022051801/5adf06b47f8b9ad66b8c5416/html5/thumbnails/12.jpg)
How to Open the IDB Analyzer
• Start All Programs IEA IDBAnalyzerV3 IEA IDBAnalyzer
12
![Page 13: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-](https://reader034.fdocuments.in/reader034/viewer/2022051801/5adf06b47f8b9ad66b8c5416/html5/thumbnails/13.jpg)
What you will see…
One integrated environment, two modules
Prepare data for analysis
Conduct analysis
Help Manual
13
![Page 14: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-](https://reader034.fdocuments.in/reader034/viewer/2022051801/5adf06b47f8b9ad66b8c5416/html5/thumbnails/14.jpg)
Table of contents
• Introduction to the IEA IDB Analyzer
• Installation walkthrough
• Use of the IDB Analyzer
• Merge Module
• Analysis Module
14
![Page 15: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-](https://reader034.fdocuments.in/reader034/viewer/2022051801/5adf06b47f8b9ad66b8c5416/html5/thumbnails/15.jpg)
Merging Data Files
• Merge module
• Merges data from different respondents (e.g. in TALIS: school and teacher) and different countries
• Select source files
• Select participants
• Select variables
• Define the output (merged) file
• Create and save SPSS syntax for merging the data
• Execute the SPSS syntax to produce the merged dataset
15
![Page 16: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-](https://reader034.fdocuments.in/reader034/viewer/2022051801/5adf06b47f8b9ad66b8c5416/html5/thumbnails/16.jpg)
Merge Module
Data Source Directory
Select... C:\EU_Workshop\Data
16
![Page 17: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-](https://reader034.fdocuments.in/reader034/viewer/2022051801/5adf06b47f8b9ad66b8c5416/html5/thumbnails/17.jpg)
Merge Module
Select...
Data Source Directory
Participants
PIAAC PIAAC Cycle 1
17
![Page 18: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-](https://reader034.fdocuments.in/reader034/viewer/2022051801/5adf06b47f8b9ad66b8c5416/html5/thumbnails/18.jpg)
Merge Module
Select... Data Source Directory
Participants
18
![Page 19: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-](https://reader034.fdocuments.in/reader034/viewer/2022051801/5adf06b47f8b9ad66b8c5416/html5/thumbnails/19.jpg)
File Types
Variables
Merge Module
Select...
3
2
You can search by name or description
1
19
![Page 20: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-](https://reader034.fdocuments.in/reader034/viewer/2022051801/5adf06b47f8b9ad66b8c5416/html5/thumbnails/20.jpg)
Define File Name and Save
Merge Module
20
![Page 21: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-](https://reader034.fdocuments.in/reader034/viewer/2022051801/5adf06b47f8b9ad66b8c5416/html5/thumbnails/21.jpg)
Merge Module
Syntax file is automatically stored in specified directory AND SPSS, the created syntax file is automatically opened
21
![Page 22: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-](https://reader034.fdocuments.in/reader034/viewer/2022051801/5adf06b47f8b9ad66b8c5416/html5/thumbnails/22.jpg)
Merge Module
• From the SPSS syntax editor choose: – Run > All
– The syntax is executed and the merged file is saved under the location you have chose in the last step of the IDB Analyzer Merge Module
22
![Page 23: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-](https://reader034.fdocuments.in/reader034/viewer/2022051801/5adf06b47f8b9ad66b8c5416/html5/thumbnails/23.jpg)
Merge Module
23
![Page 24: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-](https://reader034.fdocuments.in/reader034/viewer/2022051801/5adf06b47f8b9ad66b8c5416/html5/thumbnails/24.jpg)
Table of contents
• Introduction to the IEA IDB Analyzer
• Installation walkthrough
• Use of the IDB Analyzer
• Merge Module
• Analysis Module
24
![Page 25: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-](https://reader034.fdocuments.in/reader034/viewer/2022051801/5adf06b47f8b9ad66b8c5416/html5/thumbnails/25.jpg)
Analyzing data with the IEA IDB Analyzer
25
![Page 26: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-](https://reader034.fdocuments.in/reader034/viewer/2022051801/5adf06b47f8b9ad66b8c5416/html5/thumbnails/26.jpg)
Choose file containing the data for analysis
Overview of the Analysis Module
26
![Page 27: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-](https://reader034.fdocuments.in/reader034/viewer/2022051801/5adf06b47f8b9ad66b8c5416/html5/thumbnails/27.jpg)
Overview of the Analysis Module
27
![Page 28: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-](https://reader034.fdocuments.in/reader034/viewer/2022051801/5adf06b47f8b9ad66b8c5416/html5/thumbnails/28.jpg)
Overview of the Analysis Module
• Percentages and Means
– Computes the percentages within specified subgroups and their mean and standard deviation on the continuous variable selected
– Also computes the appropriate standard errors for those percentages, means and standard deviations
28
![Page 29: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-](https://reader034.fdocuments.in/reader034/viewer/2022051801/5adf06b47f8b9ad66b8c5416/html5/thumbnails/29.jpg)
Overview of the Analysis Module
• Percentages Only
– Computes the percentages within specified subgroups
– Computes the appropriate standard errors for those percentages
29
![Page 30: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-](https://reader034.fdocuments.in/reader034/viewer/2022051801/5adf06b47f8b9ad66b8c5416/html5/thumbnails/30.jpg)
Overview of the Analysis Module
• Regression
– Computes a simple or multiple linear regression between a dependent variable and a set of independent variables
– Can apply dummy and effect coding on the fly to test for differences across groups
– Computes the regression coefficients and their corresponding standard errors
30
![Page 31: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-](https://reader034.fdocuments.in/reader034/viewer/2022051801/5adf06b47f8b9ad66b8c5416/html5/thumbnails/31.jpg)
Overview of the Analysis Module
• Correlations
– Calculates correlation coefficients between selected analysis variables their standard errors
31
![Page 32: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-](https://reader034.fdocuments.in/reader034/viewer/2022051801/5adf06b47f8b9ad66b8c5416/html5/thumbnails/32.jpg)
Overview of the Analysis Module
• Percentiles
– Calculates the score points that separate a given percentage of the distribution of a variable, by subgroups defined by the grouping variables with the respective standard errors
32
![Page 33: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-](https://reader034.fdocuments.in/reader034/viewer/2022051801/5adf06b47f8b9ad66b8c5416/html5/thumbnails/33.jpg)
Overview of the Analysis Module
Mandatory for all analysis types
33
![Page 34: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-](https://reader034.fdocuments.in/reader034/viewer/2022051801/5adf06b47f8b9ad66b8c5416/html5/thumbnails/34.jpg)
Overview of the Analysis Module
Applies to: Percentages and Means Regression Correlations
Percentiles 34
![Page 35: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-](https://reader034.fdocuments.in/reader034/viewer/2022051801/5adf06b47f8b9ad66b8c5416/html5/thumbnails/35.jpg)
Overview of the Analysis Module
Applies to:
Regression
35
![Page 36: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-](https://reader034.fdocuments.in/reader034/viewer/2022051801/5adf06b47f8b9ad66b8c5416/html5/thumbnails/36.jpg)
Overview of the Analysis Module
Select variables of interest
Search for variable by name or label
36
![Page 37: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-](https://reader034.fdocuments.in/reader034/viewer/2022051801/5adf06b47f8b9ad66b8c5416/html5/thumbnails/37.jpg)
Overview of the Analysis Module
Selected automatically when file is opened
37
![Page 38: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-](https://reader034.fdocuments.in/reader034/viewer/2022051801/5adf06b47f8b9ad66b8c5416/html5/thumbnails/38.jpg)
Overview of the Analysis Module
Add or remove variables
38
![Page 39: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-](https://reader034.fdocuments.in/reader034/viewer/2022051801/5adf06b47f8b9ad66b8c5416/html5/thumbnails/39.jpg)
Overview of the Analysis Module
Choose the desired number of decimals in the output
39
![Page 40: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-](https://reader034.fdocuments.in/reader034/viewer/2022051801/5adf06b47f8b9ad66b8c5416/html5/thumbnails/40.jpg)
Overview of the Analysis Module
Define the location of the output files to be produced
40
![Page 41: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-](https://reader034.fdocuments.in/reader034/viewer/2022051801/5adf06b47f8b9ad66b8c5416/html5/thumbnails/41.jpg)
Overview of the Analysis Module
Start SPSS and produce syntax
41
![Page 42: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-](https://reader034.fdocuments.in/reader034/viewer/2022051801/5adf06b47f8b9ad66b8c5416/html5/thumbnails/42.jpg)
Any Questions?
Thank you for your attention!
42