Data Quality Control and Assurance · Quality assurance and Quality control Data contamination...
Transcript of Data Quality Control and Assurance · Quality assurance and Quality control Data contamination...
![Page 1: Data Quality Control and Assurance · Quality assurance and Quality control Data contamination Types of errors QA/QC best practices Before data collection During data collection/entry](https://reader034.fdocuments.in/reader034/viewer/2022042101/5e7e62c07c49154b0e466e25/html5/thumbnails/1.jpg)
DataQualityControlandAssuranceDataONECommunityEngagement&OutreachWorking
Group
![Page 2: Data Quality Control and Assurance · Quality assurance and Quality control Data contamination Types of errors QA/QC best practices Before data collection During data collection/entry](https://reader034.fdocuments.in/reader034/viewer/2022042101/5e7e62c07c49154b0e466e25/html5/thumbnails/2.jpg)
Definitions
QualityassuranceandQualitycontrolDatacontaminationTypesoferrors
QA/QCbestpractices
BeforedatacollectionDuringdatacollection/entryAfterdatacollection/entry
CCimagebycobalt123onFlickr
LessonTopics
![Page 3: Data Quality Control and Assurance · Quality assurance and Quality control Data contamination Types of errors QA/QC best practices Before data collection During data collection/entry](https://reader034.fdocuments.in/reader034/viewer/2022042101/5e7e62c07c49154b0e466e25/html5/thumbnails/3.jpg)
LearningObjectivesAftercompletingthislesson,theparticipantwillbeableto:
DefinedataqualitycontrolanddataqualityassurancePerformqualitycontrolandassuranceontheirdataatallstagesoftheresearchcycle
CCimageby0xFCAFonFlickr
![Page 4: Data Quality Control and Assurance · Quality assurance and Quality control Data contamination Types of errors QA/QC best practices Before data collection During data collection/entry](https://reader034.fdocuments.in/reader034/viewer/2022042101/5e7e62c07c49154b0e466e25/html5/thumbnails/4.jpg)
TheDataLifeCycle
DataONELifeCycle
![Page 5: Data Quality Control and Assurance · Quality assurance and Quality control Data contamination Types of errors QA/QC best practices Before data collection During data collection/entry](https://reader034.fdocuments.in/reader034/viewer/2022042101/5e7e62c07c49154b0e466e25/html5/thumbnails/5.jpg)
DefinitionsDataContamination:
Processorphenomenon,otherthantheoneofinterest,thataffectsthevariablevalueErroneousvalues
![Page 6: Data Quality Control and Assurance · Quality assurance and Quality control Data contamination Types of errors QA/QC best practices Before data collection During data collection/entry](https://reader034.fdocuments.in/reader034/viewer/2022042101/5e7e62c07c49154b0e466e25/html5/thumbnails/6.jpg)
Definitions:TypesofErrorsErrorsofCommission
IncorrectorinaccuratedataenteredExamples:malfunctioninginstrument,mistypeddataErrorsofOmissionDataormetadatanotrecordedExamples:inadequatedocumentation,humanerror,anomaliesinthefield
CCimagebyNickJWebbonFlickr
![Page 7: Data Quality Control and Assurance · Quality assurance and Quality control Data contamination Types of errors QA/QC best practices Before data collection During data collection/entry](https://reader034.fdocuments.in/reader034/viewer/2022042101/5e7e62c07c49154b0e466e25/html5/thumbnails/7.jpg)
DefiningQA/QCStrategiesforpreventingerrorsfromenteringadatasetActivitiestoensurequalityofdatabeforecollectionActivitiesthatinvolvemonitoringandmaintainingthequalityofdataduringthestudy
![Page 8: Data Quality Control and Assurance · Quality assurance and Quality control Data contamination Types of errors QA/QC best practices Before data collection During data collection/entry](https://reader034.fdocuments.in/reader034/viewer/2022042101/5e7e62c07c49154b0e466e25/html5/thumbnails/8.jpg)
QA/QCBeforeCollectionDefine&enforcestandards
FormatsCodesMeasurementunitsMetadataAssignresponsibilityfordataqualityBesureassignedpersoniseducatedinQA/QC
![Page 9: Data Quality Control and Assurance · Quality assurance and Quality control Data contamination Types of errors QA/QC best practices Before data collection During data collection/entry](https://reader034.fdocuments.in/reader034/viewer/2022042101/5e7e62c07c49154b0e466e25/html5/thumbnails/9.jpg)
QA/QCDuringDataEntryDoubleentry
DatakeyedinbytwoindependentpeopleCheckforagreementwithcomputerverification
RecordareadingofthedataandtranscribefromtherecordingUsetext-to-speechprogramtoreaddataback
CCimagebyweskrieselonFlickr
![Page 10: Data Quality Control and Assurance · Quality assurance and Quality control Data contamination Types of errors QA/QC best practices Before data collection During data collection/entry](https://reader034.fdocuments.in/reader034/viewer/2022042101/5e7e62c07c49154b0e466e25/html5/thumbnails/10.jpg)
QA/QCDuringDataEntryDesigndatastoragewell:
MinimizenumberoftimesitemsthatmustbeenteredrepeatedlyUseconsistentterminologyAtomizedata:onecellperpieceofinformationDocumentchangestodataAvoidsduplicateerrorcheckingAllowsundoifnecessary
![Page 11: Data Quality Control and Assurance · Quality assurance and Quality control Data contamination Types of errors QA/QC best practices Before data collection During data collection/entry](https://reader034.fdocuments.in/reader034/viewer/2022042101/5e7e62c07c49154b0e466e25/html5/thumbnails/11.jpg)
MakesuredatalineupinpropercolumnsNomissing,impossible,oranomalousvaluesPerformstatisticalsummaries
QA/QCAfterDataEntry
CCimagebycobalt123onFlickr
![Page 12: Data Quality Control and Assurance · Quality assurance and Quality control Data contamination Types of errors QA/QC best practices Before data collection During data collection/entry](https://reader034.fdocuments.in/reader034/viewer/2022042101/5e7e62c07c49154b0e466e25/html5/thumbnails/12.jpg)
QA/QCAfterDataEntryLookforoutliers:
OutliersareextremevaluesforavariablegiventhestatisticalmodelbeingusedThegoalisnottoeliminateoutliersbuttoidentifypotentialdatacontamination
![Page 13: Data Quality Control and Assurance · Quality assurance and Quality control Data contamination Types of errors QA/QC best practices Before data collection During data collection/entry](https://reader034.fdocuments.in/reader034/viewer/2022042101/5e7e62c07c49154b0e466e25/html5/thumbnails/13.jpg)
Methodstolookforoutliers
GraphicalNormalprobabilityplotsRegressionScatterplots
MapsSubtractvaluesfrommean
QA/QCAfterDataEntry
![Page 14: Data Quality Control and Assurance · Quality assurance and Quality control Data contamination Types of errors QA/QC best practices Before data collection During data collection/entry](https://reader034.fdocuments.in/reader034/viewer/2022042101/5e7e62c07c49154b0e466e25/html5/thumbnails/14.jpg)
SummaryDatacontaminationisdatathatresultsfromafactornotexaminedbythestudythatresultsinaltereddatavaluesDataerrortypes:commissionoromissionQualityassuranceandqualitycontrolarestrategiesfor
preventingerrorsfromenteringadatasetensuringdataqualityforentereddatamonitoring,andmaintainingdataqualitythroughouttheproject
IdentifyandenforcequalityassuranceandqualitycontrolmeasuresthroughouttheDataLifeCycle
![Page 15: Data Quality Control and Assurance · Quality assurance and Quality control Data contamination Types of errors QA/QC best practices Before data collection During data collection/entry](https://reader034.fdocuments.in/reader034/viewer/2022042101/5e7e62c07c49154b0e466e25/html5/thumbnails/15.jpg)
ResourcesD.Edwards,inEcologicalData:Design,ManagementandProcessing,WKMichenerandJWBrunt,Eds.(Blackwell,NewYork,2000),pp.70-91.Availableatwww.ecoinformatics.org/pubsR.B.Cook,R.J.Olson,P.Kanciruk,L.A.Hook,Bestpracticesforpreparingecologicaldatasetstoshareandarchive.Bull.Ecol.Soc.Amer.82,138-141(2001).A.D.Chapman,“PrinciplesofDataQuality:.ReportfortheGlobalBiodiversityInformationFacility”(GlobalBiodiversityInformationFacility,Copenhagen,2004).Availableathttp://www.gbif.org/communications/resources/print-and-online-resources/download-publications/bookelets/
![Page 16: Data Quality Control and Assurance · Quality assurance and Quality control Data contamination Types of errors QA/QC best practices Before data collection During data collection/entry](https://reader034.fdocuments.in/reader034/viewer/2022042101/5e7e62c07c49154b0e466e25/html5/thumbnails/16.jpg)
AboutParticipateinourGitHubrepo:https://dataoneorg.github.io/dataone_lessons/
Suggestedcitation:DataONEEducationModule:DataManagement.DataONE.RetrievedNovember12,2016.Fromhttp://www.dataone.org/sites/all/documents/L01_DataManagement.pptx
Copyrightlicenseinformation:Norightsreserved;youmayenhanceandreuseforyourownpurposes.WedoaskthatyouprovideappropriatecitationandattributiontoDataONE.