Big Data Hadoop Customize Training Course - A2Z IT Consulting Inc · 2019-03-03 · Big Data Hadoop...
Transcript of Big Data Hadoop Customize Training Course - A2Z IT Consulting Inc · 2019-03-03 · Big Data Hadoop...
A2ZITConsultingInc.Toronto,MississaugaON41SpringHillRoadMEUSA www.a2zitconsultinginc.com
BigDataHadoopCustomizeTrainingCourseOnsiteCorporate/IndividualTraining
A2ZITisafast-growingprofessionaltrainingproviderthatisofferingclassroomandonlinetraininginover20mostsought-aftertoolsandtechnologies.WehavealearnerbaseinCanadaandUSA.Wehelporganizationstomaximizetheimpactofourtrainingsbycustomizingthecurriculumtomakesurewecoverthetopicsrelevanttoyourgroup.Wehelpfastlearntheskillswithindayswhereityoucanstartapplyingthenewtoolsassoonaspossible.
KeyFeaturesofA2ZITTraining:
• InstructorLedClassroomTraining/Online/Selfstudy
Prerequisites:Youdon’tneedanyspecificknowledgetolearnBigdataHadoop.Abasicknowledgeofdatawarehouseknowledgecanhelp
Courseincludes:Thiscoursewillincludeextensivehands-onactivitiestore-enforcetheskillsandknowledgeattained.
BigdataHadoopCourseContentHADOOPINSTALLATIONVMLINK
HADOOPSINGLENODEINSTALLATION
INTRODUCTIONOFHADOOP
HADOOPUSECASES
HADOOPINTRODUCTION
HOWMAPREDUCEWORKS
HDFS(hadoopdistributedfilesystem)
AGGREGATINGDATA
HOWTOCODEMAPREDUCE
JOIN
HADOOPECOSYSTEM
SQOOP
HIVE
PIG
HADOOP-PROJECTWORK
A2ZITConsultingInc.Toronto,MississaugaON41SpringHillRoadMEUSA www.a2zitconsultinginc.com
MINIPROJECT–WORKINGWITHMAPREDUCE,HIVE,SQOOP
MAPREDUCE
INTRODUCTIONTOHDFS
INTRODUCTIONTOMAPREDUCE
INTRODUCTIONTOMAPREDUCE
WRITINGMAPREDUCEPROGRAMMEONHADOOPFRAMEWORK
DATAINTENSIVEINFORMATIONPROCESSING
HOWTOAGGREGATETHEDATA
PROBLEMSOLVINGWITHMAPREDUCE
MULTIPLEINPUTFORMATS
GRAPHPROBLEMSOLVING
MAPPER&REDUCER
MAPSIDEJOIN
REDUCEJOINS
MAPREDUCE-PROJECT,ASSIGNMENT
SQOOPIMPORT,EXPORTDATA
INVERTEDINDEXING
ENDTOENDMAPREDUCEYARNPOC
ASSIGNMENT–MAPREDUCE
MAPREDUCE
HIVE
WHATISTHEREQUIREMENTOFHIVE
INTRODUCTIONTOHIVE
HIVEINTERFACE
PARTITIONINHIVE
INDEXINGINHIVE
HIVEPREVIOUSVERSION
RELATIONALDATAANALYSISWITHHIVE
HIVEMANAGEMENT,OPTIMIZATIONANDEXTENDINGHIVE
HIVEINDEXES,VIEWS,FUNCTIONS,OPTIMIZINGQUERIES
HIVE-PROJECT,ASSIGNMENT
PROJECT–PARTITIONINGTABLES
A2ZITConsultingInc.Toronto,MississaugaON41SpringHillRoadMEUSA www.a2zitconsultinginc.com
ASSIGNMENT–HIVE
PIG
INTRODUCTIONTOPIG
WORKINGWITHPIG
OPERATORORSYNTAX
WORDCOUNTPROGRAMINPIG
WEATHERDATAANALYSISUSINGPIG
WEBLOGANALYSIS
USERDEFINEDFUNCTIONINPIG
DIAGNOSTICOPERATORINPIG
JSONWITHPIG
PIGINSTALLATIONCOMMAND
PIG-ASSIGNMENT
ASSIGNMENT–PIG
HBASE
PROJECTWORK-ETLPOC
PROJECTWORK–CONNECTINGPENTAHOWITHHADOOPECO-SYSTEM
IMPALAANDAVRO
INTRODUCTIONTOIMPALAANDMETADATACACHING
IMPALAMODELING
IMPALATABLES
IMPALAPARTITIONING
IMPALAANDAVROFILEFORMAT
SQOOPINGDATAINAVROFORMATANDUSINGITINIMPALA
IMPALA-PROJECT,ASSIGNMENT
USINGCOMPRESSION
HADOOPECOSYSTEM
SPARK
SPARKINTRODUCTION
SPARKCORECONCEPTS
A2ZITConsultingInc.Toronto,MississaugaON41SpringHillRoadMEUSA www.a2zitconsultinginc.com
SPARKINSTALLATION
SPARKENVIRONMENT
SPARKASSIGNMENT
OOZIE/FLUME/ZOOKEEPER/SQOOP
OOZIE
ZOOKEEPER
FLUME
SQOOP
OOZIE/FLUME/ZOOKEEPER/HUEPREVIOUSVERSION
OOZIE–INSTALLATIONANDHANDSONEXERCISES
ADVANCECONCEPTSINFLUME
DEEPDIVEINZOOKEEPER
DEEPDIVEINHUE
OOZIE/FLUME/ZOOKEEPER/HUE-ASSIGNMENT
FLUME,OOZIE,ZOOKEEPER,HUEASSIGNMENT
OOZIE/FLUME/ZOOKEEPER/HUEQUIZ
HADOOPADMINISTRATION
HDFSPARAMETERS
ADMINISTRATIONANDMAINTENANCE
DISTRIBUTIONMODE
KERBEROS
HADOOPADMINPREVIOUSVERSION
HADOOPADMINISTRATIONANDMAINTENANCE
HADOOPMONITORINGANDTROUBLESHOOTING
HADOOPJOBSCHEDULING
HADOOPJOBSCHEDULING–CONT.
HADOOPADMIN-PROJECTWORK
PROJECTWORK–MULTINODECLUSTERSETUP
HADOOPTESTING
BIGDATATESTING
SECURITYTESTING
SYSTEMTESTING
A2ZITConsultingInc.Toronto,MississaugaON41SpringHillRoadMEUSA www.a2zitconsultinginc.com
ROLESANDRESPONSBILITIESOFHADOOPTESTER
HDFSTESTPLAN
HADOOPTESTINGTECHNIQUES
INSTALLINGQUERYSURGE
CREATINGCOLUMNLEVELCOMPARISON
CREATINGTABLELEVELCOMPARISON,ROWCOUNTCOMPARISONANDSCHEDULING
HADOOPTESTING-PROJECT,ASSIGNMENT
HADOOPTESTINGPROJECT1
HADOOPTESTINGUSINGMRPROJECT2
ASSIGNMENT–HADOOPTESTING
PROJECTWORK,ASSIGNMENT
HADOOP–BIGDATASETSTOPRACTICE
HADOOP–ASSIGNMENT
HADOOPMAJORPROJECT
HADOOPARCHITECT
HIVEUDF
Tableau-BIBusinessIntelligenceToolForHadoopCourseContentFiltering,Sorting&Grouping-Filtering,SortingandGroupingarefundamentalconceptswhenworkingwithandanalyzingdata.WewillbrieflyreviewthesetopicsastheyapplytoTableau
• Advancedoptionsforfilteringandhiding
• Thevarioustypesoffiltersandhowandwheneachexecutesinsequence
• Datasecurityconsiderationsofspecificfilters
• Specificrecommendationsonhowtouse,ornottouse,variousfilteroptions
• Understandingyourmanyoptionsfororderingandgroupingyourdata:Sort,Groups,Bins,Sets
• Thevarioustypesofsetsandusecasesforeach
• Understandinghowtheseoptionsinter-relate
WorkingwithData–IntheFundamentalsclass,weacceptedthedataforwhatitis!(withabasicoverviewofblendingandjoiningdataandworkingwiththedataengine).IntheAdvancedclass,wewillunderstandthedifferencebetweenjoiningandblendingdata,andwhenweshoulddoeach.Wewillalsoconsidertheimplicationsofworkingwithlargedatasets,andconsideroptionsforwhenandhowtoworkwithextractsandthedataengine.Wewillalsoinvestigatebestpracticesin“sharing”datasourcesforTableauServerusers.
• WorkingwiththeDataEngine/Extractsandschedulingextractupdates
• WorkingwithCustomSQL
A2ZITConsultingInc.Toronto,MississaugaON41SpringHillRoadMEUSA www.a2zitconsultinginc.com
• AddingtoContext
• SwitchingtoDirectConnection
• BuildingmetadataviasharedDataSourceconnections
• Performanceconsideringandworkingwithbigdata
WorkingwithCalculatedDataandStatistics–IntheFundamentalsClass,wewereintroducedtosomebasiccalculations:basicstringandarithmeticcalculationsandratiosandquicktablecalculations.IntheAdvancedclass,wewillextendthoseconceptstounderstandtheintricaciesofmanipulatingdatawithinTableau
• AQuickReviewofBasicCalculations! ArithmeticCalculations
! StringManipulation
! DateCalculations! QuickTableCalculations! CustomAggregations
! CustomCalculatedFields
! LogicandConditionalCalculations! ConditionalFilters
• AdvancedTableCalculations! UnderstandingPartioningandAddressing! Differencesbetweenvisuallayoutofdataandresultsoftablecalculations! Approachesforunderstandingwhatishappeningintablecalculations! CalculateonResultsofTableCalculations! ComplexCalculations
! DifferencefromAverage
! SecondaryTableCalculations
• UnderstandingwhereCalculationsOccur
• Statistics! Reference/TrendLines! StatisticalCalculations! SummaryStats
! CohortAnalysis! MovingAverages
o Fromafixedpoint
o Inarollingwindow
• WorkingwithDatesandTimes
! ContinuousversusDiscreteDates
A2ZITConsultingInc.Toronto,MississaugaON41SpringHillRoadMEUSA www.a2zitconsultinginc.com
! DatesandTimes
! ReferenceDates
BuildingAdvancedChartTypesandVisualizations/Tips&Tricks–ThistopiccovershowtocreatesomeofthecharttypesandvisualizationsthatmaybelessobviousinTableau.Italsocoverssomeofthemorecommontips&tricks/techniquesthatweusetoassistcustomersinsolvingsomeoftheirmorecomplexproblems.
• ParetoChart
• SparkLine
• HorizonChart
BestPracticesinFormattingandVisualizing
• FormattingTips
! Highlighting! Labeling! Legends
• IntroductiontoVisualizationBestPractices
BuildingBetterDashboards–IntheFundamentalscourses,welearnedhowwecancombineseveralworksheetsinadashboardandpublishthattotheweb.IntheAdvancedcourse,wewilllearnhowtobuildeffectiveandinteractiveapplicationsviadashboarding.
• GuidedAnalytics! CascadingFilters! Highlighting! QuickfilterOptions! URLActions
Overview–WorkingwithTableauServer–InTableauFundamentals,wesawthatwecoulduseTableauServerasamechanismtoshareourvisualizationsanddashboards.Nowwewilldiginabitdeeper.
• PublishingtoTableauServer–Overviewofpublishing,scheduling&securityoptions
• TableauServerUsage–InteractingwithPublishedVisualizations
WrapUpActivities
• Summaryofwhatwehavelearned
• Advancedactivitiestopulltogetherandsolidifytheconcepts
WheretogetFurtherAssistance
• Forums
• Whitepapers&Books
• FurtherTrainingOfferings&ProfessionalServices
• TechnicalSupport