Download - Big Data Hadoop Customize Training Course - A2Z IT Consulting Inc · 2019-03-03 · Big Data Hadoop Customize Training Course Onsite Corporate/Individual Training A2Z IT is a fast-growing

Transcript
Page 1: Big Data Hadoop Customize Training Course - A2Z IT Consulting Inc · 2019-03-03 · Big Data Hadoop Customize Training Course Onsite Corporate/Individual Training A2Z IT is a fast-growing

A2ZITConsultingInc.Toronto,MississaugaON41SpringHillRoadMEUSA www.a2zitconsultinginc.com

BigDataHadoopCustomizeTrainingCourseOnsiteCorporate/IndividualTraining

A2ZITisafast-growingprofessionaltrainingproviderthatisofferingclassroomandonlinetraininginover20mostsought-aftertoolsandtechnologies.WehavealearnerbaseinCanadaandUSA.Wehelporganizationstomaximizetheimpactofourtrainingsbycustomizingthecurriculumtomakesurewecoverthetopicsrelevanttoyourgroup.Wehelpfastlearntheskillswithindayswhereityoucanstartapplyingthenewtoolsassoonaspossible.

KeyFeaturesofA2ZITTraining:

• InstructorLedClassroomTraining/Online/Selfstudy

Prerequisites:Youdon’tneedanyspecificknowledgetolearnBigdataHadoop.Abasicknowledgeofdatawarehouseknowledgecanhelp

Courseincludes:Thiscoursewillincludeextensivehands-onactivitiestore-enforcetheskillsandknowledgeattained.

BigdataHadoopCourseContentHADOOPINSTALLATIONVMLINK

HADOOPSINGLENODEINSTALLATION

INTRODUCTIONOFHADOOP

HADOOPUSECASES

HADOOPINTRODUCTION

HOWMAPREDUCEWORKS

HDFS(hadoopdistributedfilesystem)

AGGREGATINGDATA

HOWTOCODEMAPREDUCE

JOIN

HADOOPECOSYSTEM

SQOOP

HIVE

PIG

HADOOP-PROJECTWORK

Page 2: Big Data Hadoop Customize Training Course - A2Z IT Consulting Inc · 2019-03-03 · Big Data Hadoop Customize Training Course Onsite Corporate/Individual Training A2Z IT is a fast-growing

A2ZITConsultingInc.Toronto,MississaugaON41SpringHillRoadMEUSA www.a2zitconsultinginc.com

MINIPROJECT–WORKINGWITHMAPREDUCE,HIVE,SQOOP

MAPREDUCE

INTRODUCTIONTOHDFS

INTRODUCTIONTOMAPREDUCE

INTRODUCTIONTOMAPREDUCE

WRITINGMAPREDUCEPROGRAMMEONHADOOPFRAMEWORK

DATAINTENSIVEINFORMATIONPROCESSING

HOWTOAGGREGATETHEDATA

PROBLEMSOLVINGWITHMAPREDUCE

MULTIPLEINPUTFORMATS

GRAPHPROBLEMSOLVING

MAPPER&REDUCER

MAPSIDEJOIN

REDUCEJOINS

MAPREDUCE-PROJECT,ASSIGNMENT

SQOOPIMPORT,EXPORTDATA

INVERTEDINDEXING

ENDTOENDMAPREDUCEYARNPOC

ASSIGNMENT–MAPREDUCE

MAPREDUCE

HIVE

WHATISTHEREQUIREMENTOFHIVE

INTRODUCTIONTOHIVE

HIVEINTERFACE

PARTITIONINHIVE

INDEXINGINHIVE

HIVEPREVIOUSVERSION

RELATIONALDATAANALYSISWITHHIVE

HIVEMANAGEMENT,OPTIMIZATIONANDEXTENDINGHIVE

HIVEINDEXES,VIEWS,FUNCTIONS,OPTIMIZINGQUERIES

HIVE-PROJECT,ASSIGNMENT

PROJECT–PARTITIONINGTABLES

Page 3: Big Data Hadoop Customize Training Course - A2Z IT Consulting Inc · 2019-03-03 · Big Data Hadoop Customize Training Course Onsite Corporate/Individual Training A2Z IT is a fast-growing

A2ZITConsultingInc.Toronto,MississaugaON41SpringHillRoadMEUSA www.a2zitconsultinginc.com

ASSIGNMENT–HIVE

PIG

INTRODUCTIONTOPIG

WORKINGWITHPIG

OPERATORORSYNTAX

WORDCOUNTPROGRAMINPIG

WEATHERDATAANALYSISUSINGPIG

WEBLOGANALYSIS

USERDEFINEDFUNCTIONINPIG

DIAGNOSTICOPERATORINPIG

JSONWITHPIG

PIGINSTALLATIONCOMMAND

PIG-ASSIGNMENT

ASSIGNMENT–PIG

HBASE

PROJECTWORK-ETLPOC

PROJECTWORK–CONNECTINGPENTAHOWITHHADOOPECO-SYSTEM

IMPALAANDAVRO

INTRODUCTIONTOIMPALAANDMETADATACACHING

IMPALAMODELING

IMPALATABLES

IMPALAPARTITIONING

IMPALAANDAVROFILEFORMAT

SQOOPINGDATAINAVROFORMATANDUSINGITINIMPALA

IMPALA-PROJECT,ASSIGNMENT

USINGCOMPRESSION

HADOOPECOSYSTEM

SPARK

SPARKINTRODUCTION

SPARKCORECONCEPTS

Page 4: Big Data Hadoop Customize Training Course - A2Z IT Consulting Inc · 2019-03-03 · Big Data Hadoop Customize Training Course Onsite Corporate/Individual Training A2Z IT is a fast-growing

A2ZITConsultingInc.Toronto,MississaugaON41SpringHillRoadMEUSA www.a2zitconsultinginc.com

SPARKINSTALLATION

SPARKENVIRONMENT

SPARKASSIGNMENT

OOZIE/FLUME/ZOOKEEPER/SQOOP

OOZIE

ZOOKEEPER

FLUME

SQOOP

OOZIE/FLUME/ZOOKEEPER/HUEPREVIOUSVERSION

OOZIE–INSTALLATIONANDHANDSONEXERCISES

ADVANCECONCEPTSINFLUME

DEEPDIVEINZOOKEEPER

DEEPDIVEINHUE

OOZIE/FLUME/ZOOKEEPER/HUE-ASSIGNMENT

FLUME,OOZIE,ZOOKEEPER,HUEASSIGNMENT

OOZIE/FLUME/ZOOKEEPER/HUEQUIZ

HADOOPADMINISTRATION

HDFSPARAMETERS

ADMINISTRATIONANDMAINTENANCE

DISTRIBUTIONMODE

KERBEROS

HADOOPADMINPREVIOUSVERSION

HADOOPADMINISTRATIONANDMAINTENANCE

HADOOPMONITORINGANDTROUBLESHOOTING

HADOOPJOBSCHEDULING

HADOOPJOBSCHEDULING–CONT.

HADOOPADMIN-PROJECTWORK

PROJECTWORK–MULTINODECLUSTERSETUP

HADOOPTESTING

BIGDATATESTING

SECURITYTESTING

SYSTEMTESTING

Page 5: Big Data Hadoop Customize Training Course - A2Z IT Consulting Inc · 2019-03-03 · Big Data Hadoop Customize Training Course Onsite Corporate/Individual Training A2Z IT is a fast-growing

A2ZITConsultingInc.Toronto,MississaugaON41SpringHillRoadMEUSA www.a2zitconsultinginc.com

ROLESANDRESPONSBILITIESOFHADOOPTESTER

HDFSTESTPLAN

HADOOPTESTINGTECHNIQUES

INSTALLINGQUERYSURGE

CREATINGCOLUMNLEVELCOMPARISON

CREATINGTABLELEVELCOMPARISON,ROWCOUNTCOMPARISONANDSCHEDULING

HADOOPTESTING-PROJECT,ASSIGNMENT

HADOOPTESTINGPROJECT1

HADOOPTESTINGUSINGMRPROJECT2

ASSIGNMENT–HADOOPTESTING

PROJECTWORK,ASSIGNMENT

HADOOP–BIGDATASETSTOPRACTICE

HADOOP–ASSIGNMENT

HADOOPMAJORPROJECT

HADOOPARCHITECT

HIVEUDF

Tableau-BIBusinessIntelligenceToolForHadoopCourseContentFiltering,Sorting&Grouping-Filtering,SortingandGroupingarefundamentalconceptswhenworkingwithandanalyzingdata.WewillbrieflyreviewthesetopicsastheyapplytoTableau

• Advancedoptionsforfilteringandhiding

• Thevarioustypesoffiltersandhowandwheneachexecutesinsequence

• Datasecurityconsiderationsofspecificfilters

• Specificrecommendationsonhowtouse,ornottouse,variousfilteroptions

• Understandingyourmanyoptionsfororderingandgroupingyourdata:Sort,Groups,Bins,Sets

• Thevarioustypesofsetsandusecasesforeach

• Understandinghowtheseoptionsinter-relate

WorkingwithData–IntheFundamentalsclass,weacceptedthedataforwhatitis!(withabasicoverviewofblendingandjoiningdataandworkingwiththedataengine).IntheAdvancedclass,wewillunderstandthedifferencebetweenjoiningandblendingdata,andwhenweshoulddoeach.Wewillalsoconsidertheimplicationsofworkingwithlargedatasets,andconsideroptionsforwhenandhowtoworkwithextractsandthedataengine.Wewillalsoinvestigatebestpracticesin“sharing”datasourcesforTableauServerusers.

• WorkingwiththeDataEngine/Extractsandschedulingextractupdates

• WorkingwithCustomSQL

Page 6: Big Data Hadoop Customize Training Course - A2Z IT Consulting Inc · 2019-03-03 · Big Data Hadoop Customize Training Course Onsite Corporate/Individual Training A2Z IT is a fast-growing

A2ZITConsultingInc.Toronto,MississaugaON41SpringHillRoadMEUSA www.a2zitconsultinginc.com

• AddingtoContext

• SwitchingtoDirectConnection

• BuildingmetadataviasharedDataSourceconnections

• Performanceconsideringandworkingwithbigdata

WorkingwithCalculatedDataandStatistics–IntheFundamentalsClass,wewereintroducedtosomebasiccalculations:basicstringandarithmeticcalculationsandratiosandquicktablecalculations.IntheAdvancedclass,wewillextendthoseconceptstounderstandtheintricaciesofmanipulatingdatawithinTableau

• AQuickReviewofBasicCalculations! ArithmeticCalculations

! StringManipulation

! DateCalculations! QuickTableCalculations! CustomAggregations

! CustomCalculatedFields

! LogicandConditionalCalculations! ConditionalFilters

• AdvancedTableCalculations! UnderstandingPartioningandAddressing! Differencesbetweenvisuallayoutofdataandresultsoftablecalculations! Approachesforunderstandingwhatishappeningintablecalculations! CalculateonResultsofTableCalculations! ComplexCalculations

! DifferencefromAverage

! SecondaryTableCalculations

• UnderstandingwhereCalculationsOccur

• Statistics! Reference/TrendLines! StatisticalCalculations! SummaryStats

! CohortAnalysis! MovingAverages

o Fromafixedpoint

o Inarollingwindow

• WorkingwithDatesandTimes

! ContinuousversusDiscreteDates

Page 7: Big Data Hadoop Customize Training Course - A2Z IT Consulting Inc · 2019-03-03 · Big Data Hadoop Customize Training Course Onsite Corporate/Individual Training A2Z IT is a fast-growing

A2ZITConsultingInc.Toronto,MississaugaON41SpringHillRoadMEUSA www.a2zitconsultinginc.com

! DatesandTimes

! ReferenceDates

BuildingAdvancedChartTypesandVisualizations/Tips&Tricks–ThistopiccovershowtocreatesomeofthecharttypesandvisualizationsthatmaybelessobviousinTableau.Italsocoverssomeofthemorecommontips&tricks/techniquesthatweusetoassistcustomersinsolvingsomeoftheirmorecomplexproblems.

• ParetoChart

• SparkLine

• HorizonChart

BestPracticesinFormattingandVisualizing

• FormattingTips

! Highlighting! Labeling! Legends

• IntroductiontoVisualizationBestPractices

BuildingBetterDashboards–IntheFundamentalscourses,welearnedhowwecancombineseveralworksheetsinadashboardandpublishthattotheweb.IntheAdvancedcourse,wewilllearnhowtobuildeffectiveandinteractiveapplicationsviadashboarding.

• GuidedAnalytics! CascadingFilters! Highlighting! QuickfilterOptions! URLActions

Overview–WorkingwithTableauServer–InTableauFundamentals,wesawthatwecoulduseTableauServerasamechanismtoshareourvisualizationsanddashboards.Nowwewilldiginabitdeeper.

• PublishingtoTableauServer–Overviewofpublishing,scheduling&securityoptions

• TableauServerUsage–InteractingwithPublishedVisualizations

WrapUpActivities

• Summaryofwhatwehavelearned

• Advancedactivitiestopulltogetherandsolidifytheconcepts

WheretogetFurtherAssistance

• Forums

• Whitepapers&Books

• FurtherTrainingOfferings&ProfessionalServices

• TechnicalSupport