W/' · ,mkl pizip hexe jps[ perkyeki jsv i\tpsvmrk ziv] pevki hexewixw w/' z w ] p ] z ] p z r o À...

High level data flow language for exploring very large datasets. PIG Apache Pig is a high-level platform for creating programs that run on Apache Hadoop. The language for this platform is called Pig Latin. Pig can execute its Hadoop jobs in MapReduce, Apache Tez, or Apache Spark. Pig Latin abstracts the programming from the Java MapReduce idiom into a notation which makes MapReduce programming high level, similar to that of SQL for RDBMSs. Pig Latin can be extended using User Defined Functions (UDFs) which the user can write in Java, Python, JavaScript, Ruby or Groovy[2] and then call directly from the language. Apache Pig was originally developed at Yahoo Research around 2006 for researchers to have an ad-hoc way of creating and executing MapReduce jobs on very large data sets. In 2007, it was moved into the Apache Software Foundation.

Upload
others
Category

Documents
view
2
download
0

Embed Size (px):

Transcript of W/' · ,mkl pizip hexe jps[ perkyeki jsv i\tpsvmrk ziv] pevki hexewixw w/' z w ] p ] z ] p z r o À...

$Page 1: W/' · ,mkl pizip hexe jps[ perkyeki jsv i\tpsvmrk ziv] pevki hexewixw w/' z w ] p ] z ] p z r o À o o ( } u ( } ] v p } p u$

High level data flow language for exploring very large datasets.

PIG

Apache Pig is a high-level platform for creating programs that run on Apache Hadoop. The language for this platform is called Pig Latin. Pig can execute its Hadoopjobs in MapReduce, Apache Tez, or Apache Spark. Pig Latin abstracts the programming from the Java MapReduce idiom into a notation which makes MapReduce idiom into a notation which makes MapReduce programming high level, similar to that of SQL for RDBMSs. Pig Latin can be extended using User Defined Functions (UDFs) which the user can write in Java, Python, JavaScript, Ruby or Groovy[2] and then call directly from the language.

Apache Pig was originally developed at Yahoo Research around 2006 for researchers to have an ad-hoc way of creating and executing MapReduce jobs on very large data sets. In 2007, it was moved into the Apache Software Foundation.

$Page 2: W/' · ,mkl pizip hexe jps[ perkyeki jsv i\tpsvmrk ziv] pevki hexewixw w/' z w ] p ] z ] p z r o À o o ( } u ( } ] v p } p u$

Why use Pig

$Page 3: W/' · ,mkl pizip hexe jps[ perkyeki jsv i\tpsvmrk ziv] pevki hexewixw w/' z w ] p ] z ] p z r o À o o ( } u ( } ] v p } p u$

Pig is a powerful tool for querying data in a Hadoop cluster. It's so powerful that Yahoo! estimates that between 40% and 60% of its Hadoop workloads are generated from Pig Latin scripts. With 100,000 CPUs at Yahoo! and roughly 50% running Hadoop, that's a lot of pigs running around.

Pig Users

running Hadoop, that's a lot of pigs running around.

But Yahoo! isn't the only organization taking advantage of Pig. You'll find Pig at Twitter (processing logs, mining tweet data); t AOL and MapQuest (for analytics and batch data processing); and at LinkedIn, where Pig is used to discover people you might know.

Ebay is reportedly using Pig for search optimization, and adyard uses Pig in about half of its recommender system.

$Page 4: W/' · ,mkl pizip hexe jps[ perkyeki jsv i\tpsvmrk ziv] pevki hexewixw w/' z w ] p ] z ] p z r o À o o ( } u ( } ] v p } p u$

Where not to Use Pig

$Page 5: W/' · ,mkl pizip hexe jps[ perkyeki jsv i\tpsvmrk ziv] pevki hexewixw w/' z w ] p ] z ] p z r o À o o ( } u ( } ] v p } p u$

Apache Pig - Architecture

$Page 6: W/' · ,mkl pizip hexe jps[ perkyeki jsv i\tpsvmrk ziv] pevki hexewixw w/' z w ] p ] z ] p z r o À o o ( } u ( } ] v p } p u$

$Page 7: W/' · ,mkl pizip hexe jps[ perkyeki jsv i\tpsvmrk ziv] pevki hexewixw w/' z w ] p ] z ] p z r o À o o ( } u ( } ] v p } p u$

$Page 8: W/' · ,mkl pizip hexe jps[ perkyeki jsv i\tpsvmrk ziv] pevki hexewixw w/' z w ] p ] z ] p z r o À o o ( } u ( } ] v p } p u$

$Page 9: W/' · ,mkl pizip hexe jps[ perkyeki jsv i\tpsvmrk ziv] pevki hexewixw w/' z w ] p ] z ] p z r o À o o ( } u ( } ] v p } p u$

$Page 10: W/' · ,mkl pizip hexe jps[ perkyeki jsv i\tpsvmrk ziv] pevki hexewixw w/' z w ] p ] z ] p z r o À o o ( } u ( } ] v p } p u$

W Z ] o o Z ] , ] } ] o } u u ] ] } vW Z ] o o Z ] Z P ...

v ] µ W Z } } } µ ] / u P ] v P } ( Ç ] v } Z À o Z D Z v ] u } ( > ] u ... · 2019. 7. 18. · / v ] µ W Z } } } µ ] / u P ] v P } ( Ç ] v } Z À o Z D Z v ] u } ( > ] u

76$,'&/ , ] P Z } D Z ] v Çtsagros.org/pdf/HighCostMechinary.pdf · 2018. 5. 31. · Á ] Z W ï ð ð ì Ud Z Z ] v P µ u W P } } Z Ç U K À o o ] u v ] } v W > r ô ï ì ì

RD D B K B D P K D P D P W P P W H Z Z P W P W R D D R D B ... · d rd r b k z . d rd w p b b w p w

Z ó : À ] t ] P Z P í ì u l W À ] } µ z [ } W r Y µ ] } v v l

d P } W µ o ] ^ Z } } o t ] v P r í U E W ] o & } Ç U ^ Z ...

^ u Z } v W Z } } P Z Ç 2018 Smartphone... · ^ u Z } v W Z } } P Z Ç W v Ç E ] o ^ Z u ] ^ u Z } v W Z } } P Z Ç X X X o ] o l P } µ v X X X

K v ^ Z ] } Z µ o d Z u o o W W µ µ ] v P Z s ] ] } v ...

d o P u Z v v o r E Z ] } v v Æ u W & W P î

´ ò /c û xß H Q M P P P W - Ibaraki...z z z z z z z z ø b ó ê ' < þ ö ø 5 Hø ´ ò /c û xß H ËL ( J l Q M P P P W Ë> H Ñàâ ¿® Ã

Sani2C Adventure MTB 20180509 · 2020. 2. 5. · W z' W z íd z Ç íd z Ç îd z Ç ïd z' d u ·d uE u Z ] í Z ] î P } Ç í P } Ç îW z î í í ì ï W í ï W î ò ì ð

3DLQ RU 3ULYLOHJH · o v W Z Z [ o } Z i ^ Z } P ] v W ñ W ì ñ u i W ] l ] À } W Z î

Final 2020 OWSHS iPad Program Participants Agreement ......W W } P u t W µ Z P u v t z ó r õ U î ì î ì K u µ t } } ^ , ] P Z ^ Z } } o ]W W } P u î ì î ì r î ì î î

W> ^ WZ/Ed W ] v , ] } Ç Y µ ] } v v ] W Z } } z z z z z z ... · ,/W W ] À Ç W } o ] Ç / l v } Á o P Z u Ç u ] o Z ] } Ç u Ç } } v o ] v Z } µ P Z D o o Ç [ } u µ Ç

} } ( Z P v W } P u ] } v Z µ h v ] À ] Ç } ( o l W } } o } } Z v P W ... UAF...ï Xd Ç } ( W } P u W h v P µ ] ( ] } ] o µ Æ ... essential that the faculty retained to teach

v P Ç W ( } u v } v ~ W · 2020. 3. 13. · v P Ç W } i µ ] ] ] } v Z À ] Á ~ W Z ...

Z ^^/E' d ' W^ E Z/^< KDDhE/ d/KE /^^h ^ Z > d dK W& ^ /E ...€¦ · Z > d dK W& ^ /E Z/E

&/ sKd } P u W W } ] ] À ] u } v v ( ] ] Ç Z } µ Z } o < Ç ...€¦ · î n W P } Æ î W t Z ] Z Z } µ Z } o v ( ] ( } u Z &/ sKd } P u M d Z Z } µ Z } o o P } v v u µ } (

P v ] ^ Z } l o P } ] Z u v W v ] } v ^ / ^,K < r î ì í ô · >s W E í ô u u , P >s W E í ô u u Z P ^ ] P v ] ( ] v Ds l >D ] Z ] P Z Z Z ] Ì ] } v ... •Z h

$lakmefashionweek.co.inlakmefashionweek.co.in/assets/images/LFW SR 2017.pdfú À z d À W * 5 p À . W² þ ( þ p À ¸ Wú z þ ¸ Wú z \ þ * ò W W W W WÁ 5 W ( 5 þ * ò W þ$

lakmefashionweek.co.inlakmefashionweek.co.in/assets/images/LFW SR 2017.pdfú À z d À W * 5 p À . W² þ ( þ p À ¸ Wú z þ ¸ Wú z \ þ * ò W W W W WÁ 5 W ( 5 þ * ò W þ

W/' · ,mkl pizip hexe jps[ perkyeki jsv i\tpsvmrk ziv] pevki hexewixw w/' z w ] p ] z ] p z r o À...

Documents

Transcript of W/' · ,mkl pizip hexe jps[ perkyeki jsv i\tpsvmrk ziv] pevki hexewixw w/' z w ] p ] z ] p z r o À...