Cloud Era
If you can't read please download the document
-
Upload
charles-sanders -
Category
Documents
-
view
214 -
download
1
Transcript of Cloud Era
15/03/14 23:12:07 INFO mapred.JobClient: map 0% reduce 0%15/03/14 23:13:45 INFO mapred.JobClient: map 1% reduce 0%15/03/14 23:14:38 INFO mapred.JobClient: map 2% reduce 0%15/03/14 23:15:27 INFO mapred.JobClient: map 3% reduce 0%15/03/14 23:15:56 INFO mapred.JobClient: map 4% reduce 0%15/03/14 23:16:23 INFO mapred.JobClient: map 5% reduce 0%15/03/14 23:16:51 INFO mapred.JobClient: map 6% reduce 0%15/03/14 23:17:21 INFO mapred.JobClient: map 7% reduce 0%15/03/14 23:17:31 INFO mapred.JobClient: map 8% reduce 0%15/03/14 23:18:00 INFO mapred.JobClient: map 9% reduce 0%15/03/14 23:18:29 INFO mapred.JobClient: map 10% reduce 0%15/03/14 23:19:00 INFO mapred.JobClient: map 11% reduce 0%15/03/14 23:19:26 INFO mapred.JobClient: map 12% reduce 0%15/03/14 23:19:59 INFO mapred.JobClient: map 13% reduce 0%15/03/14 23:20:29 INFO mapred.JobClient: map 14% reduce 0%15/03/14 23:21:09 INFO mapred.JobClient: map 15% reduce 0%15/03/14 23:21:58 INFO mapred.JobClient: map 16% reduce 0%15/03/14 23:22:33 INFO mapred.JobClient: map 17% reduce 0%15/03/14 23:23:16 INFO mapred.JobClient: map 18% reduce 0%15/03/14 23:23:57 INFO mapred.JobClient: map 19% reduce 0%15/03/14 23:24:42 INFO mapred.JobClient: map 20% reduce 0%15/03/14 23:24:55 INFO mapred.JobClient: map 21% reduce 0%15/03/14 23:25:31 INFO mapred.JobClient: map 22% reduce 0%15/03/14 23:26:00 INFO mapred.JobClient: map 23% reduce 0%15/03/14 23:26:30 INFO mapred.JobClient: map 24% reduce 0%15/03/14 23:26:57 INFO mapred.JobClient: map 25% reduce 0%15/03/14 23:27:25 INFO mapred.JobClient: map 26% reduce 0%15/03/14 23:27:52 INFO mapred.JobClient: map 27% reduce 0%15/03/14 23:28:21 INFO mapred.JobClient: map 28% reduce 0%15/03/14 23:28:46 INFO mapred.JobClient: map 29% reduce 0%15/03/14 23:29:12 INFO mapred.JobClient: map 30% reduce 0%15/03/14 23:29:37 INFO mapred.JobClient: map 31% reduce 0%15/03/14 23:30:03 INFO mapred.JobClient: map 32% reduce 0%15/03/14 23:30:29 INFO mapred.JobClient: map 33% reduce 0%15/03/14 23:30:37 INFO mapred.JobClient: map 34% reduce 0%15/03/14 23:31:00 INFO mapred.JobClient: map 35% reduce 0%15/03/14 23:31:32 INFO mapred.JobClient: map 36% reduce 0%15/03/14 23:31:56 INFO mapred.JobClient: map 37% reduce 0%15/03/14 23:32:31 INFO mapred.JobClient: map 38% reduce 0%15/03/14 23:33:09 INFO mapred.JobClient: map 39% reduce 0%15/03/14 23:33:35 INFO mapred.JobClient: map 40% reduce 0%15/03/14 23:33:58 INFO mapred.JobClient: map 41% reduce 0%15/03/14 23:34:26 INFO mapred.JobClient: map 42% reduce 0%15/03/14 23:34:51 INFO mapred.JobClient: map 43% reduce 0%15/03/14 23:35:10 INFO mapred.JobClient: map 44% reduce 0%15/03/14 23:35:35 INFO mapred.JobClient: map 45% reduce 0%15/03/14 23:35:58 INFO mapred.JobClient: map 46% reduce 0%15/03/14 23:36:20 INFO mapred.JobClient: map 47% reduce 0%15/03/14 23:36:27 INFO mapred.JobClient: map 48% reduce 0%15/03/14 23:36:51 INFO mapred.JobClient: map 49% reduce 0%15/03/14 23:37:09 INFO mapred.JobClient: map 50% reduce 0%15/03/14 23:37:33 INFO mapred.JobClient: map 51% reduce 0%15/03/14 23:37:57 INFO mapred.JobClient: map 52% reduce 0%15/03/14 23:38:17 INFO mapred.JobClient: map 53% reduce 0%15/03/14 23:38:38 INFO mapred.JobClient: map 54% reduce 0%15/03/14 23:39:01 INFO mapred.JobClient: map 55% reduce 0%15/03/14 23:39:18 INFO mapred.JobClient: map 56% reduce 0%15/03/14 23:39:38 INFO mapred.JobClient: map 57% reduce 0%15/03/14 23:40:15 INFO mapred.JobClient: map 58% reduce 0%15/03/14 23:40:43 INFO mapred.JobClient: map 59% reduce 0%15/03/14 23:41:13 INFO mapred.JobClient: map 60% reduce 0%15/03/14 23:41:23 INFO mapred.JobClient: map 61% reduce 0%15/03/14 23:41:51 INFO mapred.JobClient: map 62% reduce 0%15/03/14 23:42:15 INFO mapred.JobClient: map 63% reduce 0%15/03/14 23:42:34 INFO mapred.JobClient: map 64% reduce 0%15/03/14 23:42:58 INFO mapred.JobClient: map 65% reduce 0%15/03/14 23:43:20 INFO mapred.JobClient: map 66% reduce 0%15/03/14 23:43:37 INFO mapred.JobClient: map 67% reduce 0%15/03/14 23:43:58 INFO mapred.JobClient: map 68% reduce 0%15/03/14 23:44:18 INFO mapred.JobClient: map 69% reduce 0%15/03/14 23:44:38 INFO mapred.JobClient: map 70% reduce 0%15/03/14 23:44:58 INFO mapred.JobClient: map 71% reduce 0%15/03/14 23:45:19 INFO mapred.JobClient: map 72% reduce 0%15/03/14 23:45:37 INFO mapred.JobClient: map 73% reduce 0%15/03/14 23:45:40 INFO mapred.JobClient: map 74% reduce 0%15/03/14 23:45:56 INFO mapred.JobClient: Task Id : attempt_201503142142_0001_m_000136_0, Status : FAILEDjava.lang.ArrayIndexOutOfBoundsException: 8at AvgTemperatureMapper.map(AvgTemperatureMapper.java:22)at AvgTemperatureMapper.map(AvgTemperatureMapper.java:1)at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:417)at org.apache.hadoop.mapred.MapTask.run(MapTask.java:332)at org.apache.hadoop.mapred.Child$4.run(Child.java:268)at java.security.AccessController.doPrivileged(Native Method)at javax.security.auth.Subject.doAs(Subject.java:396)at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1438)at org.apache.hadoop.mapred.Child.main(Child.java:262)attempt_201503142142_0001_m_000136_0: SLF4J: Class path contains multiple SLF4J bindings.attempt_201503142142_0001_m_000136_0: SLF4J: Found binding in [jar:file:/usr/lib/zookeeper/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]attempt_201503142142_0001_m_000136_0: SLF4J: Found binding in [jar:file:/mapred/local/taskTracker/cloudera/jobcache/job_201503142142_0001/jars/job.jar!/org/slf4j/impl/StaticLoggerBinder.class]attempt_201503142142_0001_m_000136_0: SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.15/03/14 23:45:59 INFO mapred.JobClient: Task Id : attempt_201503142142_0001_m_000137_0, Status : FAILEDjava.lang.ArrayIndexOutOfBoundsException: 8at AvgTemperatureMapper.map(AvgTemperatureMapper.java:22)at AvgTemperatureMapper.map(AvgTemperatureMapper.java:1)at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:417)at org.apache.hadoop.mapred.MapTask.run(MapTask.java:332)at org.apache.hadoop.mapred.Child$4.run(Child.java:268)at java.security.AccessController.doPrivileged(Native Method)at javax.security.auth.Subject.doAs(Subject.java:396)at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1438)at org.apache.hadoop.mapred.Child.main(Child.java:262)attempt_201503142142_0001_m_000137_0: SLF4J: Class path contains multiple SLF4J bindings.attempt_201503142142_0001_m_000137_0: SLF4J: Found binding in [jar:file:/usr/lib/zookeeper/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]attempt_201503142142_0001_m_000137_0: SLF4J: Found binding in [jar:file:/mapred/local/taskTracker/cloudera/jobcache/job_201503142142_0001/jars/job.jar!/org/slf4j/impl/StaticLoggerBinder.class]attempt_201503142142_0001_m_000137_0: SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.15/03/14 23:46:12 INFO mapred.JobClient: Task Id : attempt_201503142142_0001_m_000136_1, Status : FAILEDjava.lang.ArrayIndexOutOfBoundsException: 8at AvgTemperatureMapper.map(AvgTemperatureMapper.java:22)at AvgTemperatureMapper.map(AvgTemperatureMapper.java:1)at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:417)at org.apache.hadoop.mapred.MapTask.run(MapTask.java:332)at org.apache.hadoop.mapred.Child$4.run(Child.java:268)at java.security.AccessController.doPrivileged(Native Method)at javax.security.auth.Subject.doAs(Subject.java:396)at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1438)at org.apache.hadoop.mapred.Child.main(Child.java:262)attempt_201503142142_0001_m_000136_1: SLF4J: Class path contains multiple SLF4J bindings.attempt_201503142142_0001_m_000136_1: SLF4J: Found binding in [jar:file:/usr/lib/zookeeper/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]attempt_201503142142_0001_m_000136_1: SLF4J: Found binding in [jar:file:/mapred/local/taskTracker/cloudera/jobcache/job_201503142142_0001/jars/job.jar!/org/slf4j/impl/StaticLoggerBinder.class]attempt_201503142142_0001_m_000136_1: SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.15/03/14 23:46:13 INFO mapred.JobClient: Task Id : attempt_201503142142_0001_m_000137_1, Status : FAILEDjava.lang.ArrayIndexOutOfBoundsException: 8at AvgTemperatureMapper.map(AvgTemperatureMapper.java:22)at AvgTemperatureMapper.map(AvgTemperatureMapper.java:1)at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:417)at org.apache.hadoop.mapred.MapTask.run(MapTask.java:332)at org.apache.hadoop.mapred.Child$4.run(Child.java:268)at java.security.AccessController.doPrivileged(Native Method)at javax.security.auth.Subject.doAs(Subject.java:396)at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1438)at org.apache.hadoop.mapred.Child.main(Child.java:262)attempt_201503142142_0001_m_000137_1: SLF4J: Class path contains multiple SLF4J bindings.attempt_201503142142_0001_m_000137_1: SLF4J: Found binding in [jar:file:/usr/lib/zookeeper/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]attempt_201503142142_0001_m_000137_1: SLF4J: Found binding in [jar:file:/mapred/local/taskTracker/cloudera/jobcache/job_201503142142_0001/jars/job.jar!/org/slf4j/impl/StaticLoggerBinder.class]attempt_201503142142_0001_m_000137_1: SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.15/03/14 23:46:28 INFO mapred.JobClient: Task Id : attempt_201503142142_0001_m_000136_2, Status : FAILEDjava.lang.ArrayIndexOutOfBoundsException: 8at AvgTemperatureMapper.map(AvgTemperatureMapper.java:22)at AvgTemperatureMapper.map(AvgTemperatureMapper.java:1)at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:417)at org.apache.hadoop.mapred.MapTask.run(MapTask.java:332)at org.apache.hadoop.mapred.Child$4.run(Child.java:268)at java.security.AccessController.doPrivileged(Native Method)at javax.security.auth.Subject.doAs(Subject.java:396)at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1438)at org.apache.hadoop.mapred.Child.main(Child.java:262)attempt_201503142142_0001_m_000136_2: SLF4J: Class path contains multiple SLF4J bindings.attempt_201503142142_0001_m_000136_2: SLF4J: Found binding in [jar:file:/usr/lib/zookeeper/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]attempt_201503142142_0001_m_000136_2: SLF4J: Found binding in [jar:file:/mapred/local/taskTracker/cloudera/jobcache/job_201503142142_0001/jars/job.jar!/org/slf4j/impl/StaticLoggerBinder.class]attempt_201503142142_0001_m_000136_2: SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.15/03/14 23:46:29 INFO mapred.JobClient: Task Id : attempt_201503142142_0001_m_000137_2, Status : FAILEDjava.lang.ArrayIndexOutOfBoundsException: 8at AvgTemperatureMapper.map(AvgTemperatureMapper.java:22)at AvgTemperatureMapper.map(AvgTemperatureMapper.java:1)at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:417)at org.apache.hadoop.mapred.MapTask.run(MapTask.java:332)at org.apache.hadoop.mapred.Child$4.run(Child.java:268)at java.security.AccessController.doPrivileged(Native Method)at javax.security.auth.Subject.doAs(Subject.java:396)at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1438)at org.apache.hadoop.mapred.Child.main(Child.java:262)attempt_201503142142_0001_m_000137_2: SLF4J: Class path contains multiple SLF4J bindings.attempt_201503142142_0001_m_000137_2: SLF4J: Found binding in [jar:file:/usr/lib/zookeeper/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]attempt_201503142142_0001_m_000137_2: SLF4J: Found binding in [jar:file:/mapred/local/taskTracker/cloudera/jobcache/job_201503142142_0001/jars/job.jar!/org/slf4j/impl/StaticLoggerBinder.class]attempt_201503142142_0001_m_000137_2: SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.15/03/14 23:46:48 INFO mapred.JobClient: Job complete: job_201503142142_000115/03/14 23:46:49 INFO mapred.JobClient: Counters: 2915/03/14 23:46:50 INFO mapred.JobClient: File System Counters15/03/14 23:46:50 INFO mapred.JobClient: FILE: Number of bytes read=14369585315/03/14 23:46:50 INFO mapred.JobClient: FILE: Number of bytes written=30970104815/03/14 23:46:50 INFO mapred.JobClient: FILE: Number of read operations=015/03/14 23:46:50 INFO mapred.JobClient: FILE: Number of large read operations=015/03/14 23:46:50 INFO mapred.JobClient: FILE: Number of write operations=015/03/14 23:46:50 INFO mapred.JobClient: HDFS: Number of bytes read=1466697995015/03/14 23:46:50 INFO mapred.JobClient: HDFS: Number of bytes written=015/03/14 23:46:50 INFO mapred.JobClient: HDFS: Number of read operations=27515/03/14 23:46:50 INFO mapred.JobClient: HDFS: Number of large read operations=015/03/14 23:46:50 INFO mapred.JobClient: HDFS: Number of write operations=015/03/14 23:46:50 INFO mapred.JobClient: Job Counters 15/03/14 23:46:50 INFO mapred.JobClient: Failed map tasks=115/03/14 23:46:50 INFO mapred.JobClient: Launched map tasks=14415/03/14 23:46:50 INFO mapred.JobClient: Data-local map tasks=14415/03/14 23:46:50 INFO mapred.JobClient: Total time spent by all maps in occupied slots (ms)=407653415/03/14 23:46:50 INFO mapred.JobClient: Total time spent by all reduces in occupied slots (ms)=015/03/14 23:46:50 INFO mapred.JobClient: Total time spent by all maps waiting after reserving slots (ms)=015/03/14 23:46:50 INFO mapred.JobClient: Total time spent by all reduces waiting after reserving slots (ms)=015/03/14 23:46:50 INFO mapred.JobClient: Map-Reduce Framework15/03/14 23:46:50 INFO mapred.JobClient: Map input records=11223343615/03/14 23:46:50 INFO mapred.JobClient: Map output records=8262819015/03/14 23:46:50 INFO mapred.JobClient: Map output bytes=74365371015/03/14 23:46:50 INFO mapred.JobClient: Input split bytes=1781615/03/14 23:46:50 INFO mapred.JobClient: Combine input records=015/03/14 23:46:50 INFO mapred.JobClient: Combine output records=015/03/14 23:46:50 INFO mapred.JobClient: Spilled Records=16525638015/03/14 23:46:50 INFO mapred.JobClient: CPU time spent (ms)=51927015/03/14 23:46:50 INFO mapred.JobClient: Physical memory (bytes) snapshot=1991912243215/03/14 23:46:50 INFO mapred.JobClient: Virtual memory (bytes) snapshot=9067481907215/03/14 23:46:50 INFO mapred.JobClient: Total committed heap usage (bytes)=1294208204815/03/14 23:46:50 INFO mapred.JobClient: File Input Format Counters 15/03/14 23:46:50 INFO mapred.JobClient: Bytes Read=1466349107815/03/14 23:46:50 INFO mapred.JobClient: Job Failed: NAException in thread "main" java.io.IOException: Job failed!at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1416)at AvgTemperature.main(AvgTemperature.java:33)at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)at java.lang.reflect.Method.invoke(Method.java:597)at org.apache.hadoop.util.RunJar.main(RunJar.java:208)[cloudera@localhost ~]$ ^C[cloudera@localhost ~]$
