Installing 9.6 BDE binaries on hadoop data nodes Snapshots captured from Cloudera sandbox.
-
Upload
conrad-benson -
Category
Documents
-
view
225 -
download
0
description
Transcript of Installing 9.6 BDE binaries on hadoop data nodes Snapshots captured from Cloudera sandbox.
Installing 9.6 BDE binarieson hadoop data nodes
Snapshots captured from Cloudera sandbox
2
Installation on Single node
3
1. Run Installer
Login as root and run the installer script as shown above. You can also run this
script as ‘sudo’
4
2. Choose Installation type
Login as root and run the installer script as shown above. You can also run this
script as ‘sudo’
5
3. Install completes
6
Uninstallation
7
1. Run Installer
Login as root and run the installer script as shown above. You can also run this
script as ‘sudo’
8
2. Choose Uninstallation
9
3. Choose local/remote. Installer completes
10
Installation on remote nodesIncomplete section
11
1. Run Installer
Login as root and run the installer script as shown above. You can also run this
script as ‘sudo’
12
2. Choose installation on remote nodes
13
3. Invoking from name node ?
14
4. Provide hadoop installation path
15
DIS ConfigurationPost installation activity
16
Configure DIS properties in DIS Processes
17
Hadoop node setupPost installation activity
18
Check the map reduce site XML
19
Check for mapreduce.admin.map.child.java.opts
if this parameter is present, remove the -Djava.library.path Java option from it
20
Modify it to be the following
infapdo.java.opts=-Xmx512M -XX:GCTimeRatio=34
-XX:+UseConcMarkSweepGC -XX:+UseParNewGC -
XX:ParallelGCThreads=2 -XX:NewRatio=2 -
Djava.library.path=$HADOOP_NODE_INFA_HOME/serv
ices/shared/bin:$HADOOP_NODE_HADOOP_DIST/lib/
*:$HADOOP_NODE_HADOOP_DIST/lib/native/Linux-
amd64-64:/usr/lib/hadoop/lib/native/:/mylib/ -
Djava.security.egd=file:/dev/./urandom
21
Edit hive-site.xml
Edit the file <BDE directory>/Informatica/services/shared/hadoop/ <Hadoop_distribution_name>/conf/hive-site.xml