install apache hadoop cluster cdh4 cloudera on digitalocean Part 2

Share it with your friends Like

Thanks! Share it with your friends!

Close

install apache hadoop cluster cdh4 cloudera on digitalocean

Hello Friends My Name is Mohit Talpara and To’day i am Showing You How To install apache hadoop cluster cdh4 cloudera digitalocean

we choose digitalocean because his Provided Kvm Virtualization, Shared Private Networking, ECC Ram and RAID SSD storage and Tier-1 Bandwidth All servers come with 1Gb/sec so its best configration for Clusters and is chepest then other provider so we always say to used digitalocean for Cluster Stability.

Now First You Need To Creat Some Node in Digitalocean Control Panel and Setup DNS For Eatch one .

in my Tutorial i am used 4 Droplets with 1GB Memory and 30GB Disk Space and setup host name for eatch one

so now i have 4 Droplets with this host name

node1.datatube.co.in 192.241.162.77
node2.datatube.co.in 162.243.80.11
node3.datatube.co.in 162.243.81.68
node4.datatube.co.in 162.243.82.23

now Chabged Password Of All Node And Created New Same Password For All Users Because in cloudera Setup i will choose root password authentication option

now Fisrt Login In To All Droplets Using SSH

And Update Yum Using This Command

yum -y install perl openssh-clients

Now Edit Host File For Add All Cluster Nodes Please Note Its My Configration You Need To Add Your Own Host Domain Name.

Edit Host File using This Command
nano /etc/hosts

And Add This Config in host file please note do not delete any existing host just add new host

192.241.162.77 node1.datatube.co.in n1
162.243.80.11 node2.datatube.co.in n2
162.243.81.68 node3.datatube.co.in n3
162.243.82.23 node4.datatube.co.in n4

Now Edit /etc/resolv.conf File Using This Command.[It is use to configure client side access to the Internet Domain Name System (DNS). This file defines which name servers to use.]

nano /etc/resolv.conf

Now Delete All Data in file and Add This Data

search datatube.co.in
nameserver 8.8.8.8

Now Edit Network using This Commands

nano /etc/sysconfig/network

Delete All Config and Add this Following Config [Please Not in this config HOSTNAME= is Your server(drop) Host Name So change with your Server Host Name]

NETWORKING=yes
HOSTNAME=node1.datatube.co.in
GATEWAY=8.8.8.8

Now Edit selinux Configration using This Command
nano /etc/selinux/config

And See In This File this option SELINUX is disabled
SELINUX=disabled

Now Check Your Iptables off

chkconfig iptables off

Now Edit Yum Config Disable For fastestmirror checking.So edit fastestmirror.conf file using this Commandline

nano /etc/yum/pluginconf.d/fastestmirror.conf

edit in config file enabled=1 to enabled=0

enabled=0

And After Restart The Network using This Command

/etc/init.d/network restart

now edit ssh config file For Stop To Check Hostkey using This Command
nano /etc/ssh/ssh_config

edit in Config File StricHostkeyChecking no

StricHostkeyChecking no

now All Node Is Ready For Install Cloudera manager So just install in only main node using This Command

wget http://archive.cloudera.com/cm4/insta…

chmod +x cloudera-manager-

Comments

Write a comment

*