Wednesday, February 12, 2014

Cloudera Manager 4.8.1 - Cluster Setup

Note: repeat step 1, 2, 3, 4 at all cluster nodes

1. Ubuntu

- install Ubuntu Server 12.04 64-bit
- Note: cloudera manager will use a lot of space of /var by default

2. Network interface

- sudo vi /etc/network/interfaces
- add network interface information
- example

auto eth0
iface eth0 inet static
gateway 10.10.10.1
address 10.10.10.10
netmask 255.255.255.0
dns-nameservers 168.126.63.1

3. User

- sudo vi /etc/sudoers
- change '%sudo   ALL=(ALL:ALL) ALL' to '%sudo   ALL=(ALL:ALL) NOPASSWD:ALL'

4. Hosts

- sudo vi /ets/hosts
- leave '127.0.0.1 localhost' and delete other information
- add cluster information
- example

10.10.10.10 hostname1
10.10.10.11 hostname2
10.10.10.12 hostname3

5. SSH

- cd
- ssh-keygen -t rsa
- cp .ssh/id_rsa.pub .ssh/authorized_keys
- scp .ssh/id_rsa.pub username@hostnameN:
- ssh hostnameN
- mkdir .ssh
- mv id_rsa.pub .ssh/authorized_keys

6. Cloudera Manager

- http://www.cloudera.com
- download cloudera-manager-installer.bin
- chmod u+x cloudera-manager-installer.bin
- sudo ./cloudera-manager-installer.bin
- http://hostname1:7180
- admin / admin
- add IP addresses of the cluster
- example

10.10.10.[10-12]

- choose 'Another User'

No comments:

Post a Comment

Note: Only a member of this blog may post a comment.