HDP 2.3 installation

1. software requirements
   1. yum, rpm, scp, curl, unzip, tar, wget, OpenSSL v1.01, build 16 or later), python v2.6
   2. option
      1. chmod 755 /usr/bin/yum /bin/rpm /usr/bin/scp /usr/bin/curl /usr/bin/unzip /bin/tar /usr/bin/wget /usr/bin/ssh /usr/bin/python
2. check java version
   1. Oracle JDK 1.8 64-bit (minimum JDK 1.8_40) (default)
   2. Oracle JDK 1.7 64-bit (minimum JDK 1.7_67)
   3. OpenJDK 8 64-bit
   4. OpenJDK 7 64-bit
3. ulimit -Sn / ulimit -Hn
   1. 65535
4. configure FQDN at /etc/hosts, /etc/sysconfig/networks and using hostname command
5. set up password-less SSH
   1. ssh-keygen
   2. Copy the SSH Public Key (id_rsa.pub) to the root account on your target hosts
      1. option
         1. vim /etc/ssh/sshd_config
         2. PermitRootLogin yes
         3. service sshd restart
         4. vim /etc/ssh/sshd_config
   3. all hosts
      1. cat id_rsa.pub >> ~/.ssh/authorized_keys
   4. option
      1. chmod 700 ~/.ssh 
      2. chmod 600 ~/.ssh/authorized_keys
6. NTP yum -y install sudo (option)
   1. yum -y install ntp
   2. chkconfig ntpd on
   3. service ntpd start
7. SELinux
   1. vim /etc/selinux/config
   2. if it is abled
      1. set SELINUX=disabled
      2. command: setenforce 0
   3. if PackageKit is installed
      1. vim /etc/yum/pluginconf.d/refresh-packagekit.conf
      2. enabled=0
8. umask
   1. umask
      1. 0022
   2. if it is not 0022
      1. vim /etc/profile
      2. umask 022
9. THP
   1. check
      1. cat /sys/kernel/mm/redhat_transparent_hugepage/defrag
      2. cat /sys/kernel/mm/redhat_transparent_hugepage/enabled
   2. command and /etc/rc.local
      1. echo never > /sys/kernel/mm/redhat_transparent_hugepage/enabled
      2. echo never > /sys/kernel/mm/redhat_transparent_hugepage/defrag
10. permission (option)
    1. ambari
       1. /bin/hostname
       2. /usr/bin/sudo
    2. namenode
       1. /usr/bin/which
       2. /bin/ps
       3. /bin/df
    3. ambari metrics
       1. /usr/bin/gcc
       2. /usr/bin/ld
       3. /etc/centos-release
    4. yarn, MR2
       1. /tmp (check)
          1. /etc/fstab (default)
          2. /proc/mounts (current)
          3. mount -o remount,exec /tmp
       2. /usr/bin/curl
    5. knox
       1. /bin/netstat
    6. all
       1. chmod 755 /bin/hostname /usr/bin/sudo /usr/bin/which /bin/ps /bin/df /usr/bin/gcc /usr/bin/ld /etc/centos-release /usr/bin/curl /bin/netstat
11. Install ambari 2.1.0 using non-default databases (HDP)
1. http://mungeol-heo.blogspot.kr/2015/11/install-mariadb-httpmungeol-heo.html
12. http://<your.ambari.server>:8080 -> admin / admin -> launch install wiizard -> cluster name -> HDP 2.3 -> install options -> confirm hosts -> choose servicesl -> assgin masters -> assign slaves and clients -> customize services -> review -> install, start and test -> summary