HDP 2.4 Installation

• requirements
  • OS
    • ubuntu 14.04
      
    • centos 7.2
  • software
    • ubuntu 
      • apt
    • centos
      • yum, rpm
    • common
      • scp, curl, unzip, tar, wget, openSSL (v1.01, build 16 or later), python v2.6
  • Oracle JDK 1.8 64-bit (minimum JDK 1.8_60)
    • • http://mungeol-heo.blogspot.kr/2016/12/oracle-jdk-installation.html
• ulimit -Sn / ulimit -Hn
  
  • root
    • ulimit -n 65535
  • non-root user
    • vim /etc/security/limits.conf
    • <user name> soft nofile 65535
    • <user name> hard nofile 65535
• FQDN
  • /etc/hosts
  • hostname command
  • centos
    • vim /etc/sysconfig/network
    • NETWORKING=yes
    • HOSTNAME=test.com
  • ubuntu
    • /etc/hostname
• SSH
  • ssh-keygen
  • Copy the SSH Public Key (id_rsa.pub) to the root account on your target hosts
  • all node
    • cat id_rsa.pub >> ~/.ssh/authorized_keys
  • option
    
    • vim /etc/ssh/sshd_config
    • PermitRootLogin yes
    • centos
      • systemctl restart  sshd.service
    • ubuntu
      • service ssh restart
• NTP
  • ubuntu
    • apt-get -y install ntp
  • centos
    • yum -y install ntp
    • systemctl enable ntpd.service
    • systemctl start ntpd.service
• SELinux
  • vim /etc/selinux/config
  • if it is abled
    • set SELINUX=disabled
    • command: setenforce 0
    • shutdown -r now
• umask 
  • umask 
    • 0022 
  • if it is not 0022 
    • vim /etc/profile 
    • umask 022
• THP
  • temparary
    • echo never > /sys/kernel/mm/transparent_hugepage/defrag
    • echo never > /sys/kernel/mm/transparent_hugepage/enabled
  • permanent
    • append the following lines below into of /etc/rc.local

      if test -f /sys/kernel/mm/transparent_hugepage/enabled; then   echo never > /sys/kernel/mm/transparent_hugepage/enabled fi if test -f /sys/kernel/mm/transparent_hugepage/defrag; then    echo never > /sys/kernel/mm/transparent_hugepage/defrag fi

      
      
• permission (option) 
  • ambari 
    • /bin/hostname 
    • /usr/bin/sudo 
  • namenode 
    • /usr/bin/which 
    • /bin/ps 
    • /bin/df 
  • ambari metrics 
    • /usr/bin/gcc 
    • /usr/bin/ld 
    • /etc/centos-release 
  • yarn, MR2 
    • /tmp (check) 
      • /etc/fstab (default) 
      • /proc/mounts (current) 
      • mount -o remount,exec /tmp 
    • /usr/bin/curl 
  • knox 
    • /bin/netstat 
  • spark
    • /bin/ln
    • /bin/chmod
  • all 
    • centos
      • chmod 755 /bin/hostname /usr/bin/which /bin/ps /bin/df /usr/bin/gcc /usr/bin/ld /etc/centos-release /usr/bin/curl /bin/netstat /bin/ln /bin/chmod
        • chmod 4755 /usr/bin/sudo
    • ubuntu
      • chmod 755 /bin/hostname /usr/bin/which /bin/ps /bin/df /usr/bin/gcc /usr/bin/ld /etc/os-release /usr/bin/curl /bin/netstat /bin/ln /bin/chmod
        
      • chmod 4755 /usr/bin/sudo
• http://mungeol-heo.blogspot.kr/2016/12/ambari-2211-installation.html
• http://<your.ambari.server>:8080 -> admin / admin -> launch install wiizard -> cluster name -> install options -> confirm hosts -> choose services -> assgin masters -> assign slaves and clients -> customize services -> review -> install, start and test -> summary