Distcp between two HA enabled hadoop

• Only command
  • hadoop distcp \
    -Ddfs.nameservices=hadoop1,hadoop2 \
    -Ddfs.internal.nameservices=hadoop1 \
    -Ddfs.client.failover.proxy.provider.hadoop1=org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider \
    -Ddfs.client.failover.proxy.provider.hadoop2=org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider \
    -Ddfs.ha.namenodes.hadoop1=nn1,nn2 \
    -Ddfs.ha.namenodes.hadoop2=nn1,nn2 \
    -Ddfs.namenode.rpc-address.hadoop1.nn1=hadoop1-nn1:8020 \
    -Ddfs.namenode.rpc-address.hadoop1.nn2=hadoop1-nn2:8020 \
    -Ddfs.namenode.rpc-address.hadoop2.nn1=hadoop2-nn1:8020 \
    -Ddfs.namenode.rpc-address.hadoop2.nn2=hadoop2-nn2:8020 \
    -m 90 hdfs://hadoop1/testhdfs://hadoop2/test
• Other
  • https://community.hortonworks.com/content/supportkb/48732/how-to-run-distcp-between-two-hdfs-ha-clusters-usi.html
  • http://henning.kropponline.de/2015/03/15/distcp-two-ha-cluster/
• Option
  • –strategy dynamic