Unable to connect R rhdfs APIs with Hadoop Cluster, which is running on different IP address -
add hadoop home
sys.setenv("hadoop_home"="ssh://root@192.168.10.70/home/easy/hadoop") set hadoop cmd path
sys.setenv("hadoop_cmd"="ssh://root@192.168.10.70/home/easy/hadoop/bin/hadoop")
sys.setenv("java_home"="/usr/java/jdk1.7.0_67-cloudera") sys.setenv("hadoop_streaming"="ssh://root@192.168.10.70/home/easy/hadoop/share/hadoop/tools/lib/hadoop-streaming-2.6.0.jar") sys.setenv("hadoop_lib"="ssh://root@192.168.10.70/home/easy/hadoop/lib") load library rhdfs
library(rhdfs) initialize hdfs
hdfs.init()
Comments
Post a Comment