Unable to connect R rhdfs APIs with Hadoop Cluster, which is running on different IP address -
add hadoop home
sys.setenv("hadoop_home"="ssh://root@192.168.10.70/home/easy/hadoop")
set hadoop cmd path
sys.setenv("hadoop_cmd"="ssh://root@192.168.10.70/home/easy/hadoop/bin/hadoop"
)
sys.setenv("java_home"="/usr/java/jdk1.7.0_67-cloudera") sys.setenv("hadoop_streaming"="ssh://root@192.168.10.70/home/easy/hadoop/share/hadoop/tools/lib/hadoop-streaming-2.6.0.jar") sys.setenv("hadoop_lib"="ssh://root@192.168.10.70/home/easy/hadoop/lib")
load library rhdfs
library(rhdfs)
initialize hdfs
hdfs.init()
Comments
Post a Comment