Unable to connect R rhdfs APIs with Hadoop Cluster, which is running on different IP address -


add hadoop home

sys.setenv("hadoop_home"="ssh://root@192.168.10.70/home/easy/hadoop") 

set hadoop cmd path

sys.setenv("hadoop_cmd"="ssh://root@192.168.10.70/home/easy/hadoop/bin/hadoop")

sys.setenv("java_home"="/usr/java/jdk1.7.0_67-cloudera")  sys.setenv("hadoop_streaming"="ssh://root@192.168.10.70/home/easy/hadoop/share/hadoop/tools/lib/hadoop-streaming-2.6.0.jar")  sys.setenv("hadoop_lib"="ssh://root@192.168.10.70/home/easy/hadoop/lib") 

load library rhdfs

library(rhdfs) 

initialize hdfs

hdfs.init() 


Comments

Popular posts from this blog

javascript - jQuery: Add class depending on URL in the best way -

caching - How to check if a url path exists in the service worker cache -

Redirect to a HTTPS version using .htaccess -