the code is working fine at my local machine. but, I am getting an error while running in EMR cluster. could you please help to resolve the issue.
Exception: org.apache.hadoop.security.AccessControlException: Permission denied: user=hive, access=WRITE, inode="/":hdfs:hadoop:drwxr-xr-x
below is my code snippet
val df = ss.read.format("csv").
format("com.springml.spark.sftp").
option("delimiter", "|").
option("host", FTP_Host).
option("username", FTP_Username).
option("password", FTP_Password).
option("fileType", "csv").
option("inferSchema", "true").
option("encoding","UTF-8").
load(FTP_File_Path_final)
the code is working fine at my local machine. but, I am getting an error while running in EMR cluster. could you please help to resolve the issue.
Exception: org.apache.hadoop.security.AccessControlException: Permission denied: user=hive, access=WRITE, inode="/":hdfs:hadoop:drwxr-xr-x
below is my code snippet
val df = ss.read.format("csv").
format("com.springml.spark.sftp").
option("delimiter", "|").
option("host", FTP_Host).
option("username", FTP_Username).
option("password", FTP_Password).
option("fileType", "csv").
option("inferSchema", "true").
option("encoding","UTF-8").
load(FTP_File_Path_final)