Cannot run program "Rscript": error=2, No such file or directory

Question

Cannot run program "Rscript": error=2, No such file or directory

babumathew opened this issue 10 years ago · comments

I have Rscript available and accessible. Still getting this error.. Any insights?

14/05/15 15:03:14 WARN streaming.StreamJob: -file option is deprecated, please use generic option -files instead.
packageJobJar: [/tmp/RtmpiK9HPB/rmr-local-env5ec9554c124f, /tmp/RtmpiK9HPB/rmr-global-env5ec97c89861a, /tmp/RtmpiK9HPB/rmr-streaming-map5ec93fde38ef] [/opt/cloudera/parcels/CDH-5.0.0-0.cdh5b2.p0.27/lib/hadoop-mapreduce/hadoop-streaming-2.2.0-cdh5.0.0-beta-2.jar] /tmp/streamjob8029066543835906592.jar tmpDir=null
14/05/15 15:03:15 INFO client.RMProxy: Connecting to ResourceManager at HadoopS.dbstraining.local/192.168.100.40:8032
14/05/15 15:03:15 INFO client.RMProxy: Connecting to ResourceManager at HadoopS.dbstraining.local/192.168.100.40:8032
14/05/15 15:03:16 INFO mapred.FileInputFormat: Total input paths to process : 1
14/05/15 15:03:16 INFO mapreduce.JobSubmitter: number of splits:2
14/05/15 15:03:16 INFO Configuration.deprecation: mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
14/05/15 15:03:16 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1395320373286_0038
14/05/15 15:03:16 INFO impl.YarnClientImpl: Submitted application application_1395320373286_0038
14/05/15 15:03:16 INFO mapreduce.Job: The url to track the job: http://HadoopS.dbstraining.local:8088/proxy/application_1395320373286_0038/
14/05/15 15:03:16 INFO mapreduce.Job: Running job: job_1395320373286_0038
14/05/15 15:03:22 INFO mapreduce.Job: Job job_1395320373286_0038 running in uber mode : false
14/05/15 15:03:22 INFO mapreduce.Job: map 0% reduce 0%
14/05/15 15:03:26 INFO mapreduce.Job: Task Id : attempt_1395320373286_0038_m_000001_0, Status : FAILED
Error: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:109)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:75)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:133)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:426)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:342)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:165)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:160)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:106)
... 9 more
Caused by: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:109)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:75)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:133)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:38)
... 14 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:106)
... 17 more
Caused by: java.lang.RuntimeException: configuration exception
at org.apache.hadoop.streaming.PipeMapRed.configure(PipeMapRed.java:222)
at org.apache.hadoop.streaming.PipeMapper.configure(PipeMapper.java:66)
... 22 more
Caused by: java.io.IOException: Cannot run program "Rscript": error=2, No such file or directory
at java.lang.ProcessBuilder.start(ProcessBuilder.java:1041)
at org.apache.hadoop.streaming.PipeMapRed.configure(PipeMapRed.java:209)
... 23 more
Caused by: java.io.IOException: error=2, No such file or directory
at java.lang.UNIXProcess.forkAndExec(Native Method)
at java.lang.UNIXProcess.(UNIXProcess.java:135)
at java.lang.ProcessImpl.start(ProcessImpl.java:130)
at java.lang.ProcessBuilder.start(ProcessBuilder.java:1022)
... 24 more

Antonio Piccolboni · Answer 1 · Fri May 16 2014 04:10:43 GMT+0800 (China Standard Time)

Please resubmit to the rmr2 issue tracker. Thanks

On Thu, May 15, 2014 at 1:07 PM, babumathew notifications@github.comwrote:

I have Rscript available and accessible. Still getting this error.. Any
insights?

14/05/15 15:03:14 WARN streaming.StreamJob: -file option is deprecated,
please use generic option -files instead.
packageJobJar: [/tmp/RtmpiK9HPB/rmr-local-env5ec9554c124f,
/tmp/RtmpiK9HPB/rmr-global-env5ec97c89861a,
/tmp/RtmpiK9HPB/rmr-streaming-map5ec93fde38ef]
[/opt/cloudera/parcels/CDH-5.0.0-0.cdh5b2.p0.27/lib/hadoop-mapreduce/hadoop-streaming-2.2.0-cdh5.0.0-beta-2.jar]
/tmp/streamjob8029066543835906592.jar tmpDir=null
14/05/15 15:03:15 INFO client.RMProxy: Connecting to ResourceManager at
HadoopS.dbstraining.local/192.168.100.40:8032
14/05/15 15:03:15 INFO client.RMProxy: Connecting to ResourceManager at
HadoopS.dbstraining.local/192.168.100.40:8032
14/05/15 15:03:16 INFO mapred.FileInputFormat: Total input paths to
process : 1
14/05/15 15:03:16 INFO mapreduce.JobSubmitter: number of splits:2
14/05/15 15:03:16 INFO Configuration.deprecation: mapred.reduce.tasks is
deprecated. Instead, use mapreduce.job.reduces
14/05/15 15:03:16 INFO mapreduce.JobSubmitter: Submitting tokens for job:
job_1395320373286_0038
14/05/15 15:03:16 INFO impl.YarnClientImpl: Submitted application
application_1395320373286_0038
14/05/15 15:03:16 INFO mapreduce.Job: The url to track the job:
http://HadoopS.dbstraining.local:8088/proxy/application_1395320373286_0038/
14/05/15 15:03:16 INFO mapreduce.Job: Running job: job_1395320373286_0038
14/05/15 15:03:22 INFO mapreduce.Job: Job job_1395320373286_0038 running
in uber mode : false
14/05/15 15:03:22 INFO mapreduce.Job: map 0% reduce 0%
14/05/15 15:03:26 INFO mapreduce.Job: Task Id :
attempt_1395320373286_0038_m_000001_0, Status : FAILED
Error: java.lang.RuntimeException: Error in configuring object
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:109)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:75)
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:133)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:426)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:342)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:165)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:160)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:106)
... 9 more
Caused by: java.lang.RuntimeException: Error in configuring object
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:109)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:75)
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:133)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:38)
... 14 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:106)
... 17 more
Caused by: java.lang.RuntimeException: configuration exception
at org.apache.hadoop.streaming.PipeMapRed.configure(PipeMapRed.java:222)
at org.apache.hadoop.streaming.PipeMapper.configure(PipeMapper.java:66)
... 22 more
Caused by: java.io.IOException: Cannot run program "Rscript": error=2, No
such file or directory
at java.lang.ProcessBuilder.start(ProcessBuilder.java:1041)
at org.apache.hadoop.streaming.PipeMapRed.configure(PipeMapRed.java:209)
... 23 more
Caused by: java.io.IOException: error=2, No such file or directory
at java.lang.UNIXProcess.forkAndExec(Native Method)
at java.lang.UNIXProcess.(UNIXProcess.java:135)
at java.lang.ProcessImpl.start(ProcessImpl.java:130)
at java.lang.ProcessBuilder.start(ProcessBuilder.java:1022)
... 24 more

—
Reply to this email directly or view it on GitHubhttps://github.com//issues/207
.

EndCho · Answer 2 · Thu Nov 15 2018 15:04:38 GMT+0800 (China Standard Time)

Where is the program "Rscript"? I can not find it.