Hi all,
I have setup a 3-node cluster (1 namenode, 2 datanode).
I was trying to run Arabesque like this:
./run_arabesque.sh cluster.yaml cliques.yaml
in cluster.yaml I changed num_workers to 2.
I got this output, wihch I don't understand:
...
3343 [main] INFO org.apache.giraph.job.GiraphJob - Waiting for resources... Job will start only when it gets all 3 mappers
2019-10-24 23:24:11,775 INFO mapreduce.Job: Running job: job_1571961586402_0007
13874 [main] INFO org.apache.hadoop.mapreduce.Job - Running job: job_1571961586402_0007
2019-10-24 23:24:11,783 INFO mapreduce.Job: Job job_1571961586402_0007 running in uber mode : false
13882 [main] INFO org.apache.hadoop.mapreduce.Job - Job job_1571961586402_0007 running in uber mode : false
2019-10-24 23:24:11,786 INFO mapreduce.Job: map 0% reduce 0%
13885 [main] INFO org.apache.hadoop.mapreduce.Job - map 0% reduce 0%
2019-10-24 23:24:11,807 INFO mapreduce.Job: Job job_1571961586402_0007 failed with state FAILED due to: Application application_1571961586402_0007 failed 2 times due to AM Container for appattempt_1571961586402_0007_000002 exited with exitCode: 1
Failing this attempt.Diagnostics: [2019-10-24 23:24:11.725]Exception from container-launch.
Container id: container_1571961586402_0007_02_000001
Exit code: 1
[2019-10-24 23:24:11.731]Container exited with a non-zero exit code 1. Error file: prelaunch.err.
Last 4096 bytes of prelaunch.err :
Last 4096 bytes of stderr :
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/hadoop-xchen/nm-local-dir/usercache/xchen/appcache/application_1571961586402_0007/filecache/11/job.jar/job.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/workspace/hadoop-3.2.0/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
log4j:WARN No appenders could be found for logger (org.apache.hadoop.mapreduce.v2.app.MRAppMaster).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
...
full output is attached.
No error in the hadoop logs.
Any idea?
output-example.txt
Hi all,
I have setup a 3-node cluster (1 namenode, 2 datanode).
I was trying to run Arabesque like this:
./run_arabesque.sh cluster.yaml cliques.yaml
in cluster.yaml I changed num_workers to 2.
I got this output, wihch I don't understand:
...
3343 [main] INFO org.apache.giraph.job.GiraphJob - Waiting for resources... Job will start only when it gets all 3 mappers
2019-10-24 23:24:11,775 INFO mapreduce.Job: Running job: job_1571961586402_0007
13874 [main] INFO org.apache.hadoop.mapreduce.Job - Running job: job_1571961586402_0007
2019-10-24 23:24:11,783 INFO mapreduce.Job: Job job_1571961586402_0007 running in uber mode : false
13882 [main] INFO org.apache.hadoop.mapreduce.Job - Job job_1571961586402_0007 running in uber mode : false
2019-10-24 23:24:11,786 INFO mapreduce.Job: map 0% reduce 0%
13885 [main] INFO org.apache.hadoop.mapreduce.Job - map 0% reduce 0%
2019-10-24 23:24:11,807 INFO mapreduce.Job: Job job_1571961586402_0007 failed with state FAILED due to: Application application_1571961586402_0007 failed 2 times due to AM Container for appattempt_1571961586402_0007_000002 exited with exitCode: 1
Failing this attempt.Diagnostics: [2019-10-24 23:24:11.725]Exception from container-launch.
Container id: container_1571961586402_0007_02_000001
Exit code: 1
[2019-10-24 23:24:11.731]Container exited with a non-zero exit code 1. Error file: prelaunch.err.
Last 4096 bytes of prelaunch.err :
Last 4096 bytes of stderr :
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/hadoop-xchen/nm-local-dir/usercache/xchen/appcache/application_1571961586402_0007/filecache/11/job.jar/job.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/workspace/hadoop-3.2.0/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
log4j:WARN No appenders could be found for logger (org.apache.hadoop.mapreduce.v2.app.MRAppMaster).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
...
full output is attached.
No error in the hadoop logs.
Any idea?
output-example.txt