Shulou(Shulou.com)06/03 Report--

Failed to execute the step 10 task during the build cube task because the kylin configuration did not have enough resources to execute the MR task

The task went on to step 10 and failed. Specific reason search

1. View Parameters

2. Check the MRJob log to find the problem

2017-03-16 15 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1484048632162_72188_r_000001_2: Container [pid=11851,containerID=container_1484048632162_72188_01_000170] is running beyond physical memory limits. Current usage: 1.1 GB of 1 GB physical memory used; 2.8 GB of 2.1 GB virtual memory used. Killing container. Dump of the process-tree for container_1484048632162_72188_01_000170:-PID PPID PGRPID SESSID CMD_NAME USER_MODE_TIME (MILLIS) SYSTEM_TIME (MILLIS) VMEM_USAGE (BYTES) RSSMEM_USAGE (PAGES) FULL_CMD_LINE |-11859 11851 11851 11851 (java) 20435 2125 2883371008 280614 / usr/local/jdk/bin/java-Djava.net.preferIPv4Stack=true-Dhadoop.metrics.log.level=WARN-Xmx768m-Djava.io.tmpdir=/hadoop/2/yarn/local/usercache/kylin/appcache/application_1484048632162 _ 72188/container_1484048632162_72188_01_000170/tmp-Dlog4j.configuration=container-log4j.properties-Dyarn.app.container.log.dir=/hadoop/6/yarn/logs/application_1484048632162_72188/container_1484048632162_72188_01_000170-Dyarn.app.container.log.filesize=0-Dhadoop.root.logger=INFO CLA-Dhadoop.root.logfile=syslog-Dyarn.app.mapreduce.shuffle.logger=INFO ShuffleCLA-Dyarn.app.mapreduce.shuffle.logfile=syslog.shuffle-Dyarn.app.mapreduce.shuffle.log.filesize=0-Dyarn.app.mapreduce.shuffle.log.backups=0 org.apache.hadoop.mapred.YarnChild 10.10.10.10 41607 attempt_1484048632162_72188_r_000001_2 170 |-11851 11849 11851 11851 (bash) 00 108625920 341 / bin/bash-c / usr/local/jdk/bin/java-Djava.net.preferIPv4Stack=true-Dhadoop.metrics.log.level=WARN-Xmx768m-Djava.io.tmpdir=/hadoop/ 2/yarn/local/usercache/kylin/appcache/application_1484048632162_72188/container_1484048632162_72188_01_000170/tmp-Dlog4j.configuration=container-log4j.properties-Dyarn.app.container.log.dir=/hadoop/6/yarn/logs/application_1484048632162_72188/container_1484048632162_72188_01_000170-Dyarn.app.container.log.filesize=0-Dhadoop.root.logger=INFO CLA-Dhadoop.root.logfile=syslog-Dyarn.app.mapreduce.shuffle.logger=INFO ShuffleCLA-Dyarn.app.mapreduce.shuffle.logfile=syslog.shuffle-Dyarn.app.mapreduce.shuffle.log.filesize=0-Dyarn.app.mapreduce.shuffle.log.backups=0 org.apache.hadoop.mapred.YarnChild 10.10.10.10 41607 attempt_1484048632162_72188_r_000001_2 1701 > / hadoop/6/yarn/logs/application_1484048632162_72188/container_1484048632162_72188_01_000170/stdout 2 > / hadoop/6/yarn/logs/application_1484048632162_72188/container_1484048632162_72188_01_000170/stderr Container killed on request. Exit code is 143 Container exited with a non-zero exit code 143

3. Modify the configuration file kylin_job_conf_inmem.xml and add

Mapreduce.reduce.memory.mb3096 the amount of memory required for each Reduce Task mapreduce.reduce.java.opts-Xmx3096mreduce task memory

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.