Details
-
Bug
-
Status: Resolved
-
Critical
-
Resolution: Fixed
-
3.1.1
-
None
-
Configure:
<property>
<name>yarn.nodemanager.disk-validator</name>
<value>read-write</value>
</property>
Description
Application fails to execute successfully when ReadWriteDiskValidator is configured.
<property> <name>yarn.nodemanager.disk-validator</name> <value>read-write</value> </property>
Exception thrown while starting Container: java.io.IOException: org.apache.hadoop.util.DiskChecker$DiskErrorException: Disk Check failed! at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ContainerLocalizer.runLocalization(ContainerLocalizer.java:200) at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.startLocalizer(DefaultContainerExecutor.java:180) at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerRunner.run(ResourceLocalizationService.java:1233) Caused by: org.apache.hadoop.util.DiskChecker$DiskErrorException: Disk Check failed! at org.apache.hadoop.util.ReadWriteDiskValidator.checkStatus(ReadWriteDiskValidator.java:82) at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ContainerLocalizer.download(ContainerLocalizer.java:255) at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ContainerLocalizer.localizeFiles(ContainerLocalizer.java:312) at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ContainerLocalizer.runLocalization(ContainerLocalizer.java:198) ... 2 more Caused by: org.apache.hadoop.util.DiskChecker$DiskErrorException: /opt/HA/AN0805/nmlocal/usercache/dsperf/appcache/application_1557736108162_0009/filecache/11 is not a directory! at org.apache.hadoop.util.ReadWriteDiskValidator.checkStatus(ReadWriteDiskValidator.java:50)