Details
-
Sub-task
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
-
None
Description
Currently the MutableVolumeSet has a periodic disk checker which runs every 15mins(fixed, not configurable), so it will be about serveral mins before datanode get the chance to detect bad disks.
As I found, datanode does not handle failure on the write path, we may have to introduce on-demand disk checks when io failure is hit(due to bad disks, etc).
By the way, hdfs has only a lazy on-demand disk checker:
https://blog.cloudera.com/hdfs-datanode-scanners-and-disk-checker-explained/
Attachments
Issue Links
- links to