Details
Description
If a user's map function is CPU intensive and doesn't read from the input very quickly, compounded by the buffering of input, then S3 might think the connection has been lost and will close the connection. Then when the user attempts to read from the input again, they'll receive a SocketTimeoutException and the task will fail.
Attachments
Attachments
Issue Links
- is related to
-
HADOOP-12844 Recover when S3A fails on IOException in read()
- Resolved