Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Duplicate
-
2.3.1
-
None
-
None
Description
MessageWithHeader transfer header and body if they are ByteBuf, in the case of fetch remote big block with greater than 'NIO_BUFFER_LIMIT', because of ChunkedByteBuffer#toNetty avoid consolidate, CompositeByteBuf.nioByteBuf will allocate from heap every times, lead to fetch timeout.
Attachments
Issue Links
- relates to
-
SPARK-21517 Fetch local data via block manager cause oom
- Resolved