[SPARK-45814] ArrowConverters.createEmptyArrowBatch may cause memory leak - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Bug
Status: Resolved
Priority: Minor
Resolution: Fixed
Affects Version/s: 3.4.1, 3.5.0
Fix Version/s: 3.4.2, 4.0.0, 3.5.1
Component/s: Connect, SQL
Labels:
- pull-request-available

Description

ArrowConverters.createEmptyArrowBatch don't call hasNext, if TaskContext.get is None, then memory leak happens

Attachments

Issue Links

links to

GitHub Pull Request #43691

GitHub Pull Request #43728

Activity

People

Assignee:: xie shuiahu

Reporter:: xie shuiahu

Votes:: 0 Vote for this issue

Watchers:: 2 Start watching this issue

Dates

Created:: 07/Nov/23 01:43

Updated:: 20/Dec/23 10:03

Resolved:: 10/Nov/23 04:33