[FLINK-14569] use flink to deal with batch task,when parallelism granter than 1, always 1 or 2 records loss - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Bug
Status: Open
Priority: Not a Priority
Resolution: Unresolved
Affects Version/s: 1.7.2
Fix Version/s: None
Component/s: API / DataSet
Labels:
Environment:

hadoop:2.8.5

flink: 1.7.1

node machines: 3

deploy: yarn

Description

when flink read from hdfs file and set the parallelism>1, occasionally， 1 or 2 records lose, however the hdfs file bigger or smaller.

Attachments

Activity

People

Assignee:: Unassigned

Reporter:: kk

Votes:: 0 Vote for this issue

Watchers:: 3 Start watching this issue

Dates

Created:: 30/Oct/19 08:15

Updated:: 20/Dec/21 10:39