Details
-
Bug
-
Status: Closed
-
Critical
-
Resolution: Duplicate
-
1.20.0
-
None
Description
Feb 07 09:40:16 09:40:16.314 [ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 29.58 s <<< FAILURE! -- in org.apache.flink.formats.protobuf.VeryBigPbProtoToRowTest Feb 07 09:40:16 09:40:16.314 [ERROR] org.apache.flink.formats.protobuf.VeryBigPbProtoToRowTest.testSimple -- Time elapsed: 29.57 s <<< ERROR! Feb 07 09:40:16 org.apache.flink.util.FlinkRuntimeException: Error in serialization. Feb 07 09:40:16 at org.apache.flink.streaming.api.graph.StreamingJobGraphGenerator.createJobGraph(StreamingJobGraphGenerator.java:327) Feb 07 09:40:16 at org.apache.flink.streaming.api.graph.StreamingJobGraphGenerator.createJobGraph(StreamingJobGraphGenerator.java:162) Feb 07 09:40:16 at org.apache.flink.streaming.api.graph.StreamGraph.getJobGraph(StreamGraph.java:1007) Feb 07 09:40:16 at org.apache.flink.client.StreamGraphTranslator.translateToJobGraph(StreamGraphTranslator.java:56) Feb 07 09:40:16 at org.apache.flink.client.FlinkPipelineTranslationUtil.getJobGraph(FlinkPipelineTranslationUtil.java:45) Feb 07 09:40:16 at org.apache.flink.client.deployment.executors.PipelineExecutorUtils.getJobGraph(PipelineExecutorUtils.java:61) Feb 07 09:40:16 at org.apache.flink.client.deployment.executors.LocalExecutor.getJobGraph(LocalExecutor.java:104) Feb 07 09:40:16 at org.apache.flink.client.deployment.executors.LocalExecutor.execute(LocalExecutor.java:81) Feb 07 09:40:16 at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.executeAsync(StreamExecutionEnvironment.java:2440) Feb 07 09:40:16 at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.executeAsync(StreamExecutionEnvironment.java:2421) Feb 07 09:40:16 at org.apache.flink.streaming.api.datastream.DataStream.executeAndCollectWithClient(DataStream.java:1495) Feb 07 09:40:16 at org.apache.flink.streaming.api.datastream.DataStream.executeAndCollect(DataStream.java:1382) Feb 07 09:40:16 at org.apache.flink.streaming.api.datastream.DataStream.executeAndCollect(DataStream.java:1367) Feb 07 09:40:16 at org.apache.flink.formats.protobuf.ProtobufTestHelper.validateRow(ProtobufTestHelper.java:66) Feb 07 09:40:16 at org.apache.flink.formats.protobuf.ProtobufTestHelper.pbBytesToRow(ProtobufTestHelper.java:121) Feb 07 09:40:16 at org.apache.flink.formats.protobuf.ProtobufTestHelper.pbBytesToRow(ProtobufTestHelper.java:103) Feb 07 09:40:16 at org.apache.flink.formats.protobuf.ProtobufTestHelper.pbBytesToRow(ProtobufTestHelper.java:98) Feb 07 09:40:16 at org.apache.flink.formats.protobuf.VeryBigPbProtoToRowTest.testSimple(VeryBigPbProtoToRowTest.java:36) Feb 07 09:40:16 at java.lang.reflect.Method.invoke(Method.java:498) Feb 07 09:40:16 Caused by: java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Java heap space Feb 07 09:40:16 at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357) Feb 07 09:40:16 at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908) Feb 07 09:40:16 at org.apache.flink.streaming.api.graph.StreamingJobGraphGenerator.createJobGraph(StreamingJobGraphGenerator.java:323) Feb 07 09:40:16 ... 18 more Feb 07 09:40:16 Caused by: java.lang.OutOfMemoryError: Java heap space Feb 07 09:40:16 at java.util.Arrays.copyOf(Arrays.java:3236) Feb 07 09:40:16 at java.io.ByteArrayOutputStream.toByteArray(ByteArrayOutputStream.java:191) Feb 07 09:40:16 at org.apache.flink.util.InstantiationUtil.serializeObject(InstantiationUtil.java:555) Feb 07 09:40:16 at org.apache.flink.util.InstantiationUtil.writeObjectToConfig(InstantiationUtil.java:486) Feb 07 09:40:16 at org.apache.flink.streaming.api.graph.StreamConfig.lambda$triggerSerializationAndReturnFuture$0(StreamConfig.java:182) Feb 07 09:40:16 at org.apache.flink.streaming.api.graph.StreamConfig$$Lambda$1582/1961611609.accept(Unknown Source) Feb 07 09:40:16 at java.util.concurrent.CompletableFuture.uniAccept(CompletableFuture.java:670) Feb 07 09:40:16 at java.util.concurrent.CompletableFuture$UniAccept.tryFire(CompletableFuture.java:646) Feb 07 09:40:16 at java.util.concurrent.CompletableFuture$Completion.run(CompletableFuture.java:456) Feb 07 09:40:16 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) Feb 07 09:40:16 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) Feb 07 09:40:16 at java.lang.Thread.run(Thread.java:748)
Attachments
Issue Links
- duplicates
-
FLINK-34403 VeryBigPbProtoToRowTest#testSimple cannot pass due to OOM
- Resolved
- is caused by
-
FLINK-33611 Support Large Protobuf Schemas
- Resolved