Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-9853 Remove spurious or irrelevant error messages from portable runner log output.
  3. BEAM-9082

"Socket closed" Spurious GRPC errors in Flink/Spark runner log output

    XMLWordPrintableJSON

Details

    Description

      We often see "Socket closed" errors on job shutdown, even though the pipeline has finished successfully. They are misleading and especially annoying at scale.

      ERROR:root:Failed to read inputs in the data plane.
      ...
      grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
      status = StatusCode.UNAVAILABLE
      details = "Socket closed"
      debug_error_string = "

      {"created":"@1578597616.309419460","description":"Error received from peer ipv6:[::1]:37211","file":"src/core/lib/surface/call.cc","file_line":1056,"grpc_message":"Socket closed","grpc_status":14}

      "

      Attachments

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. BEAM-3811 Add a CancellableQueue to make close methods safer

          • P3 - Non-urgent bugs, features, and improvements
          • Resolved
          relates to

          Sub-task - The sub-task of the issue BEAM-9793 Method not found: org.apache.beam.model.job_management.v1.ArtifactStagingService/ReverseArtifactRetrievalService

          • P3 - Non-urgent bugs, features, and improvements
          • Open

          Activity

            People

              Unassigned Unassigned
              ibzib Kyle Weaver
              Votes:
              2 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated: