Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-18617

Close "kryo auto pick" feature for Spark Streaming

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.0.2
    • 2.0.3, 2.1.0
    • None
    • None

    Description

      PR-15992 provided a solution to fix the bug, i.e. receiver data can not be deserialized properly. As zsxwing said, it is a critical bug, but we should not break APIs between maintenance releases. It may be a rational choice to close auto pick kryo serializer for Spark Streaming in the first step.

      Attachments

        Issue Links

          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. SPARK-18560 Receiver data can not be dataSerialized properly.

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. SPARK-17766 Write ahead log exception on a toy project

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          links to

          Pull request #16052 [Github] Pull Request #16052 (uncleGen)

          Pull request #16091 [Github] Pull Request #16091 (zsxwing)

          Pull request #16096 [Github] Pull Request #16096 (uncleGen)

          Pull request #16105 [Github] Pull Request #16105 (zsxwing)

          Activity

            People

              uncleGen Genmao Yu
              uncleGen Genmao Yu
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: