Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-31905

Add compatibility tests for streaming state store format

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.0.0
    • 3.1.0
    • Structured Streaming
    • None

    Description

      After SPARK-31894, we have a validation checking for the streaming state store. It's better to add integrated tests in the PR builder as soon as the breaking changes introduced.

      Attachments

        Issue Links

          is part of

          Bug - A problem which impairs or prevents the functions of the product. SPARK-31990 Streaming's state store compatibility is broken

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. SPARK-31894 Introduce UnsafeRow format validation for streaming state store

          • Major - Major loss of function.
          • Resolved
          links to

          Pull request #28725 [Github] Pull Request #28725 (xuanyuanking)

          Activity

            People

              XuanYuan Yuanjian Li
              XuanYuan Yuanjian Li
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: