Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-28152

Replace scala.util.parsing.json with org.json4s.jackson which used in Spark too

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • connector-1.0.0
    • hbase-connectors-1.0.1
    • spark
    • None

    Description

      In https://issues.apache.org/jira/browse/HBASE-28137 to support Spark 3.4 the scala-parser-combinators was added as direct dependency to HBase Spark Connector.

      This was needed as Spark 3.4 is not using scala-parser-combinators and it is not inherited as transitive dependency.

      But this solution has a disadvantage. As the HBase Spark Connector assembly jar does not include any 3rd party libraries the scala-parser-combinators must be added to the spark classpath for HBase Spark Connector to work.

      A much better solution is to replace scala.util.parsing.json with org.json4s.jackson which is used by Spark core, see https://github.com/apache/spark/blob/branch-3.4/core/pom.xml#L279-L280.

      Attachments

        Issue Links

          Activity

            People

              attilapiros Attila Zsolt Piros
              attilapiros Attila Zsolt Piros
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: