Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-9500

Support nested structs over 24 levels.

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 1.2.0
    • None

    Description

      Customer has deeply nested avro structure and is receiving the following error when performing queries.

      15/01/09 20:59:29 ERROR ql.Driver: FAILED: SemanticException org.apache.hadoop.hive.serde2.SerDeException: Number of levels of nesting supported for LazySimpleSerde is 23 Unable to work with level 24
      Currently we support up to 24 levels of nested structs when hive.serialization.extend.nesting.levels is set to true, while the customers have the requirement to support more than that.

      It would be better to make the supported levels configurable or completely removed (i.e., we can support any number of levels).

      Attachments

        1. HIVE-9500.1.patch
          88 kB
          Aihua Xu
        2. HIVE-9500.2.patch
          392 kB
          Aihua Xu
        3. HIVE-9500.3.patch
          406 kB
          Aihua Xu
        4. HIVE-9500.4.patch
          409 kB
          Aihua Xu
        5. TClass.java
          3 kB
          Thejas Nair

        Issue Links

          Activity

            People

              aihuaxu Aihua Xu
              aihuaxu Aihua Xu
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: