Uploaded image for project: 'Parquet'
  1. Parquet
  2. PARQUET-354

Question on parquet-protobuf and parquet-pig

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 1.8.0
    • None
    • parquet-mr

    Description

      Hi,

      I have a question about protobuf to parquet conversion.
      I have a message like this (simplified) :

       
      message MyMessage {
        repeated string language = 1;
      }
      

      parquet-protobuf convert it to the following schema :

      message MyMessage {
        repeated binary language (UTF8);
      }
      

      But, according to TestPigSchameConverter.java, the correct schema should be :

      message MyMessage {
        optional group language (LIST) {
          repeated binary value (UTF8);
        }
      }
      

      Language is an optional list of language, i want to store zero or more language.

      Who have the correct schema for my case ? parquet-protobuf or parquet-pig ?

      Attachments

        Activity

          People

            Unassigned Unassigned
            cnguyen@nextperf.com Christian Nguyen Van Than
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: