Uploaded image for project: 'Parquet'
  1. Parquet
  2. PARQUET-1717

parquet-thrift converts Thrift i16 to parquet INT32 instead of INT_16

    XMLWordPrintableJSON

Details

    Description

      Currently when converting Thrift to Parquet, the ThriftSchemaConverter will convert a i16 thrift data type as a INT32 Parquet data type even if the logical type INT(16, false) would be more representative, especially for downstream consumers of the parquet files.

      Using the logical data type requires a change in this method:

       @Override
        public ConvertedField visit(I16Type i16Type, State state) {
          return visitPrimitiveType(INT32, state);
        }
      

      from the ThriftSchemaConvertVisitor

      Attachments

        Issue Links

          Activity

            People

              ebrard Emmanuel Brard
              ebrard Emmanuel Brard
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: