Uploaded image for project: 'Sqoop (Retired)'
  1. Sqoop (Retired)
  2. SQOOP-3010

Sqoop should not allow --as-parquetfile with hcatalog jobs or when hive import with create-hive-table is used

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.4.6
    • 1.4.7
    • None
    • None

    Description

      sqoop import ... --create-hcatalog-table --hcatalog-table --as-parquetfile

        Error: java.lang.RuntimeException: Should never be used
       	at org.apache.hadoop.hive.ql.io.parquet.MapredParquetOutputFormat.getRecordWriter(MapredParquetOutputFormat.java:76)
       	at org.apache.hive.hcatalog.mapreduce.FileOutputFormatContainer.getRecordWriter(FileOutputFormatContainer.java:103)

      This should not run and should display a validation error as it does for both --as-sequencefile and --as-avrodatafile but the job runs and fails later with RuntimeException

      Attachments

        Issue Links

          relates to

          Improvement - An improvement or enhancement to an existing feature or task. SQOOP-3046 Add support for (import + --hcatalog* + --as-parquetfile)

          • Major - Major loss of function.
          • Open
          links to

          Web Link GitHub Pull Request #28

          Web Link RB link

          Activity

            People

              sowmyaramesh Sowmya Ramesh
              sowmyaramesh Sowmya Ramesh
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: