Uploaded image for project: 'ORC'
  1. ORC
  2. ORC-162

Handle 0 byte files as empty ORC files

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 1.3.4, 1.4.1, 1.5.0
    • None
    • None

    Description

      Hive often creates empty files for empty buckets, which can introduce significant load on the HDFS cluster. Therefore, they made the Hive OrcOutputFormat and OrcInputFormat use 0 byte ORC files as a special case.

      We need to make the other readers treat them reasonably.

      Attachments

        Issue Links

          Activity

            People

              omalley Owen O'Malley
              omalley Owen O'Malley
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: