Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-6734

Add back HUDI-5409 in Hudi 0.12.x branch

    XMLWordPrintableJSON

Details

    Description

      Hudi 0.12.3 is more than 10x slow compared to Hudi 0.12.2 when reading large non-metadata partitioned table. The slowness was originally reported by https://github.com/apache/hudi/issues/6940 and fixed by HUDI-5409. However, HUDI-5409 is reverted by HUDI-5411 and I'm still seeing the slowness in Hudi 0.12.3.

      Attachments

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. HUDI-5411 Make sure Trino does not re-instantiates Hive's InputFormat for every partition during file listing

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          links to

          Web Link GitHub Pull Request #9567

          Activity

            People

              Unassigned Unassigned
              aajisaka Akira Ajisaka
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: