Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-1510

Move HoodieEngineContext to hudi-common module

    XMLWordPrintableJSON

Details

    Description

      We want to parallelize file system listings in Hudi, which after RFC-15 implementation will be happening through class FileSystemBackedMetadata which is in hudi-common. Same with FSUtils which sits in hudi-common. Thus, we want to move HoodieEngineContext to hudi-common to be able to parallelize the file/partition listing APIs using the engine.

      Attachments

        Issue Links

          is a child of

          Task - A task that needs to be done. HUDI-1479 Replace FSUtils.getAllPartitionPaths() with HoodieTableMetadata#getAllPartitionPaths()

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved
          links to

          Web Link GitHub Pull Request #2410

          Activity

            People

              uditme Udit Mehrotra
              uditme Udit Mehrotra
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: