Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-1847

Add ability to decouple configs for scheduling inline and running async

    XMLWordPrintableJSON

Details

    • 1

    Description

      Currently, there are 2 ways to enable compaction:

       

      1. Inline - This will schedule compaction inline and execute inline
      2. Async - This option is only available for HoodieDeltaStreamer based jobs. This turns on scheduling inline and running async as part of the same spark job.

       

      Users need a config to be able to schedule only inline while having an ability to execute in their own spark job

      Attachments

        Issue Links

          Activity

            People

              shivnarayan sivabalan narayanan
              nishith29 Nishith Agarwal
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - 3h Original Estimate - 3h
                  3h
                  Remaining:
                  Time Spent - 3h Remaining Estimate - 2h
                  2h
                  Logged:
                  Time Spent - 3h Remaining Estimate - 2h
                  3h