Uploaded image for project: 'Usergrid (Retired)'
  1. Usergrid (Retired)
  2. USERGRID-1356

Make entity fetcher threads configurable for Export

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 2.2.0
    • 2.2.0
    • Stack
    • None

    Description

      The new export tool first fetches all Entity ids and as it fetches them, it starts parallel exports in batches of 1000.

      Depending on the data in each entity and the number and size of assets and members (connections etc), this process can take a long time. But as we can safely process it in parallel, we can increase the number of threads to make it faster (keeping resource utilization in mind).

      To do this, we need to add configs to set and tune fetcher thread counts.

       

      Attachments

        Activity

          People

            keyurkarnik Keyur Karnik
            keyurkarnik Keyur Karnik
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: