Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-12210

Perfomance degradation at High Load

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Duplicate
    • 7.2
    • None
    • Hadoop Integration
    • None

    Description

      When hdfsDataFactory is used and the incoming data stream is large, the rate of indexation is degraded. This is not a problem when using a local file system. I think the problem is in cleaning hdfsBlockCache. Because the degradation of the indexing rate occurs precisely when this cache reaches its maximum value. The basis for hdfsBlockCache is caffeine cache, but it is configured to clean only when the maximum size is reached. At the same time, nothing prevents using timeEviction, I suggest testing the indexing speed using this type of cache cleaning.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              rnazarenko ROMAN NAZARENKO
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: