Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-9599

DocValues performance regression with new iterator API

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 7.0
    • 7.0
    • None
    • None

    Description

      I did a quick performance comparison of faceting indexed fields (i.e. docvalues are not stored) using method=dv before and after the new docvalues iterator went in (LUCENE-7407).

      5M document index, 21 segments, single valued string fields w/ no missing values.

      field cardinality new_time / old_time
      10 2.01
      1000 2.02
      10000 1.85
      100000 1.56
      1000000 1.31

      So unfortunately, often twice as slow.

      See followup messages for tests using real docvalues as well.

      Attachments

        Issue Links

          is broken by

          Improvement - An improvement or enhancement to an existing feature or task. LUCENE-7407 Explore switching doc values to an iterator API

          • Major - Major loss of function.
          • Resolved
          is related to

          Improvement - An improvement or enhancement to an existing feature or task. LUCENE-8374 Reduce reads for sparse DocValues

          • Major - Major loss of function.
          • Resolved
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. LUCENE-7462 Faster search APIs for doc values

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          There are no Sub-Tasks for this issue.

          Activity

            People

              Unassigned Unassigned
              yseeley@gmail.com Yonik Seeley
              Votes:
              4 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

                Created:
                Updated: