Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-17007

TestDenseVectorFunctionQuery reproducible failures

    XMLWordPrintableJSON

Details

    • Test
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      In the past week, the same 5 test methods of TestDenseVectorFunctionQuery have all failed 3 times - in the same 3 jenkins builds (ie: same master seed - which reproduces locally for me) and all of the test (method) failures have the same root cause ... strongly suggesting that some aspect of the static, or test class level, randomization is breaking these methods.

       

      Recent example...

      ./gradlew test --tests TestDenseVectorFunctionQuery -Dtests.seed=749AD19AB618219E -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Solr/Solr-NightlyTests-main/test-data/enwiki.random.lines.txt -Dtests.locale=fr-MQ -Dtests.timezone=Asia/Novosibirsk -Dtests.asserts=true -Dtests.file.encoding=UTF-8
      ...
      org.apache.solr.search.function.TestDenseVectorFunctionQuery > floatFieldVectors_missingFieldValue_shouldReturnSimilarityZero FAILED
          java.lang.RuntimeException: Exception during query
              at __randomizedtesting.SeedInfo.seed([749AD19AB618219E:E0B29A3AECE5D888]:0)
              at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:989)
              at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:947)
              at org.apache.solr.search.function.TestDenseVectorFunctionQuery.floatFieldVectors_missingFieldValue_shouldReturnSimilarityZero(TestDenseVectorFunctionQuery.java:173)
      ...
              Caused by:
              java.lang.IllegalArgumentException: no float vector value is indexed for field 'vector2'
                  at org.apache.lucene.queries.function.valuesource.FloatKnnVectorFieldSource.getValues(FloatKnnVectorFieldSource.java:45)
                  at org.apache.lucene.queries.function.valuesource.VectorSimilarityFunction.getValues(VectorSimilarityFunction.java:48)
                  at org.apache.lucene.queries.function.FunctionQuery$AllScorer.<init>(FunctionQuery.java:115)
                  at org.apache.lucene.queries.function.FunctionQuery$FunctionWeight.scorer(FunctionQuery.java:76)
                  at org.apache.lucene.search.Weight.scorerSupplier(Weight.java:135)
                  at org.apache.lucene.search.BooleanWeight.scorerSupplier(BooleanWeight.java:515)
                  at org.apache.lucene.search.Weight.bulkScorer(Weight.java:165)
                  at org.apache.lucene.search.BooleanWeight.bulkScorer(BooleanWeight.java:368)
                  at org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:759)
                  at org.apache.solr.search.SolrIndexSearcher.search(SolrIndexSearcher.java:720)
                  at org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:549)
                  at org.apache.solr.search.SolrIndexSearcher.buildAndRunCollectorChain(SolrIndexSearcher.java:275)
                  at org.apache.solr.search.SolrIndexSearcher.getDocListNC(SolrIndexSearcher.java:1878)
                  at org.apache.solr.search.SolrIndexSearcher.getDocListC(SolrIndexSearcher.java:1695)
                  at org.apache.solr.search.SolrIndexSearcher.search(SolrIndexSearcher.java:710)
                  at org.apache.solr.handler.component.QueryComponent.doProcessUngroupedSearch(QueryComponent.java:1696)
                  at org.apache.solr.handler.component.QueryComponent.process(QueryComponent.java:422)
                  at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:467)
                  at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:226)
                  at org.apache.solr.core.SolrCore.execute(SolrCore.java:2901)
                  at org.apache.solr.util.TestHarness.query(TestHarness.java:352)
                  at org.apache.solr.util.TestHarness.query(TestHarness.java:332)
                  at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:961)
      ...
      > Task :solr:core:test FAILEDERROR: The following test(s) have failed:
        - org.apache.solr.search.function.TestDenseVectorFunctionQuery.floatFieldVectors_missingFieldValue_shouldReturnSimilarityZero (:solr:core)
          Test output: /home/hossman/lucene/solr/solr/core/build/test-results/test/outputs/OUTPUT-org.apache.solr.search.function.TestDenseVectorFunctionQuery.txt
          Reproduce with: gradlew :solr:core:test --tests "org.apache.solr.search.function.TestDenseVectorFunctionQuery.floatFieldVectors_missingFieldValue_shouldReturnSimilarityZero" -Ptests.jvms=5 "-Ptests.jvmargs=-XX:TieredStopAtLevel=1 -XX:+UseParallelGC -XX:ActiveProcessorCount=1 -XX:ReservedCodeCacheSize=120m" -Ptests.seed=749AD19AB618219E -Ptests.multiplier=2 -Ptests.locale=fr-MQ -Ptests.timezone=Asia/Novosibirsk -Ptests.nightly=true -Ptests.file.encoding=UTF-8 -Ptests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Solr/Solr-NightlyTests-main/test-data/enwiki.random.lines.txt  - org.apache.solr.search.function.TestDenseVectorFunctionQuery.resultOfVectorFunction_canBeUsedAsFloatFunctionInput (:solr:core)
          Test output: /home/hossman/lucene/solr/solr/core/build/test-results/test/outputs/OUTPUT-org.apache.solr.search.function.TestDenseVectorFunctionQuery.txt
          Reproduce with: gradlew :solr:core:test --tests "org.apache.solr.search.function.TestDenseVectorFunctionQuery.resultOfVectorFunction_canBeUsedAsFloatFunctionInput" -Ptests.jvms=5 "-Ptests.jvmargs=-XX:TieredStopAtLevel=1 -XX:+UseParallelGC -XX:ActiveProcessorCount=1 -XX:ReservedCodeCacheSize=120m" -Ptests.seed=749AD19AB618219E -Ptests.multiplier=2 -Ptests.locale=fr-MQ -Ptests.timezone=Asia/Novosibirsk -Ptests.nightly=true -Ptests.file.encoding=UTF-8 -Ptests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Solr/Solr-NightlyTests-main/test-data/enwiki.random.lines.txt  - org.apache.solr.search.function.TestDenseVectorFunctionQuery.byteFieldVectors_shouldReturnFloatSimilarity (:solr:core)
          Test output: /home/hossman/lucene/solr/solr/core/build/test-results/test/outputs/OUTPUT-org.apache.solr.search.function.TestDenseVectorFunctionQuery.txt
          Reproduce with: gradlew :solr:core:test --tests "org.apache.solr.search.function.TestDenseVectorFunctionQuery.byteFieldVectors_shouldReturnFloatSimilarity" -Ptests.jvms=5 "-Ptests.jvmargs=-XX:TieredStopAtLevel=1 -XX:+UseParallelGC -XX:ActiveProcessorCount=1 -XX:ReservedCodeCacheSize=120m" -Ptests.seed=749AD19AB618219E -Ptests.multiplier=2 -Ptests.locale=fr-MQ -Ptests.timezone=Asia/Novosibirsk -Ptests.nightly=true -Ptests.file.encoding=UTF-8 -Ptests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Solr/Solr-NightlyTests-main/test-data/enwiki.random.lines.txt  - org.apache.solr.search.function.TestDenseVectorFunctionQuery.floatFieldVectors_shouldReturnFloatSimilarity (:solr:core)
          Test output: /home/hossman/lucene/solr/solr/core/build/test-results/test/outputs/OUTPUT-org.apache.solr.search.function.TestDenseVectorFunctionQuery.txt
          Reproduce with: gradlew :solr:core:test --tests "org.apache.solr.search.function.TestDenseVectorFunctionQuery.floatFieldVectors_shouldReturnFloatSimilarity" -Ptests.jvms=5 "-Ptests.jvmargs=-XX:TieredStopAtLevel=1 -XX:+UseParallelGC -XX:ActiveProcessorCount=1 -XX:ReservedCodeCacheSize=120m" -Ptests.seed=749AD19AB618219E -Ptests.multiplier=2 -Ptests.locale=fr-MQ -Ptests.timezone=Asia/Novosibirsk -Ptests.nightly=true -Ptests.file.encoding=UTF-8 -Ptests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Solr/Solr-NightlyTests-main/test-data/enwiki.random.lines.txt  - org.apache.solr.search.function.TestDenseVectorFunctionQuery.byteFieldVectors_missingFieldValue_shouldReturnSimilarityZero (:solr:core)
          Test output: /home/hossman/lucene/solr/solr/core/build/test-results/test/outputs/OUTPUT-org.apache.solr.search.function.TestDenseVectorFunctionQuery.txt
          Reproduce with: gradlew :solr:core:test --tests "org.apache.solr.search.function.TestDenseVectorFunctionQuery.byteFieldVectors_missingFieldValue_shouldReturnSimilarityZero" -Ptests.jvms=5 "-Ptests.jvmargs=-XX:TieredStopAtLevel=1 -XX:+UseParallelGC -XX:ActiveProcessorCount=1 -XX:ReservedCodeCacheSize=120m" -Ptests.seed=749AD19AB618219E -Ptests.multiplier=2 -Ptests.locale=fr-MQ -Ptests.timezone=Asia/Novosibirsk -Ptests.nightly=true -Ptests.file.encoding=UTF-8 -Ptests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Solr/Solr-NightlyTests-main/test-data/enwiki.random.lines.txt
      

       

      Attachments

        1. apache_solr_Solr-NightlyTests-main_928.log.txt
          332 kB
          Chris M. Hostetter
        2. apache_solr_Solr-NightlyTests-main_931.log.txt
          5.51 MB
          Chris M. Hostetter
        3. thetaphi_solr_Solr-main-Linux_14822.log.txt
          2.17 MB
          Chris M. Hostetter

        Issue Links

          Activity

            People

              Unassigned Unassigned
              hossman Chris M. Hostetter
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated: