Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-7445

TestSearcherManager failure: Document contains at least one immense term in field="body"

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 6.3, 7.0
    • None
    • None
    • New

    Description

      My Jenkins found a reproducing branch_6x seed:

         [junit4] Suite: org.apache.lucene.search.TestSearcherManager
         [junit4]   2> ruj 10, 2016 8:08:20 AM com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler uncaughtException
         [junit4]   2> WARNING: Uncaught exception in thread: Thread[Thread-673,5,TGRP-TestSearcherManager]
         [junit4]   2> java.lang.IllegalArgumentException: Document contains at least one immense term in field="body" (whose UTF8 encoding is longer than the max length 32766), all of which were skipped.  Please correct the analyzer to not produce such terms.  The prefix of the first immense term is: '[125, 125, 123, 123, 123, 123, 123, 115, 117, 98, 115, 116, 99, 124, 125, 125, 125, 123, 123, 123, 49, 125, 125, 125, 124, 123, 123, 123, 112, 49]...', original message: bytes can be at most 32766 in length; got 94384
         [junit4]   2> 	at __randomizedtesting.SeedInfo.seed([22BFCB6CA5A80CA]:0)
         [junit4]   2> 	at org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:772)
         [junit4]   2> 	at org.apache.lucene.index.DefaultIndexingChain.processField(DefaultIndexingChain.java:417)
         [junit4]   2> 	at org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:373)
         [junit4]   2> 	at org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:231)
         [junit4]   2> 	at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:478)
         [junit4]   2> 	at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1562)
         [junit4]   2> 	at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1307)
         [junit4]   2> 	at org.apache.lucene.search.TestSearcherManager$8.run(TestSearcherManager.java:557)
         [junit4]   2> 	Suppressed: java.lang.IllegalStateException: close() called in wrong state: INCREMENT
         [junit4]   2> 		at org.apache.lucene.analysis.MockTokenizer.fail(MockTokenizer.java:125)
         [junit4]   2> 		at org.apache.lucene.analysis.MockTokenizer.close(MockTokenizer.java:292)
         [junit4]   2> 		at org.apache.lucene.analysis.TokenFilter.close(TokenFilter.java:58)
         [junit4]   2> 		at org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:788)
         [junit4]   2> 		... 7 more
         [junit4]   2> Caused by: org.apache.lucene.util.BytesRefHash$MaxBytesLengthExceededException: bytes can be at most 32766 in length; got 94384
         [junit4]   2> 	at org.apache.lucene.util.BytesRefHash.add(BytesRefHash.java:263)
         [junit4]   2> 	at org.apache.lucene.index.TermsHashPerField.add(TermsHashPerField.java:149)
         [junit4]   2> 	at org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:762)
         [junit4]   2> 	... 7 more
         [junit4]   2> 
         [junit4]   2> ruj 10, 2016 8:38:00 AM com.carrotsearch.randomizedtesting.ThreadLeakControl$2 evaluate
         [junit4]   2> WARNING: Suite execution timed out: org.apache.lucene.search.TestSearcherManager
         [junit4]   2> ==== jstack at approximately timeout time ====
         [junit4]   2> "Thread-676" ID=802 RUNNABLE
         [junit4]   2> 	at java.lang.Thread.holdsLock(Native Method)
         [junit4]   2> 	at org.apache.lucene.index.IndexFileDeleter.locked(IndexFileDeleter.java:117)
         [junit4]   2> 	at org.apache.lucene.index.IndexFileDeleter.incRef(IndexFileDeleter.java:565)
         [junit4]   2> 	at org.apache.lucene.index.IndexFileDeleter.incRef(IndexFileDeleter.java:553)
         [junit4]   2> 	at org.apache.lucene.index.IndexWriter.incRefDeleter(IndexWriter.java:4963)
         [junit4]   2> 	- locked org.apache.lucene.index.IndexWriter@7fc295c2
         [junit4]   2> 	at org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:117)
         [junit4]   2> 	at org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:460)
         [junit4]   2> 	- locked org.apache.lucene.index.IndexWriter@7fc295c2
         [junit4]   2> 	- locked java.lang.Object@c3599a3
         [junit4]   2> 	at org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:103)
         [junit4]   2> 	at org.apache.lucene.search.SearcherManager.<init>(SearcherManager.java:108)
         [junit4]   2> 	at org.apache.lucene.search.SearcherManager.<init>(SearcherManager.java:76)
         [junit4]   2> 	at org.apache.lucene.search.TestSearcherManager$11.run(TestSearcherManager.java:647)
         [junit4]   2> 
         [junit4]   2> "Thread-675" ID=801 RUNNABLE
         [junit4]   2> 	at java.lang.Throwable.fillInStackTrace(Native Method)
         [junit4]   2> 	at java.lang.Throwable.fillInStackTrace(Throwable.java:783)
         [junit4]   2> 	- locked org.apache.lucene.store.AlreadyClosedException@4e77cf8b
         [junit4]   2> 	at java.lang.Throwable.<init>(Throwable.java:265)
         [junit4]   2> 	at java.lang.Exception.<init>(Exception.java:66)
         [junit4]   2> 	at java.lang.RuntimeException.<init>(RuntimeException.java:62)
         [junit4]   2> 	at java.lang.IllegalStateException.<init>(IllegalStateException.java:55)
         [junit4]   2> 	at org.apache.lucene.store.AlreadyClosedException.<init>(AlreadyClosedException.java:26)
         [junit4]   2> 	at org.apache.lucene.search.ReferenceManager.ensureOpen(ReferenceManager.java:54)
         [junit4]   2> 	at org.apache.lucene.search.ReferenceManager.maybeRefreshBlocking(ReferenceManager.java:248)
         [junit4]   2> 	at org.apache.lucene.search.TestSearcherManager$10.run(TestSearcherManager.java:617)
         [junit4]   2> 
         [junit4]   2> "Thread-674" ID=800 RUNNABLE
         [junit4]   2> 	at java.lang.Throwable.fillInStackTrace(Native Method)
         [junit4]   2> 	at java.lang.Throwable.fillInStackTrace(Throwable.java:783)
         [junit4]   2> 	- locked org.apache.lucene.store.AlreadyClosedException@746a9d47
         [junit4]   2> 	at java.lang.Throwable.<init>(Throwable.java:265)
         [junit4]   2> 	at java.lang.Exception.<init>(Exception.java:66)
         [junit4]   2> 	at java.lang.RuntimeException.<init>(RuntimeException.java:62)
         [junit4]   2> 	at java.lang.IllegalStateException.<init>(IllegalStateException.java:55)
         [junit4]   2> 	at org.apache.lucene.store.AlreadyClosedException.<init>(AlreadyClosedException.java:26)
         [junit4]   2> 	at org.apache.lucene.search.ReferenceManager.acquire(ReferenceManager.java:98)
         [junit4]   2> 	at org.apache.lucene.search.TestSearcherManager$9.run(TestSearcherManager.java:588)
         [junit4]   2> 
         [junit4]   2> "TEST-TestSearcherManager.testConcurrentIndexCloseSearchAndRefresh-seed#[22BFCB6CA5A80CA]" ID=797 WAITING on org.apache.lucene.search.TestSearcherManager$9@1fed6a8d
         [junit4]   2> 	at java.lang.Object.wait(Native Method)
         [junit4]   2> 	- waiting on org.apache.lucene.search.TestSearcherManager$9@1fed6a8d
         [junit4]   2> 	at java.lang.Thread.join(Thread.java:1245)
         [junit4]   2> 	at java.lang.Thread.join(Thread.java:1319)
         [junit4]   2> 	at org.apache.lucene.search.TestSearcherManager.testConcurrentIndexCloseSearchAndRefresh(TestSearcherManager.java:670)
         [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
         [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
         [junit4]   2> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
         [junit4]   2> 	at java.lang.reflect.Method.invoke(Method.java:498)
         [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
         [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
         [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
         [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
         [junit4]   2> 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
         [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
         [junit4]   2> 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
         [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
         [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
         [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
         [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
         [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
         [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
         [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
         [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
         [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
         [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
         [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
         [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
         [junit4]   2> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
         [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
         [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
         [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
         [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
         [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
         [junit4]   2> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
         [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
         [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
         [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
         [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
         [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
         [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
         [junit4]   2> 
         [junit4]   2> "SUITE-TestSearcherManager-seed#[22BFCB6CA5A80CA]" ID=796 RUNNABLE
         [junit4]   2> 	at sun.management.ThreadImpl.dumpThreads0(Native Method)
         [junit4]   2> 	at sun.management.ThreadImpl.dumpAllThreads(ThreadImpl.java:454)
         [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.formatThreadStacksFull(ThreadLeakControl.java:673)
         [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.access$1000(ThreadLeakControl.java:64)
         [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$2.evaluate(ThreadLeakControl.java:414)
         [junit4]   2> 	- locked java.lang.Object@3fb51052
         [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:681)
         [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$200(RandomizedRunner.java:140)
         [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:591)
         [junit4]   2> 
         [junit4]   2> "JUnit4-serializer-daemon" ID=18 TIMED_WAITING
         [junit4]   2> 	at java.lang.Thread.sleep(Native Method)
         [junit4]   2> 	at com.carrotsearch.ant.tasks.junit4.events.Serializer$1.run(Serializer.java:47)
         [junit4]   2> 
         [junit4]   2> "Signal Dispatcher" ID=4 RUNNABLE
         [junit4]   2> 
         [junit4]   2> "Finalizer" ID=3 WAITING on java.lang.ref.ReferenceQueue$Lock@4f4e9bb8
         [junit4]   2> 	at java.lang.Object.wait(Native Method)
         [junit4]   2> 	- waiting on java.lang.ref.ReferenceQueue$Lock@4f4e9bb8
         [junit4]   2> 	at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:143)
         [junit4]   2> 	at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:164)
         [junit4]   2> 	at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:209)
         [junit4]   2> 
         [junit4]   2> "Reference Handler" ID=2 WAITING on java.lang.ref.Reference$Lock@6f6eb7b3
         [junit4]   2> 	at java.lang.Object.wait(Native Method)
         [junit4]   2> 	- waiting on java.lang.ref.Reference$Lock@6f6eb7b3
         [junit4]   2> 	at java.lang.Object.wait(Object.java:502)
         [junit4]   2> 	at java.lang.ref.Reference.tryHandlePending(Reference.java:191)
         [junit4]   2> 	at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:153)
         [junit4]   2> 
         [junit4]   2> "main" ID=1 WAITING on com.carrotsearch.randomizedtesting.RandomizedRunner$2@3eff9ff9
         [junit4]   2> 	at java.lang.Object.wait(Native Method)
         [junit4]   2> 	- waiting on com.carrotsearch.randomizedtesting.RandomizedRunner$2@3eff9ff9
         [junit4]   2> 	at java.lang.Thread.join(Thread.java:1245)
         [junit4]   2> 	at java.lang.Thread.join(Thread.java:1319)
         [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:601)
         [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.run(RandomizedRunner.java:450)
         [junit4]   2> 	at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:243)
         [junit4]   2> 	at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:354)
         [junit4]   2> 	at com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:10)
         [junit4]   2> 
         [junit4]   2> ^^==============================================
         [junit4]   2> 
         [junit4]   2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
         [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestSearcherManager -Dtests.method=testConcurrentIndexCloseSearchAndRefresh -Dtests.seed=22BFCB6CA5A80CA -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=hr -Dtests.timezone=America/Port-au-Prince -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
         [junit4] ERROR   1800s J8  | TestSearcherManager.testConcurrentIndexCloseSearchAndRefresh <<<
         [junit4]    > Throwable #1: java.lang.Exception: Test abandoned because suite timeout was reached.
         [junit4]    > 	at __randomizedtesting.SeedInfo.seed([22BFCB6CA5A80CA]:0)
         [junit4]   2> ruj 10, 2016 8:38:00 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
         [junit4]   2> WARNING: Will linger awaiting termination of 4 leaked thread(s).
         [junit4]   2> ruj 10, 2016 8:38:20 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
         [junit4]   2> SEVERE: 4 threads leaked from SUITE scope at org.apache.lucene.search.TestSearcherManager: 
         [junit4]   2>    1) Thread[id=800, name=Thread-674, state=RUNNABLE, group=TGRP-TestSearcherManager]
         [junit4]   2>         at java.lang.Throwable.fillInStackTrace(Native Method)
         [junit4]   2>         at java.lang.Throwable.fillInStackTrace(Throwable.java:783)
         [junit4]   2>         at java.lang.Throwable.<init>(Throwable.java:265)
         [junit4]   2>         at java.lang.Exception.<init>(Exception.java:66)
         [junit4]   2>         at java.lang.RuntimeException.<init>(RuntimeException.java:62)
         [junit4]   2>         at java.lang.IllegalStateException.<init>(IllegalStateException.java:55)
         [junit4]   2>         at org.apache.lucene.store.AlreadyClosedException.<init>(AlreadyClosedException.java:26)
         [junit4]   2>         at org.apache.lucene.search.ReferenceManager.acquire(ReferenceManager.java:98)
         [junit4]   2>         at org.apache.lucene.search.TestSearcherManager$9.run(TestSearcherManager.java:588)
         [junit4]   2>    2) Thread[id=802, name=Thread-676, state=RUNNABLE, group=TGRP-TestSearcherManager]
         [junit4]   2>         at java.lang.Thread.holdsLock(Native Method)
         [junit4]   2>         at org.apache.lucene.index.IndexFileDeleter.locked(IndexFileDeleter.java:117)
         [junit4]   2>         at org.apache.lucene.index.IndexFileDeleter.decRef(IndexFileDeleter.java:577)
         [junit4]   2>         at org.apache.lucene.index.IndexFileDeleter.decRef(IndexFileDeleter.java:647)
         [junit4]   2>         at org.apache.lucene.index.IndexWriter.decRefDeleter(IndexWriter.java:4975)
         [junit4]   2>         at org.apache.lucene.index.StandardDirectoryReader.doClose(StandardDirectoryReader.java:381)
         [junit4]   2>         at org.apache.lucene.index.IndexReader.decRef(IndexReader.java:251)
         [junit4]   2>         at org.apache.lucene.search.SearcherManager.decRef(SearcherManager.java:149)
         [junit4]   2>         at org.apache.lucene.search.SearcherManager.decRef(SearcherManager.java:58)
         [junit4]   2>         at org.apache.lucene.search.ReferenceManager.release(ReferenceManager.java:274)
         [junit4]   2>         at org.apache.lucene.search.ReferenceManager.swapReference(ReferenceManager.java:62)
         [junit4]   2>         at org.apache.lucene.search.ReferenceManager.close(ReferenceManager.java:146)
         [junit4]   2>         at org.apache.lucene.search.TestSearcherManager$11.run(TestSearcherManager.java:643)
         [junit4]   2>    3) Thread[id=797, name=TEST-TestSearcherManager.testConcurrentIndexCloseSearchAndRefresh-seed#[22BFCB6CA5A80CA], state=WAITING, group=TGRP-TestSearcherManager]
         [junit4]   2>         at java.lang.Object.wait(Native Method)
         [junit4]   2>         at java.lang.Thread.join(Thread.java:1245)
         [junit4]   2>         at java.lang.Thread.join(Thread.java:1319)
         [junit4]   2>         at org.apache.lucene.search.TestSearcherManager.testConcurrentIndexCloseSearchAndRefresh(TestSearcherManager.java:670)
         [junit4]   2>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
         [junit4]   2>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
         [junit4]   2>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
         [junit4]   2>         at java.lang.reflect.Method.invoke(Method.java:498)
         [junit4]   2>         at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
         [junit4]   2>         at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
         [junit4]   2>         at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
         [junit4]   2>         at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
         [junit4]   2>         at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
         [junit4]   2>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
         [junit4]   2>         at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
         [junit4]   2>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
         [junit4]   2>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
         [junit4]   2>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
         [junit4]   2>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
         [junit4]   2>         at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
         [junit4]   2>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
         [junit4]   2>         at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
         [junit4]   2>         at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
         [junit4]   2>         at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
         [junit4]   2>         at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
         [junit4]   2>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
         [junit4]   2>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
         [junit4]   2>         at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
         [junit4]   2>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
         [junit4]   2>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
         [junit4]   2>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
         [junit4]   2>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
         [junit4]   2>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
         [junit4]   2>         at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
         [junit4]   2>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
         [junit4]   2>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
         [junit4]   2>         at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
         [junit4]   2>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
         [junit4]   2>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
         [junit4]   2>         at java.lang.Thread.run(Thread.java:745)
         [junit4]   2>    4) Thread[id=801, name=Thread-675, state=RUNNABLE, group=TGRP-TestSearcherManager]
         [junit4]   2>         at java.lang.Throwable.fillInStackTrace(Native Method)
         [junit4]   2>         at java.lang.Throwable.fillInStackTrace(Throwable.java:783)
         [junit4]   2>         at java.lang.Throwable.<init>(Throwable.java:265)
         [junit4]   2>         at java.lang.Exception.<init>(Exception.java:66)
         [junit4]   2>         at java.lang.RuntimeException.<init>(RuntimeException.java:62)
         [junit4]   2>         at java.lang.IllegalStateException.<init>(IllegalStateException.java:55)
         [junit4]   2>         at org.apache.lucene.store.AlreadyClosedException.<init>(AlreadyClosedException.java:26)
         [junit4]   2>         at org.apache.lucene.search.ReferenceManager.ensureOpen(ReferenceManager.java:54)
         [junit4]   2>         at org.apache.lucene.search.ReferenceManager.maybeRefreshBlocking(ReferenceManager.java:248)
         [junit4]   2>         at org.apache.lucene.search.TestSearcherManager$10.run(TestSearcherManager.java:617)
         [junit4]   2> ruj 10, 2016 8:38:20 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
         [junit4]   2> INFO: Starting to interrupt leaked threads:
         [junit4]   2>    1) Thread[id=800, name=Thread-674, state=RUNNABLE, group=TGRP-TestSearcherManager]
         [junit4]   2>    2) Thread[id=802, name=Thread-676, state=BLOCKED, group=TGRP-TestSearcherManager]
         [junit4]   2>    3) Thread[id=797, name=TEST-TestSearcherManager.testConcurrentIndexCloseSearchAndRefresh-seed#[22BFCB6CA5A80CA], state=WAITING, group=TGRP-TestSearcherManager]
         [junit4]   2>    4) Thread[id=801, name=Thread-675, state=RUNNABLE, group=TGRP-TestSearcherManager]
         [junit4]   2> NOTE: leaving temporary files on disk at: /var/lib/jenkins/jobs/Lucene-Solr-Nightly-6.x/workspace/lucene/build/core/test/J8/temp/lucene.search.TestSearcherManager_22BFCB6CA5A80CA-001
         [junit4]   2> Sep 10, 2016 8:38:23 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
         [junit4]   2> SEVERE: There are still zombie threads that couldn't be terminated:
         [junit4]   2>    1) Thread[id=800, name=Thread-674, state=RUNNABLE, group=TGRP-TestSearcherManager]
         [junit4]   2>         at java.lang.Throwable.fillInStackTrace(Native Method)
         [junit4]   2>         at java.lang.Throwable.fillInStackTrace(Throwable.java:783)
         [junit4]   2>         at java.lang.Throwable.<init>(Throwable.java:265)
         [junit4]   2>         at java.lang.Exception.<init>(Exception.java:66)
         [junit4]   2>         at java.lang.RuntimeException.<init>(RuntimeException.java:62)
         [junit4]   2>         at java.lang.IllegalStateException.<init>(IllegalStateException.java:55)
         [junit4]   2>         at org.apache.lucene.store.AlreadyClosedException.<init>(AlreadyClosedException.java:26)
         [junit4]   2>         at org.apache.lucene.search.ReferenceManager.acquire(ReferenceManager.java:98)
         [junit4]   2>         at org.apache.lucene.search.TestSearcherManager$9.run(TestSearcherManager.java:588)
         [junit4]   2>    2) Thread[id=802, name=Thread-676, state=RUNNABLE, group=TGRP-TestSearcherManager]
         [junit4]   2>         at java.lang.Thread.holdsLock(Native Method)
         [junit4]   2>         at org.apache.lucene.index.IndexWriter.holdsFullFlushLock(IndexWriter.java:3306)
         [junit4]   2>         at org.apache.lucene.index.DocumentsWriter.finishFullFlush(DocumentsWriter.java:676)
         [junit4]   2>         at org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:468)
         [junit4]   2>         at org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:103)
         [junit4]   2>         at org.apache.lucene.search.SearcherManager.<init>(SearcherManager.java:108)
         [junit4]   2>         at org.apache.lucene.search.SearcherManager.<init>(SearcherManager.java:76)
         [junit4]   2>         at org.apache.lucene.search.TestSearcherManager$11.run(TestSearcherManager.java:647)
         [junit4]   2>    3) Thread[id=801, name=Thread-675, state=RUNNABLE, group=TGRP-TestSearcherManager]
         [junit4]   2>         at java.lang.Throwable.fillInStackTrace(Native Method)
         [junit4]   2>         at java.lang.Throwable.fillInStackTrace(Throwable.java:783)
         [junit4]   2>         at java.lang.Throwable.<init>(Throwable.java:265)
         [junit4]   2>         at java.lang.Exception.<init>(Exception.java:66)
         [junit4]   2>         at java.lang.RuntimeException.<init>(RuntimeException.java:62)
         [junit4]   2>         at java.lang.IllegalStateException.<init>(IllegalStateException.java:55)
         [junit4]   2>         at org.apache.lucene.store.AlreadyClosedException.<init>(AlreadyClosedException.java:26)
         [junit4]   2>         at org.apache.lucene.search.ReferenceManager.ensureOpen(ReferenceManager.java:54)
         [junit4]   2>         at org.apache.lucene.search.ReferenceManager.maybeRefreshBlocking(ReferenceManager.java:248)
         [junit4]   2>         at org.apache.lucene.search.TestSearcherManager$10.run(TestSearcherManager.java:617)
         [junit4]   2> NOTE: test params are: codec=Asserting(Lucene62): {date=BlockTreeOrds(blocksize=128), docid=PostingsFormat(name=Asserting), titleTokenized=PostingsFormat(name=LuceneFixedGap), body=BlockTreeOrds(blocksize=128), title=PostingsFormat(name=MockRandom)}, docValues:{docid_intDV=DocValuesFormat(name=Lucene54), titleDV=DocValuesFormat(name=Asserting)}, maxPointsInLeafNode=1354, maxMBSortInHeap=5.736770517965361, sim=RandomSimilarity(queryNorm=false,coord=yes): {titleTokenized=IB SPL-D3(800.0), body=ClassicSimilarity}, locale=hr, timezone=America/Port-au-Prince
         [junit4]   2> NOTE: Linux 4.1.0-custom2-amd64 amd64/Oracle Corporation 1.8.0_77 (64-bit)/cpus=16,threads=4,free=246890576,total=341311488
         [junit4]   2> NOTE: All tests run in this JVM: [TestIndexWriterDelete, TestBooleanQuery, TestInPlaceMergeSorter, TestReaderWrapperDVTypeCheck, FuzzyTermOnShortTermsTest, TestParallelLeafReader, TestConjunctions, TestUTF32ToUTF8, TestPolygon2D, TestCharsRef, TestSimpleFSLockFactory, TestIndexWriterWithThreads, TestSpanOrQuery, TestShardSearching, TestEarlyTermination, TestTimeLimitingCollector, TestIndexWriterNRTIsCurrent, TestSetOnce, TestIndexWriterOnDiskFull, TestSegmentMerger, TestScorerPerf, TestIndexableField, TestSearcherManager]
         [junit4]   2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
         [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestSearcherManager -Dtests.seed=22BFCB6CA5A80CA -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=hr -Dtests.timezone=America/Port-au-Prince -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
         [junit4] ERROR   0.00s J8  | TestSearcherManager (suite) <<<
         [junit4]    > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 1800000 msec).
         [junit4]    > 	at __randomizedtesting.SeedInfo.seed([22BFCB6CA5A80CA]:0)Throwable #2: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=799, name=Thread-673, state=RUNNABLE, group=TGRP-TestSearcherManager]
         [junit4]    > Caused by: java.lang.IllegalArgumentException: Document contains at least one immense term in field="body" (whose UTF8 encoding is longer than the max length 32766), all of which were skipped.  Please correct the analyzer to not produce such terms.  The prefix of the first immense term is: '[125, 125, 123, 123, 123, 123, 123, 115, 117, 98, 115, 116, 99, 124, 125, 125, 125, 123, 123, 123, 49, 125, 125, 125, 124, 123, 123, 123, 112, 49]...', original message: bytes can be at most 32766 in length; got 94384
         [junit4]    > 	at __randomizedtesting.SeedInfo.seed([22BFCB6CA5A80CA]:0)
         [junit4]    > 	at org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:772)
         [junit4]    > 	at org.apache.lucene.index.DefaultIndexingChain.processField(DefaultIndexingChain.java:417)
         [junit4]    > 	at org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:373)
         [junit4]    > 	at org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:231)
         [junit4]    > 	at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:478)
         [junit4]    > 	at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1562)
         [junit4]    > 	at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1307)
         [junit4]    > 	at org.apache.lucene.search.TestSearcherManager$8.run(TestSearcherManager.java:557)
         [junit4]    > 	Suppressed: java.lang.IllegalStateException: close() called in wrong state: INCREMENT
         [junit4]    > 		at org.apache.lucene.analysis.MockTokenizer.fail(MockTokenizer.java:125)
         [junit4]    > 		at org.apache.lucene.analysis.MockTokenizer.close(MockTokenizer.java:292)
         [junit4]    > 		at org.apache.lucene.analysis.TokenFilter.close(TokenFilter.java:58)
         [junit4]    > 		at org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:788)
         [junit4]    > 		... 7 more
         [junit4]    > Caused by: org.apache.lucene.util.BytesRefHash$MaxBytesLengthExceededException: bytes can be at most 32766 in length; got 94384
         [junit4]    > 	at org.apache.lucene.util.BytesRefHash.add(BytesRefHash.java:263)
         [junit4]    > 	at org.apache.lucene.index.TermsHashPerField.add(TermsHashPerField.java:149)
         [junit4]    > 	at org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:762)
         [junit4]    > 	... 7 more
         [junit4] Completed [438/438 (1!)] on J8 in 1823.24s, 3 tests, 3 errors <<< FAILURES!
      

      Attachments

        Activity

          People

            Unassigned Unassigned
            sarowe Steven Rowe
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: