Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-9661

Another classloader deadlock?

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Patch Available
    • Blocker
    • Resolution: Fixed
    • 8.0, 9.0
    • 8.x, 9.0, 8.8
    • None
    • None
    • New

    Description

      The java processes spawned by our Lucene nightly benchmarks sometimes randomly hang, apparently while loading classes across threads, under contention.

      I've opened this luceneutil issue with some details, but uschindler suggested I open an issue here too since he has been seeing this in CI builds too.

      It is rare, maybe once a week in the nightly benchmarks (which spawn many java processes with many threads across 128 CPU cores).  It is clearly a deadlock – when it strikes, the process hangs forever until I notice and kill -9 it.  I posted a coupled jstacks in the issue above.

      rcmuir suggested using classcycle to maybe statically dig into possible deadlocks ... I have not tried that yet.

      Attachments

        1. intellij inspection results.html
          52 kB
          David Smiley
        2. deadlock inspections.jpg
          150 kB
          Namgyu Kim
        3. deadlock_test.patch
          9 kB
          Namgyu Kim

        Issue Links

          Activity

            People

              danmuzi Namgyu Kim
              mikemccand Michael McCandless
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 2h 40m
                  2h 40m