Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-544

TestSamzaContainerPerformance throws OOM occasionally

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.9.0
    • 0.9.0
    • test
    • None

    Description

      Occasionally, can see the OOM error from TestSamzaContainerPerformance. Doubt it is because we decreased the memory in SAMZA-426. Log is following.

      11:22:14.338 [DEBUG] [TestEventLogger]     2152 [ThreadJob] INFO org.apache.samza.container.SamzaContainer - Starting consumer multiplexer.
      11:23:57.797 [ERROR] [system.err] 
      11:23:57.798 [ERROR] [system.err] Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "MockSystemConsumer-7"
      11:24:47.237 [DEBUG] [TestEventLogger]     155714 [ThreadJob] INFO org.apache.samza.container.SamzaContainer - Shutting down.
      11:24:47.237 [DEBUG] [TestEventLogger]     Exception in thread "MockSystemConsumer-6" java.lang.OutOfMemoryError: Java heap space
      11:24:47.238 [DEBUG] [TestEventLogger]     	at java.util.concurrent.LinkedBlockingQueue.put(LinkedBlockingQueue.java:335)
      11:24:47.238 [DEBUG] [TestEventLogger]     	at org.apache.samza.util.BlockingEnvelopeMap.put(BlockingEnvelopeMap.java:168)
      11:24:47.238 [DEBUG] [TestEventLogger]     	at org.apache.samza.system.mock.MockSystemConsumer.access$200(MockSystemConsumer.java:43)
      11:24:47.238 [DEBUG] [TestEventLogger]     	at org.apache.samza.system.mock.MockSystemConsumer$MockSystemConsumerRunnable.run(MockSystemConsumer.java:163)
      11:24:47.238 [DEBUG] [TestEventLogger]     	at java.lang.Thread.run(Thread.java:745)
      11:24:47.239 [DEBUG] [TestEventLogger]     155714 [ThreadJob] INFO org.apache.samza.container.SamzaContainer - Shutting down consumer multiplexer.
      11:24:47.239 [DEBUG] [TestEventLogger]     Exception in thread "MockSystemConsumer-2" java.lang.OutOfMemoryError: Java heap space
      11:24:47.239 [DEBUG] [TestEventLogger]     	at org.apache.samza.system.mock.MockSystemConsumer$MockSystemConsumerRunnable.run(MockSystemConsumer.java:163)
      11:24:47.239 [DEBUG] [TestEventLogger]     	at java.lang.Thread.run(Thread.java:745)
      11:24:47.240 [DEBUG] [TestEventLogger]     Exception in thread "MockSystemConsumer-3" java.lang.OutOfMemoryError: Java heap space
      11:24:47.240 [DEBUG] [TestEventLogger]     Exception in thread "MockSystemConsumer-9" java.lang.OutOfMemoryError: Java heap space
      11:24:47.240 [DEBUG] [TestEventLogger]     	at org.apache.samza.system.mock.MockSystemConsumer$MockSystemConsumerRunnable.run(MockSystemConsumer.java:163)
      11:24:47.240 [DEBUG] [TestEventLogger]     	at java.lang.Thread.run(Thread.java:745)
      11:24:47.240 [DEBUG] [TestEventLogger] 
      11:24:47.240 [DEBUG] [TestEventLogger] org.apache.samza.test.performance.TestSamzaContainerPerformance > testContainerPerformance STANDARD_OUT
      11:24:47.241 [DEBUG] [TestEventLogger]     Got interrupt. Shutting down.
      11:24:47.241 [DEBUG] [TestEventLogger]     Got interrupt. Shutting down.
      11:24:47.241 [DEBUG] [TestEventLogger]     Got interrupt. Shutting down.
      11:24:47.241 [DEBUG] [TestEventLogger]     Got interrupt. Shutting down.
      11:24:47.241 [DEBUG] [TestEventLogger]     Got interrupt. Shutting down.
      11:24:47.242 [DEBUG] [TestEventLogger]     Got interrupt. Shutting down.
      11:24:47.242 [DEBUG] [TestEventLogger]     Got interrupt. Shutting down.
      11:24:47.242 [DEBUG] [TestEventLogger] 
      11:24:47.242 [DEBUG] [TestEventLogger] org.apache.samza.test.performance.TestSamzaContainerPerformance > testContainerPerformance STANDARD_ERROR
      

      Attachments

        1. Screen Shot 2015-02-04 at 1.50.54 PM.png
          112 kB
          Yan Fang
        2. SAMZA-544-1.patch
          9 kB
          Chris Riccomini
        3. SAMZA-544-0.patch
          40 kB
          Chris Riccomini

        Issue Links

          Activity

            People

              criccomini Chris Riccomini
              closeuris Yan Fang
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: