Uploaded image for project: 'Camel'
  1. Camel
  2. CAMEL-18760

camel-kafka - Issue using ThrottlingExceptionRoutePolicy with Kafka consumer

    XMLWordPrintableJSON

Details

    • Unknown

    Description

      Hi,

      while attempting to add the circuit breaker pattern to a route (see also CAMEL-18759), I tried to use ThrottlingExceptionRoutePolicy to suspend and resume the route when a specific exception is thrown. I noticed that regardless of the breakOnFirstError setting, the message causing the circuit to be opened is lost. If breakOnFirstError is true, logs are showing "Will seek consumer to offset -1 and start polling again", but when the circuit is closed the message is not consumed. I suspect that the consumer overwrites the offset when it's suspended. If I switch to manual commits, everything works as expected.

      Reproducer here: https://github.com/lorenzobenvenuti/camel-kafka-break-on-first-error-bug

      Thanks,

      lorenzo

      Attachments

        Issue Links

          causes

          Improvement - An improvement or enhancement to an existing feature or task. CAMEL-20089 camel-kafka: make breakOnFirstError more flexible

          • Major - Major loss of function.
          • Open
          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. CAMEL-19358 camel-kafka - Kafka consumer is still able to consume message with keepOpen as true in ThrottlingExceptionRoutePolicy

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. CAMEL-18588 Kafka consumer on any exception should repoll records after the committed offset

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. CAMEL-18759 camel-kafka - When Kafka pausable consumer is resumed, it reads all the messages from the earliest offset

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. CAMEL-20044 camel-kafka - On rejoining consumer group Camel can set offset incorrectly causing messages to be replayed

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. CAMEL-19894 camel-kafka: enabling "breakOnFirstError" causes to skip records on exception

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Activity

            People

              orpiske Otavio Rodolfo Piske
              lbenvenu Lorenzo Benvenuti
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: