Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-6208

Reduce startup time for Kafka Connect workers

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.0.0
    • 3.6.0
    • connect

    Description

      Kafka Connect startup times are excessive with a handful of connectors on the plugin path or classpath. We should not be scanning three times (once for connectors, once for SMTs, and once for converters), and hopefully we can avoid scanning directories that are clearly not plugin directories.

      We should also consider using Java's Service Loader to quickly identify connectors. The latter would require a KIP and would require time to for connectors to migrate, but we could be smarter about only scanning plugin directories that need to be scanned.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              rhauch Randall Hauch
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: