Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-6221

ReplicaFetcherThread throws UnknownTopicOrPartitionException on topic creation

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • 0.10.1.1, 0.10.2.0, 0.10.2.1, 0.11.0.1, 1.0.0
    • None
    • core
    • None
    • RHEL 7

    Description

      This issue appeared to happen frequently on 0.10.2.0.
      On 0.10.2.1 and 1.0.0 it's a way harder to reproduce.
      We'll focus on reproducing it on 0.10.2.1 and 1.0.0.

      TOPOLOGY:
      3 brokers, 1 zk.

      REPRODUCING STRATEGY:
      Create a few dozens topics (say, 40) one by one, each with replication factor 2. Number of partitions, generally, does not matter but, for easier reproduction, should not be too small (around 30 or so).

      CREATE 40 TOPICS:

       for i in {1..40}; do bin/kafka-topics.sh --create --topic "topic${i}_p28_r2" --partitions 28 --replication-factor 2 --zookeeper :2165; done

      ERRORS

      *BROKER 1*
[2017-11-15 16:46:00,853] ERROR [ReplicaFetcherThread-0-2], Error for partition [topic1_p28_r2,27] to broker 2:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread)
[2017-11-15 16:46:00,853] ERROR [ReplicaFetcherThread-0-2], Error for partition [topic1_p28_r2,27] to broker 2:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread)
[2017-11-15 16:46:00,854] ERROR [ReplicaFetcherThread-0-2], Error for partition [topic1_p28_r2,9] to broker 2:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread)
[2017-11-15 16:46:00,854] ERROR [ReplicaFetcherThread-0-2], Error for partition [topic1_p28_r2,9] to broker 2:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread)
[2017-11-15 16:46:00,854] ERROR [ReplicaFetcherThread-0-2], Error for partition [topic1_p28_r2,3] to broker 2:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread)
[2017-11-15 16:46:00,854] ERROR [ReplicaFetcherThread-0-2], Error for partition [topic1_p28_r2,3] to broker 2:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread)
[2017-11-15 16:46:00,854] ERROR [ReplicaFetcherThread-0-2], Error for partition [topic1_p28_r2,15] to broker 2:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread)
[2017-11-15 16:46:00,854] ERROR [ReplicaFetcherThread-0-2], Error for partition [topic1_p28_r2,15] to broker 2:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread)
[2017-11-15 16:46:00,854] ERROR [ReplicaFetcherThread-0-2], Error for partition [topic1_p28_r2,21] to broker 2:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread)
[2017-11-15 16:46:00,854] ERROR [ReplicaFetcherThread-0-2], Error for partition [topic1_p28_r2,21] to broker 2:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread)

*BROKER 2*
[2017-11-15 16:46:36,408] ERROR [ReplicaFetcherThread-0-3], Error for partition [topic20_p28_r2,12] to broker 3:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread)
[2017-11-15 16:46:36,408] ERROR [ReplicaFetcherThread-0-3], Error for partition [topic20_p28_r2,12] to broker 3:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread)
[2017-11-15 16:46:36,410] ERROR [ReplicaFetcherThread-0-3], Error for partition [topic20_p28_r2,0] to broker 3:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread)
[2017-11-15 16:46:36,410] ERROR [ReplicaFetcherThread-0-3], Error for partition [topic20_p28_r2,0] to broker 3:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread)
[2017-11-15 16:46:36,410] ERROR [ReplicaFetcherThread-0-3], Error for partition [topic20_p28_r2,6] to broker 3:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread)
[2017-11-15 16:46:36,410] ERROR [ReplicaFetcherThread-0-3], Error for partition [topic20_p28_r2,6] to broker 3:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread)
[2017-11-15 16:46:36,410] ERROR [ReplicaFetcherThread-0-3], Error for partition [topic20_p28_r2,24] to broker 3:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread)
[2017-11-15 16:46:36,410] ERROR [ReplicaFetcherThread-0-3], Error for partition [topic20_p28_r2,24] to broker 3:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread)
[2017-11-15 16:46:36,410] ERROR [ReplicaFetcherThread-0-3], Error for partition [topic20_p28_r2,18] to broker 3:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread)
[2017-11-15 16:46:36,410] ERROR [ReplicaFetcherThread-0-3], Error for partition [topic20_p28_r2,18] to broker 3:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread)

*BROKER 3*
[2017-11-15 16:47:00,393] ERROR [ReplicaFetcherThread-0-2], Error for partition [topic30_p28_r2,16] to broker 2:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread)
[2017-11-15 16:47:00,393] ERROR [ReplicaFetcherThread-0-2], Error for partition [topic30_p28_r2,16] to broker 2:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread)
[2017-11-15 16:47:00,393] ERROR [ReplicaFetcherThread-0-2], Error for partition [topic30_p28_r2,10] to broker 2:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread)
[2017-11-15 16:47:00,393] ERROR [ReplicaFetcherThread-0-2], Error for partition [topic30_p28_r2,10] to broker 2:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread)
[2017-11-15 16:47:00,393] ERROR [ReplicaFetcherThread-0-2], Error for partition [topic30_p28_r2,4] to broker 2:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread)
[2017-11-15 16:47:00,393] ERROR [ReplicaFetcherThread-0-2], Error for partition [topic30_p28_r2,4] to broker 2:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread)
[2017-11-15 16:47:00,393] ERROR [ReplicaFetcherThread-0-2], Error for partition [topic30_p28_r2,22] to broker 2:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread)
[2017-11-15 16:47:00,393] ERROR [ReplicaFetcherThread-0-2], Error for partition [topic30_p28_r2,22] to broker 2:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread)

      RESULTS:
      As you can see, the problem occurs on

      • partitions [3,9,15,21,27] of topic `topic1_p28_r2`
      • partitions [0,6,12,18,14] of topic `topic20_p28_r2`
      • partitions [4,10,16,22] of topic `topic30_p28_r2`

      Partitions are either odd or even.
      Every "unlucky" partition, except the starting one, for each topic, appears to be the 6th in the row. For instance:

      • 3, 9(3+6), 15(3+6+6), ...
      • 0, 6(0+6), 12(0+6+6), ...
      • 4, ...

      Attachments

        Activity

          People

            Unassigned Unassigned
            alex.dunayevsky Alex Dunayevsky
            Votes:
            2 Vote for this issue
            Watchers:
            12 Start watching this issue

            Dates

              Created:
              Updated:

              Time Tracking

                Estimated:
                Original Estimate - 336h
                336h
                Remaining:
                Remaining Estimate - 336h
                336h
                Logged:
                Time Spent - Not Specified
                Not Specified