Skip to content

New topic information isn't picked up until restart #250

Closed
@jiminoc

Description

@jiminoc

Burrow does not seem to pick up changes to partitions in a topic until it's restarted.

Steps:

  1. clone latest burrow from github (go get)
  2. Start burrow up with default configs (changed broker/zk hosts)
  3. http://localhost:8000/v2/kafka/local/topic to show my test topic "test.jim1" does not appear
  4. create a topic in kafka called "test.jim1" with 1 partition
  5. change meta refresh interval to 30 seconds to force faster refresh of client.Topics call
  6. webpage shows 1 partition
  7. add partition to topic
  8. describe topics on kafka shows 2 partitions, after several metadata refreshes burrow still shows 1 partition
  9. on burrow restart, both partitions are now reflected.

Is this a regression or?
Figured I'd ask before digging into the code.

*updated, new topics works after the meta refresh internal, documenting partition refresh still doesn't

Activity

jiminoc

jiminoc commented on Sep 27, 2017

@jiminoc
ContributorAuthor

found it, PR coming

toddpalino

toddpalino commented on Sep 28, 2017

@toddpalino

Resolved by #251

DavidLiuXh

DavidLiuXh commented on Nov 29, 2017

@DavidLiuXh

Also need to do the same thing for addConsumerOffset function

if int(offset.Partition) >= len(consumerTopicMap) {
		// The partition count must have increased. Append enough extra partitions to our slice
		for i := len(consumerTopicMap); i < partitionCount; i++ {
			consumerTopicMap = append(consumerTopicMap, nil)
		}
}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

      Development

      No branches or pull requests

        Participants

        @jiminoc@toddpalino@DavidLiuXh

        Issue actions

          New topic information isn't picked up until restart · Issue #250 · linkedin/Burrow