Skip to content

Kafka Connector: Consumer Topic + Grouped Topic Support#139

Open
Kuroshii wants to merge 3 commits into
developfrom
kafka-topic-and-grouped-topic-support
Open

Kafka Connector: Consumer Topic + Grouped Topic Support#139
Kuroshii wants to merge 3 commits into
developfrom
kafka-topic-and-grouped-topic-support

Conversation

@Kuroshii
Copy link
Copy Markdown
Collaborator

Changes:

  • Index KafkaController instances based on both topic name and the chosen groupId for a topic this way, each different GroupedTopicSources gets it's own underlying KafkaConsumer
  • If class-annotated, a TopicSource is identified by both the default groupId and it's class's name
  • Add tests for the way sources are mapped

I ran all the tests locally and they all eventually passed after a rerun and 2GB of memory. Having another look at our integration tests is a good idea.


Please Review: @seanmrogers @dkessler-sofi @AFrieze

@Kuroshii Kuroshii force-pushed the kafka-topic-and-grouped-topic-support branch from 5ce9869 to 9a6817a Compare October 16, 2017 19:02
@dcshock
Copy link
Copy Markdown
Owner

dcshock commented Dec 3, 2017

@Kuroshii can you add a release note to the README and update the version for release? Thanks

@Kuroshii Kuroshii force-pushed the kafka-topic-and-grouped-topic-support branch from 9a6817a to 34dd22b Compare December 4, 2017 16:36
@Kuroshii Kuroshii force-pushed the kafka-topic-and-grouped-topic-support branch 2 times, most recently from f12a7f1 to 2190542 Compare March 13, 2018 00:25
@Kuroshii Kuroshii force-pushed the kafka-topic-and-grouped-topic-support branch from 2190542 to 20b3900 Compare March 13, 2018 00:26
@dcshock
Copy link
Copy Markdown
Owner

dcshock commented Jul 17, 2020

@Kuroshii is this something that we'd like to get merged in? I'm not familiar enough with the kafka connector to make the assessment.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants