KeyValueStore | A generic PHP key-value API | REST library

Initial Question: I have a question how I can bind my GlobalStateStore to a processor. My Application has a GlobalStateStore with an own processor ("GlobalConfigProcessor") to keep the Store up to date. Also, I have another Processor ("MyClassProcessor") which is called in my Consumer Function. Now I try to access the store from MyClassProcessor, but I get an exception saying : Invalid topology: StateStore config_statestore is not added yet.

Update on current situation: I setup a test repository to give a better overview over my situation. This can be found here: https://github.com/fx42/store-example

As you can see in the repo, I have two Consumers which both consume different topics. The Config-Topic provides an event which I want to write to a GlobalStateStore. Here are the StateStoreUpdateConsumer.java and the StateStoreProcessor.java involved. With the MyClassEventConsumer.java I process another Input-Topic and want to read values from the GlobalStateStore. As provided in this doc I can't initialize GlobalStateStores just as StateStoreBean but instead I have to add this actively with the StreamsBuilderFactoryBeanCustomizer Bean. This Code is currently commented out in the StreamConfig.java. Without this code I get the Exception

I am trying to create a table from streaming through topic by changing the key but the value remains the same. Is it possible to avoid repartition?

We're using Kafka Streams with Spring Cloud Stream Functions. We have the typical example application which joins user clicks kstream with user regions ktable.

We know we can force custom names for internal changelog or repartition topics by using appropiate methods that accept a name for materialized store when defining our topology:

I am migrating a Kafka Streams implementation which uses pure Kafka apis to use spring-kafka instead as it's incorporated in a spring-boot application.

Everything works fine the Stream, GlobalKTable, branching that I have all works perfectly fine but I am having a hard time incorporating a ReadOnlyKeyValueStore. Based on the spring-kafka documentation here: https://docs.spring.io/spring-kafka/docs/2.6.10/reference/html/#streams-spring

It says:

If you need to perform some KafkaStreams operations directly, you can access that internal KafkaStreams instance by using StreamsBuilderFactoryBean.getKafkaStreams(). You can autowire StreamsBuilderFactoryBean bean by type, but you should be sure to use the full type in the bean definition.

Based on that I tried to incorporate it to my example as in the following fragments below:

I'm trying to create a generic protocol that can be reused in various parts throughout my application. Previously I've hardcoded KeyValueStore to only use String and Int for Key and Value respectively. I ran into an issue where I want a different consumer, class ConsumerB, to use KeyValueStore with Key/Value being Int/Int respectively.

We have 2 compacted topics, each containing terabytes of data, which we want to join using Spring Cloud Stream and Kafka Streams. The (simplified) code looks like this:

I am building a form using Easy Admin's FormBuilder. My goal is to have an AssociationField which represents a OneToMany relationship, for example, to assign multiple products to a shop. Additionally, I only want some filtered products to be listed, so I overrode the createEditFormBuilder method in the CrudController, I used this question as reference, and this is the code for the overridden function :

Right now I am using kafka data store (Rocks DB) for storing intermediate data from topics. I had written some interactive queries on top of this using https://kafka.apache.org/20/documentation/streams/developer-guide/interactive-queries.html

// Get the values for all of the keys available in this application instance

I have a use case in which inside a consumer, I use a materializedview to execute some businesslogic (as shown in the code below). On restart of the spring boot application materializedview gets recreated from kafka topic, depending upon messages on the topic it can take small dealy to come into running state. If during this delay an message arrives on the other consumer which has the dependency on this MV to execute its logic then it fails.

Consumer 1