cdc | Change Data Capture platform example using MySQL , Maxwell | Change Data Capture library

i want to take a screen shoot than transfroming it to an array without saving the file as image in a path and loading it again from the path to convert it :

what i want is directly convert the data to an array :

I'm new to Cassandra and I've been having some issues trying to delete multiple rows in table. I have a table defined as follows:

Here's an example of DF:

I have setup a simple Kafka connect process to connect to and detect changes in an Oracle CDB/PDB environment.

Have setup all components successfully with no errors - tables created, users can query, topics get created etc. However, I'm facing an issue with the CDC process where "New records are not populating my table-specific topic".

There is an entry for this issue in the confluent troubleshooting guide here: https://docs.confluent.io/kafka-connect-oracle-cdc/current/troubleshooting.html#new-records-are-not-populating-my-table-specific-topic

But when reading this I'm unsure as it can be interpreted multiple ways depending on how you look at it:

New records are not populating my table-specific topic
The existing schema (of the table-specific topic?) may not be compatible with the redo log topic (incompatible redo schema or incompatible redo topic itself?). Removing the schema (the table-specific or redo logic schema?) or using a different redo log topic may fix this issue (a different redo topic? why?)

From this I've had no luck trying to get my process to detect the changes. Looking for some support to fully understand this solution above from Confluent.

I am trying to build a docker image with a PHP application in it.

This application installs some dependencies via composer.json and, after composer install, needs some customizations done (eg some files must be copied from vendor folder into other locations and so on).

So I have written these steps as bash commands and putted in the composer.json post-install-cmd section.

This is my composer.json (I've omitted details, but the structure is the same):

I'm trying to use Kafka Streams to perform KTable-KTable foreign key joins on CDC data. The data I will be reading is in Avro format, however it is serialized in a manner that wouldn't be compatible with other industry serializer/deserializers (ex. Confluent schema registry) because the schema identifiers are stored in the headers.

When I setup my KTables' Serdes, my Kafka Streams app runs initially, but ultimately fails because it internally invokes the Serializer method with byte[] serialize(String topic, T data); and not a method with headers (ie. byte[] serialize(String topic, Headers headers, T data) in the wrapping serializer ValueAndTimestampSerializer. The Serdes I'm working with cannot handle this and throw an exception.

First question is, does anyone know a way to implore Kafka Streams to call the method with the right method signature internally?

I'm exploring approaches to get around this, including writing new Serdes that re-serialize with the schema identifiers in the message itself. This may involve recopying the data to a new topic or using interceptors.

However, I understand ValueTransformer has access to headers in the ProcessorContext and I'm wondering if there might there be a faster way using transformValues(). The idea is to first read the value as a byte[] and then deserialize the value to my Avro class in the transformer (see example below). When I do this however, I'm getting an exception.

I am trying to read with pandas the file you find here. I saved in the local directory. I am forced to use Python 3.6

I have created this pipelined function for fetching configuration from a table which is stored in a DB that I need to access via a DB link:

I am adding a new code logic, using CDC (capture data change) events. A status field coming from the DB is represented as an int and should be deserialized into an enum. This is the enum: