kafka-connect-oracle-cdc | Demonstration Oracle CDC Source Connector | Change Data Capture library
kandi X-RAY | kafka-connect-oracle-cdc Summary
kandi X-RAY | kafka-connect-oracle-cdc Summary
Demonstration Oracle CDC Source Connector with Kafka Connect
Support
Quality
Security
License
Reuse
Top functions reviewed by kandi - BETA
Currently covering the most popular Java, JavaScript and Python libraries. See a Sample of kafka-connect-oracle-cdc
kafka-connect-oracle-cdc Key Features
kafka-connect-oracle-cdc Examples and Code Snippets
Community Discussions
Trending Discussions on kafka-connect-oracle-cdc
QUESTION
I had successfully created a custom kafka connector image containing confluent hub connectors.
I am trying to create pod and service to launch it in GCP with kubernetes.
How should I configure yaml file ? The next part of code I took from quick-start guide. This is what I've tried: Dockerfile:
...ANSWER
Answered 2022-Jan-26 at 16:23After some retries I found out that I just had to wait a little bit longer.
QUESTION
I have setup a simple Kafka connect process to connect to and detect changes in an Oracle CDB/PDB environment.
Have setup all components successfully with no errors - tables created, users can query, topics get created etc. However, I'm facing an issue with the CDC process where "New records are not populating my table-specific topic".
There is an entry for this issue in the confluent troubleshooting guide here: https://docs.confluent.io/kafka-connect-oracle-cdc/current/troubleshooting.html#new-records-are-not-populating-my-table-specific-topic
But when reading this I'm unsure as it can be interpreted multiple ways depending on how you look at it:
New records are not populating my table-specific topic
The existing schema (of the table-specific topic?) may not be compatible with the redo log topic (incompatible redo schema or incompatible redo topic itself?). Removing the schema (the table-specific or redo logic schema?) or using a different redo log topic may fix this issue (a different redo topic? why?)
From this I've had no luck trying to get my process to detect the changes. Looking for some support to fully understand this solution above from Confluent.
...ANSWER
Answered 2022-Jan-21 at 17:50In our case the reason was in absence of redo.log.consumer.bootstrap.servers
setting. Also, the redo topic name setting redo.log.topic.name
was important to set.
Assumption: it seems, that in case of 'snapshot' mode, the connector brings initial data to table topics and then starts to pull the redo log and write relevant entries to 'redo' topic. In parallel, as a separate task, it starts a consumer task to read from redo topic, and that consumer task actually writes CDC changes to table topics. That's why the 'redo.log.consumer.*' settings are relevant to configure.
Community Discussions, Code Snippets contain sources that include Stack Exchange Network
Vulnerabilities
No vulnerabilities reported
Install kafka-connect-oracle-cdc
Support
Reuse Trending Solutions
Find, review, and download reusable Libraries, Code Snippets, Cloud APIs from over 650 million Knowledge Items
Find more librariesStay Updated
Subscribe to our newsletter for trending solutions and developer bootcamps
Share this Page