zkclient | zookeeper client , that makes life

I am trying to stream from a Kafka topic to Google BigQuery. My connect-standalone.properties file is as follows:

I'm currently trying to implement a debezium connector. I've used JDBC connector as introduction but I need log-based CDC. I'm using a docker-compose.yml file to establish all configuration and the database is based on Oracle.

I'm stuck because I'm getting this error "ERROR io.confluent.admin.utils.ClusterStatus - Expected 1 brokers but found only 0. Brokers found []."

Here is my docker-compose file:

Is there a simpler way to build this docker-compose?

I want to create kafka topic in Java. I have a sample code from stackoverflow. But the problem is that I couldn't import ZKStringSerializer$ and ZkUtils. I have all maven dependencies. What is the reason? Her is the code:

QUESTION:
How do I configure "securityMechanism=9, encryptionAlgorithm=2" for a db2 database connection in my docker-compose file?

NOTE: When running my local kafka installation (kafka_2.13-2.6.0) to connect to a db2 database on the network, I only had to modify the bin/connect-standalone.sh file by modifying the existing "EXTRA_ARGS=" line like this:

I'm creating a kakfa topic which comes from an xml and writes to the topic in avro format. I'm using the file pulse to do this, and in the documentation I saw the ExplodeFilter. I tried to configure according to the documentation, but it is not working. The connect docker console is giving the following error:

One of Kafka new change in the upgrade from 2.3.0 to 2.5.0 is removing ZkUtils (see https://issues.apache.org/jira/browse/KAFKA-8545)

what is the best practice to remove the use and which package should I use instead

I am working on to create pipeline to stream data from oracle database. I am using below compose file to UP the required services for Kafka and using command option to download the ojdbc jar. I have explicitly checked the curl command used in this compose file and I am able to download jar and this should work fine here also.

I am able to UP the stacks of all required services without any issue. But, when I am navigating to kafka-connect-jdbc folder to look for ojdbc jar, I couldn't see there. Ideally, it should be downloaded and placed in the kafka-connect-jdbc jar.

docker-compose.yml file:

I have a kafka connect jar which needs to be run as a docker container. I need to capture all my connect logs on a log file in the container (preferably at a directory/file - /etc/kafka/kafka-connect-logs) which can later be pushed to localhost (on which docker engine is running) using volumes in docker. When I change my connect-log4j.properties to append into a log file, I see that no log file is created. If I try the same without docker and run the kafka connect on a local linux VM by changing connect-log4j.properties to write logs to a log file, it works perfectly but not from docker. Any suggestions will be very helpful.

Docker File

Currently two types of Kafka Connect log are being collected.

• connect-rest.log.2018-07-01-21, connect-rest.log.2018-07-01-22 ...
• connectDistributed.out

The thing is that I don't know how to configure connectDistributed.out file in Kafka Connect. Following is the sample output of the file: