connect-js | Anvil Connect JavaScript client for web browsers | Websocket library

I'm streaming topic with Kafka_2.12-3.0.0 on Ubuntu in standalone mode to PosgreSQL and getting deserialization error.

Using confluent_kafka from pip package to produce kafka stream in python (works ok):

I have used this document for creating kafka https://kow3ns.github.io/kubernetes-kafka/manifests/

able to create zookeeper, facing issue with the creation of kafka.getting error to connect with the zookeeper.

this is the manifest i have used for creating for kafka:

https://kow3ns.github.io/kubernetes-kafka/manifests/kafka.yaml for Zookeeper

https://github.com/kow3ns/kubernetes-zookeeper/blob/master/manifests/zookeeper.yaml

The logs of the kafka

I'm trying to start a Snowflake Connector instance for Kafka, following this tutorial: https://docs.snowflake.com/en/user-guide/kafka-connector-install.html

I am trying to stream from a Kafka topic to Google BigQuery. My connect-standalone.properties file is as follows:

Background

I am trying to create an envelope with the REST v2.1 API which has a textCustomField associated with it (for some individualised information about each envelope). I also want to set an envelope-level DocuSign Connect webhook (with the eventNotification) which will also include the customFields, so that I can pick this up at the HTTP listener. However, it doesn't seem clear in the documentation how to ensure that the envelope-level webhook includes the customFields (whereas this seems clearly possible when setting a Connect custom configuration at an Account level with the tickboxes when configuring the custom Connect configuration - and I can see this working at an HTTP listener). This Q&A (Does DocuSign Connect support JSON data or payloads?) about Connect seems to indicate that you can includeData for the eventNotification through eventData. When I try to test this with Postman, I seem to be able to create the envelope custom fields when creating the envelope, which I can check with the GET custom field info for an envelope, but these are not being included with the webhook request.

The question

Is it possible to includeData for the Envelope Custom Fields when registering the webhook at an envelope level or is this only possible from an Account level using Connect? If so, what is the correct property for including customFields in the webhook notification when creating the envelope via the REST API (as includeData doesn't seem to work)?

Examples

Excerpts of what I have been trying as the body of the request and what is received by the webhook below (with redactions):

Body of the Create Envelope request:

What I'm trying to accomplish is exactly what this question about (Here) however; In my case I'm using Python/Pyspark Not Scala.

I'm trying to extract "payload" part of Kafka connect message that include schema as well.

Sample message :

I am trying to install kafka in ubuntu. I have downloaded the kafka tar.gz file,unzipped it. started the zookeeper server .While trying to start the kafka server, getting the timeout exception.

Can some one pls let me know the resolution.

I am trying Kafka connect for the first time and I want to connect SAP S/4 HANA to Hive. I have created the SAP S/4 source Kafka connector using this:

https://github.com/SAP/kafka-connect-sap

But, I am not able to create an HDFS sink connector. The issue is related to pom file.

I have tried mvn clean package. But, I got this error:

I am very new to using Microservices and having trouble running Kafka after I have started zookeeper.

Zookeeper starts fine but when I try to start my Kafka server it throws an error.

I have searched on google to try and solve my problem but its quite overwhelming, as I am not sure what all these different config files mean/do.

I have tried by enabling listeners=PLAINTEXT://:9092 in server settings but it doesn't work.

I have also tried to un and reinstalled Kafka and ZooKeeper but I still get the same error.