kafka-connect-salesforce | Kafka Connect connector for reading data | REST library
kandi X-RAY | kafka-connect-salesforce Summary
kandi X-RAY | kafka-connect-salesforce Summary
This Kafka Connect connector integrates with the Salesforce Streaming Api to provide realtime updates to Kafka as objects are modified in SalesForce. This is done by registering a PushTopic for specific objects and fields. This object can be managed externally from the connector or you can specify salesforce.push.topic.create=true which will query the descriptor for the object specified in salesforce.object, generating a PushTopic for all of the fields in the descriptor. The descriptor will contain all of the fields that are available. The dynamically generated PushTopic will use all of the fields that are available at the time the PushTopic is created. If you manually create a PushTopic the schema will still include all of the fields that are defined in the descriptor.
Support
Quality
Security
License
Reuse
Top functions reviewed by kandi - BETA
- Starts the salesforce REST service
- Returns whether to force push topics should be created
- Sets whether the push topic should be deleted
- Sets whether the should push topic notifications should be created
- Handles a message
- Converts a JSON document to a SourceRecord
- Converts JSON data to a struct
- Returns the Kafka topic
- Calls the RestforceRestClient and returns the results
- Return the schema for the SObjectDescriptor
- Creates a Bayeuxio client
- Returns the schema for the given field descriptor
- Perform authentication
- Build the auth content
- Push a push topic
- Disconnect the client
- Get the version string
- Get configuration
- Sets the api version
- Compares two ApiVersion objects
- Get the list of all API versions
- Get all objects
- Return SObjectDescriptor
- Get a list of PushTopics
- Polls all available messages from queue
- Returns the error message
kafka-connect-salesforce Key Features
kafka-connect-salesforce Examples and Code Snippets
Community Discussions
Trending Discussions on kafka-connect-salesforce
QUESTION
happy new am experimenting with Kafka for the first time, i set up an AWS MSK Kafka cluster successfully, next step in my experiment is the using kafka-connect and in particular i want to use the salesforce-bulk-source connector, according to the documentation its say that this connector is a proprietary connector and it requires a confluent license as part of the configuration as well as a topic where to store here the confluent platform configuration, my question, does this connector work with an MSK cluster or would it require my cluster to be on the confluent platform?
...ANSWER
Answered 2021-Apr-12 at 19:45You can use the connector regardless of your Kafka cluster. You will need to run your own Kafka Connect worker, configured to use your Kafka cluster.
As you have noted, it is a proprietary connector and therefore:
- You can use it with a 30-day free trial
- or under the Developer Licence indefinitely if you have just a single Kafka broker
Here's an example of a Docker Compose to run Kafka Connect docker image.
Edit: You cannot use Confluent connectors that require a commercial license with MSK. You need a valid Confluent subscription.
Community Discussions, Code Snippets contain sources that include Stack Exchange Network
Vulnerabilities
No vulnerabilities reported
Install kafka-connect-salesforce
You can use kafka-connect-salesforce like any standard Java library. Please include the the jar files in your classpath. You can also use any IDE and you can run and debug the kafka-connect-salesforce component as you would do with any other Java program. Best practice is to use a build tool that supports dependency management such as Maven or Gradle. For Maven installation, please refer maven.apache.org. For Gradle installation, please refer gradle.org .
Support
Reuse Trending Solutions
Find, review, and download reusable Libraries, Code Snippets, Cloud APIs from over 650 million Knowledge Items
Find more librariesStay Updated
Subscribe to our newsletter for trending solutions and developer bootcamps
Share this Page