scalalogging | Convenient and performant logging in Scala | JSON Processing library

Welcome to dependency hell and breaking changes in libraries.

This usually happens, when various lib bring in different version of same lib. In this case it is Jackson. java.lang.NoSuchMethodError: com.fasterxml.jackson.dataformat.xml.XmlMapper.coercionConfigDefaults()Lcom/fasterxml/jackson/databind/cfg/MutableCoercionConfig; means: One lib probably require Jackson version, which has this method, but on class path is version, which does not yet have this funcion or got removed bcs was deprecated or renamed.

In case like this is good to print dependency tree and check version of Jackson required in libs. And if possible use newer versions of requid libs.

Solution: use libs, which use compatible versions of Jackson lib. No other shortcut possible.

The log4j file cannot be found because, I guess, mingw or similar shell environments in Windows aren't really tested in the Kafka source code. That's why there's .bat scripts instead. If you want to use a Linux shell, uninstall Git Bash and use WSL2

Besides that, it's irrelevant to the actual error. You need to use --bootstrap-server localhost:9092 instead of the Zookeeper flag in order to consume from Kafka.

Refer the official documentation (which is for Linux), but the command arguments are all the same, even if you use the windows scripts

http://kafka.apache.org/quickstart

when you create your cluster in databricks, there is a tab where you can specify the log directory (empty by default).

Logs are written on DBFS, so you just have to specify the directory you want.

You can use like the code below in Databricks Notebook.

The error messages explain that there are two versions of logger, one in org.slf4j.Logger and the other in com.typesafe.scalalogging.Logger. These conflict with each other, so you need to drop one. InitSpark appears to use the first of these, so use the same type in the second trait as well:

These exceptions are not related to ZooKeeper. They are thrown by log4j as it's not allowed to write to the specified files. These should not prevent Kafka from running but obviously you won't get log4j logs.

When starting Kafka with bin/kafka-server-start.sh, the default log4j configuration file, log4j.properties, is used. This attempts to write logs to ../logs/, see https://github.com/apache/kafka/blob/trunk/bin/kafka-run-class.sh#L194-L197

In your case, this path is /usr/local/kafka/bin/../logs and Kafka is not allowed to write there.

You can change the default path by setting the LOG_DIR environment variable to a path where Kafka will be allowed to write logs, for example:

Your code does not create connections. It creates MongoClient instances.

As such you cannot "create a new connection". MongoDB drivers do not provide an API for applications to manage connections.

Connections are managed internally by the driver and are created and destroyed automatically as needed in response to application requests/commands. You can configure connection pool size and when stale connections are removed from the pool.

Furthermore, execution of a single application command may involve multiple connections (up to 3 easily, possibly over 5 if encryption is involved), and the connection(s) used depend on the command/query. Checking the health of any one connection, even if it was possible, wouldn't be very useful.

Your error messages is associated with each other. First error tells us that compiler couldn't find object SttpBackends which has field of SttpBackend. The second one tells us that compiler couldn't find implicit backend: SttpBackend for constructing FutureSttpClient. It requires two implicits: SttpBackend and ExecutionContext.

Try using circe by Cats.

• add circe to your project (https://circe.github.io/circe/ - Quick Start).
• create a case class that represent what you want to build from your json.
• declare a decoder

https://circe.github.io/circe/codecs/semiauto-derivation.html https://github.com/circe/circe

The problem is due to these lines in your parent actor: