scala-csv | CSV Reader/Writer for Scala | CSV Processing library

I'm working on a rather big project. I need to use azure-security-keyvault-secrets, so I added following to my pom.xml file:

I am building a Spark application with bash script and I have an only spark-sql and core dependencies in the build.sbt file. So every time I call some rdd methods or convert the data to case class for dataset creation I get this error:

Buld.sbt

build.sbt

I have built 2 separate jar files with different main classes - KafkaCheckinsProducer and SparkConsumer, both of them are objects with main methods. In a bash script, I launch one of the jar files with parameters. I have a Dockerfile which launches this bash script. I launch my Dockerfile with this command:

I have multi-project with the main module called root, consumer and producer modules with dependencies which depend on the core module. The core modules hold configuration related classes. I would like to build 2 separate jars for consumer and producer with separate main classes with sbt-assembly. However, when I try to build them individually like this sbt consumer/assembly or altogether by running sbt assemblyI get such an error and sbt cannot compile the whole project:

I'm getting the following error on my sbt build. I'm trying to configure logentries logging on my Scala project. I have added all the required dependencies but I'm still getting the following errors

ch.qos.logback.core.util.DynamicClassLoadingException: Failed to instantiate type com.logentries.log4j.LogentriesAppender

I have a scenario where I want to write the result of a graph into a CSV. This includes the creation of the file, the initialisation of the file writer (I'm using this library) and finally, after the stream finishes, I would like to dispose/close the writer again.

Ideally, I would like to encapsulate this logic in a sink, but I'm wondering about the best practices / hooks for adding the initialization and disposal logic.

I'm using Play 2.6 with Scala - but this may not be a Play issue.

I've built the project using SBT, and found a lovely CSV file reader library I wanted to use in my project. So I import it into my build.sbt as follows: