hayat | Hayat is a script for report and analyze Google Cloud | GCP library

Libraries spark-streaming and spark-core don't exist, it is spark-streaming_2.12 and spark-core_2.12, where 2.12 is the Scala version. Currently there are no spark-streaming_3.0 and spark-core_3.0 libraries.

So to solve your issue, you need to:

• downgrade your version of scala from 3.0.2 to 2.12.x (latest current version, 2.12.15) as there is no version of Spark for Scala 3
• use spark-streaming_2.12 library instead of spark-streaming
• use spark-core_2.12 library instead of spark-core

To use _2.12 version of libraries, you can either add _2.12 to your library name:

You have to put your test.txt inside your assets folder in your project directory.

Also, it would be better if you could add your project directory structure to your post.

Instead of this,

The solution is simple. You need to add a schemaVersion property to your root class and annotate it with @XmlAttribute, not with @XmlElement.

I wrote some code that converts the flatObj you gave to the nestedObj you gave. You didn't specify any criteria so it might not do exactly what you want.

Edit added a whole lot of if else to check for each step.

you can use the aggregate pipeline with $lookup instead of find with populate

something like this

You only print once because that's exactly what are telling the programm to do