spline-spark-agent | Spline agent for Apache Spark

spline-spark-agent is a Scala library. spline-spark-agent has no bugs, it has no vulnerabilities, it has a Permissive License and it has low support. You can download it from GitHub.

Spark Agent / Harvester ===. The Spline agent for Apache Spark is a complementary module to the [Spline project] that captures runtime lineage information from the Apache Spark jobs. The agent is a Scala library that is embedded into the Spark driver, listening to Spark events, and capturing logical execution plans. The collected metadata is then handed over to the lineage dispatcher, from where it can either be sent to the Spline server (e.g. via REST API or Kafka), or used in another way, depending on selected dispatcher type (see [Lineage Dispatchers] #dispatchers)). The agent can be used with or without a Spline server, depending on your use case. See [References] #references).