parquet4s | Use Scala classes

by mjakubowski84 Scala Version: v2.10.1 License: MIT

X-Ray Key Features Code Snippets Community Discussions(2)Vulnerabilities Install Support

kandi X-RAY | parquet4s Summary

parquet4s is a Scala library typically used in Big Data, Kafka, Spark, Hadoop applications. parquet4s has no bugs, it has no vulnerabilities, it has a Permissive License and it has low support. You can download it from GitHub.

Parquet4s is a simple I/O for Parquet. Allows you to easily read and write Parquet files in Scala. Use just a Scala case class to define the schema of your data. No need to use Avro, Protobuf, Thrift or other data serialisation systems. You can use generic records if you don't want to use the case class, too. Compatible with files generated with Apache Spark. However, unlike in Spark, you do not have to start a cluster to perform I/O operations. Based on official Parquet library, Hadoop Client and Shapeless (Shapeless is not in use in a version for Scala 3). As it is based on Hadoop Client then you can connect to any Hadoop-compatible storage like AWS S3 or Google Cloud Storage. Integrations for Akka Streams and FS2. Released for Scala 2.12.x, 2.13.x and 3.0.x. Akka module is available for Scala 2.12.x and 2.13.x.

Support

Quality

Security

License

Reuse

Support

parquet4s has a low active ecosystem.

It has 237 star(s) with 55 fork(s). There are 7 watchers for this library.

It had no major release in the last 12 months.

There are 11 open issues and 136 have been closed. On average issues are closed in 49 days. There are no pull requests.

It has a neutral sentiment in the developer community.

The latest version of parquet4s is v2.10.1

Quality

parquet4s has no bugs reported.

Security

parquet4s has no vulnerabilities reported, and its dependent libraries have no vulnerabilities reported.

License

parquet4s is licensed under the MIT License. This license is Permissive.

Permissive licenses have the least restrictions, and you can use them in most projects.

Reuse

parquet4s releases are available to install and integrate.

Top functions reviewed by kandi - BETA

kandi's functional review helps you automatically verify the functionalities of the libraries and avoid rework.
Currently covering the most popular Java, JavaScript and Python libraries. See a Sample of parquet4s

Get all kandi verified functions for this library.

parquet4s Key Features

No Key Features are available at this moment for parquet4s.

parquet4s Examples and Code Snippets

No Code Snippets are available at this moment for parquet4s.

Community Discussions

Trending Discussions on parquet4s

How do I make these function definitions D.R.Y.?

Scala factory method for libraries with different implicits

QUESTION

How do I make these function definitions D.R.Y.?

Asked 2020-Jun-23 at 23:00

I have multiple function definitions to write a parquet file, but I'd rather have one general function. How can I make one general function work? The problem is that one general function returns error
could not find implicit value for parameter writerFactory: com.github.mjakubowski84.parquet4s.ParquetWriter.ParquetWriterFactory[Product]

Multiple functions:

...

ANSWER

Answered 2020-Jun-23 at 22:54

Just make the function generic:

Source https://stackoverflow.com/questions/62544898

QUESTION

Scala factory method for libraries with different implicits

Asked 2019-Nov-15 at 14:28

I want to support Json and Parquet file formats. Client should not care about their implementation, but one must pass a type to identify format.

So far I have two classes with such signature:

...