Spark Libraries - Page 4

A Spark DSL in idiomatic kotlin // dependency: com.sparkjava:spark-kotlin:1.0.0-alpha

Kotlin 955Updated: 3 y ago License: Permissive (Apache-2.0)

学习记录的一些笔记，以及所看得一些电子书eBooks、视频资源和平常收纳的一些自己认为比较好的博客、网站、工具。涉及大数据几大组件、Python机器学习和数据分析、Linux、操作系统、算法、网络等

Python 951Updated: 1 y ago License: Strong Copyleft (GPL-2.0)

ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark, and Apache Parquet. Apache 2 licensed.

Scala 943Updated: 1 y ago License: Permissive (Apache-2.0)

Sparkling Water provides H2O functionality inside Spark cluster

Scala 943Updated: 12 mo ago License: Permissive (Apache-2.0)

C# and F# language binding and extensions to Apache Spark

C# 939Updated: 1 y ago License: Permissive (MIT)

Wormhole is a SPaaS (Stream Processing as a Service) Platform

JavaScript 937Updated: 2 y ago License: Proprietary (Proprietary)

大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料

Java 935Updated: 3 y ago License: No License (No License)

Scala 934Updated: 11 mo ago License: Permissive (Apache-2.0)

Mirror of Apache Sqoop

Java 933Updated: 1 y ago License: Permissive (Apache-2.0)

This is the github repo for Learning Spark: Lightning-Fast Data Analytics [2nd Edition]

Scala 909Updated: 1 y ago License: Permissive (Apache-2.0)

A connector for Spark that allows reading and writing to/from Redis cluster

Scala 908Updated: 12 mo ago License: Permissive (BSD-3-Clause)

R interface for Apache Spark

R 906Updated: 11 mo ago License: Permissive (Apache-2.0)

A Time Series Library for Apache Spark

Scala 901Updated: 3 y ago License: Permissive (Apache-2.0)

Distributed machine learning platform

C++ 893Updated: 3 y ago License: Proprietary (Proprietary)

Public runnable examples of using John Snow Labs' NLP for Apache Spark.

Jupyter Notebook 888Updated: 11 mo ago License: Permissive (Apache-2.0)

Cloud-native genomic dataframes and batch computing

Python 881Updated: 12 mo ago License: Permissive (MIT)

CTR prediction model based on spark(LR, GBDT, DNN)

Scala 872Updated: 1 y ago License: Permissive (Apache-2.0)

hadoop各组件使用，持续更新

Java 865Updated: 1 y ago License: No License (No License)

Ready to use log management solution for Kubernetes storing data in ClickHouse and providing web UI.

Ruby 863Updated: 2 y ago License: Permissive (Apache-2.0)

Postgres to Elasticsearch/OpenSearch sync

Python 860Updated: 11 mo ago License: Weak Copyleft (LGPL-3.0)

TiSpark is built for running Apache Spark on top of TiDB/TiKV

Scala 856Updated: 11 mo ago License: Permissive (Apache-2.0)

定期更新Hadoop生态圈中常用大数据组件文档 重心依次为: Flink Solr Sparksql ES Scala Kafka Hbase/phoenix Redis Kerberos (项目包含hadoop思维导图 印象笔记 Scala版本简单demo 常用工具类 去敏后的train code 持续更新!!!)

Java 853Updated: 1 y ago License: No License (No License)

Ruby 853Updated: 1 y ago License: Permissive (Apache-2.0)

Expressive types for Spark.

Scala 851Updated: 11 mo ago License: Permissive (Apache-2.0)

电商用户行为分析大数据平台

Java 847Updated: 12 mo ago License: Permissive (Apache-2.0)

An open-source framework for real-time anomaly detection using Python, ElasticSearch and Kibana

Python 836Updated: 3 y ago License: Permissive (Apache-2.0)

An extensible distributed system for reliable nearline data streaming at scale

Java 833Updated: 11 mo ago License: Permissive (BSD-2-Clause)

Apache Metron

Java 826Updated: 3 y ago License: Permissive (Apache-2.0)

Apache Metron

Java 825Updated: 3 y ago License: Permissive (Apache-2.0)

Convenient and performant logging library for Scala wrapping SLF4J.

Scala 821Updated: 3 y ago License: Permissive (Apache-2.0)

This is a guide to PySpark code style presenting common situations and the associated best practices based on the most frequent recurring topics across the PySpark repos we've encountered.

Python 813Updated: 11 mo ago License: Permissive (MIT)

Use Jupyter Notebooks to demonstrate how to build a Recommender with Apache Spark & Elasticsearch

Jupyter Notebook 808Updated: 12 mo ago License: Permissive (Apache-2.0)

An on-line movie recommender using Spark, Python Flask, and the MovieLens dataset

Jupyter Notebook 803Updated: 1 y ago License: Proprietary (Proprietary)

Pyspark RDD, DataFrame and Dataset Examples in Python language

Python 799Updated: 12 mo ago License: No License (No License)

Shell 769Updated: 3 y ago License: Permissive (Apache-2.0)

[DEPRECATED] Tensorflow wrapper for DataFrames on Apache Spark

Scala 761Updated: 2 y ago License: Permissive (Apache-2.0)

Apache Livy is an open source REST interface for interacting with Apache Spark from anywhere.

Scala 735Updated: 1 y ago License: Permissive (Apache-2.0)

Support content for my blog

Jupyter Notebook 733Updated: 1 y ago License: Proprietary (Proprietary)

Productionise & schedule your Jupyter Notebooks as easily as you wrote them.

Python 731Updated: 12 mo ago License: Strong Copyleft (AGPL-3.0)

Code examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.

Scala 730Updated: 3 y ago License: Proprietary (Proprietary)

Mirror of Apache Bahir Flink

Java 727Updated: 1 y ago License: Permissive (Apache-2.0)

IPython Cookbook, Second Edition, by Cyrille Rossant, Packt Publishing 2018

Python 722Updated: 3 y ago License: Proprietary (Proprietary)

C++ 720Updated: 1 y ago License: Permissive (Apache-2.0)

Read - Write JSON SerDe for Apache Hive.

Java 717Updated: 1 y ago License: Proprietary (Proprietary)

A place for all things related to ye olde Spark Thermostat Hackathon

Ruby 717Updated: 3 y ago License: Permissive (MIT)

Essential Spark extensions and helper methods ✨😲

Scala 713Updated: 1 y ago License: Permissive (MIT)

Mirror of Apache Toree (Incubating)

Scala 712Updated: 1 y ago License: Permissive (Apache-2.0)

An open source framework for building data analytic applications.

Java 706Updated: 12 mo ago License: Proprietary (Proprietary)

Java Statistical Analysis Tool, a Java library for Machine Learning

Java 693Updated: 3 y ago License: Strong Copyleft (GPL-3.0)

A machine learning package for streaming data in Python. The other ancestor of River.

Python 691Updated: 11 mo ago License: Permissive (BSD-3-Clause)