Big Data Libraries - Page 6

Convenient and performant logging library for Scala wrapping SLF4J.

Scala 890Updated: 2 y ago License: Permissive (Apache-2.0)

Public runnable examples of using John Snow Labs' NLP for Apache Spark.

Jupyter Notebook 888Updated: 2 y ago License: Permissive (Apache-2.0)

The analytical engine for TiDB and TiDB Cloud. Try free: https://tidbcloud.com/free-trial

C++ 887Updated: 2 y ago License: Permissive (Apache-2.0)

CTR prediction model based on spark(LR, GBDT, DNN)

Scala 872Updated: 2 y ago License: Permissive (Apache-2.0)

hadoop各组件使用，持续更新

Java 865Updated: 2 y ago License: No License (No License)

Postgres to Elasticsearch/OpenSearch sync

Python 860Updated: 2 y ago License: Weak Copyleft (LGPL-3.0)

TiSpark is built for running Apache Spark on top of TiDB/TiKV

Scala 856Updated: 2 y ago License: Permissive (Apache-2.0)

定期更新Hadoop生态圈中常用大数据组件文档 重心依次为: Flink Solr Sparksql ES Scala Kafka Hbase/phoenix Redis Kerberos (项目包含hadoop思维导图 印象笔记 Scala版本简单demo 常用工具类 去敏后的train code 持续更新!!!)

Java 853Updated: 2 y ago License: No License (No License)

Expressive types for Spark.

Scala 851Updated: 2 y ago License: Permissive (Apache-2.0)

Scalable, fast, and lightweight system for large-scale topic modeling

C++ 849Updated: 2 y ago License: Permissive (MIT)

电商用户行为分析大数据平台

Java 847Updated: 2 y ago License: Permissive (Apache-2.0)

Accelerate SHA256 computations in pure Go using AVX512, SHA Extensions for x86 and ARM64 for ARM. On AVX512 it provides an up to 8x improvement (over 3 GB/s per core). SHA Extensions give a performance boost of close to 4x over native.

Go 837Updated: 2 y ago License: Permissive (Apache-2.0)

A common bricks library for building scalable and portable distributed machine learning.

C++ 835Updated: 2 y ago License: Permissive (Apache-2.0)

An extensible distributed system for reliable nearline data streaming at scale

Java 833Updated: 2 y ago License: Permissive (BSD-2-Clause)

Apache Metron

Java 826Updated: 4 y ago License: Permissive (Apache-2.0)

Apache Metron

Java 825Updated: 4 y ago License: Permissive (Apache-2.0)

Convenient and performant logging library for Scala wrapping SLF4J.

Scala 821Updated: 4 y ago License: Permissive (Apache-2.0)

This is a guide to PySpark code style presenting common situations and the associated best practices based on the most frequent recurring topics across the PySpark repos we've encountered.

Python 813Updated: 2 y ago License: Permissive (MIT)

A new lossy/lossless image format for photos and the internet

C++ 810Updated: 2 y ago License: Permissive (MIT)

Use Jupyter Notebooks to demonstrate how to build a Recommender with Apache Spark & Elasticsearch

Jupyter Notebook 808Updated: 2 y ago License: Permissive (Apache-2.0)

A scalable, mature and versatile web crawler based on Apache Storm

HTML 803Updated: 2 y ago License: Permissive (Apache-2.0)

Dashboard for Apache APISIX

Go 802Updated: 2 y ago License: Permissive (Apache-2.0)

Apache Arrow Ballista Distributed Query Engine

Rust 801Updated: 2 y ago License: Permissive (Apache-2.0)

Go library providing algorithms optimized to leverage the characteristics of modern CPUs

Go 784Updated: 2 y ago License: Permissive (MIT)

[DEPRECATED] Tensorflow wrapper for DataFrames on Apache Spark

Scala 761Updated: 3 y ago License: Permissive (Apache-2.0)

💥🔥 大数据生态解决方案数据平台：基于大数据、数据平台、微服务、机器学习、商城、自动化运维、DevOps、容器部署平台、数据平台采集、数据平台存储、数据平台计算、数据平台开发、数据平台应用搭建的大数据解决方案。

Java 760Updated: 3 y ago License: Strong Copyleft (GPL-3.0)

SQL data analysis & visualization projects using MySQL, PostgreSQL, SQLite, Tableau, Apache Spark and pySpark.

Jupyter Notebook 758Updated: 2 y ago License: Permissive (MIT)

Apache Ranger - To enable, monitor and manage comprehensive data security across the Hadoop platform and beyond

Java 756Updated: 2 y ago License: Permissive (Apache-2.0)

Fast Base64 stream encoder/decoder in C99, with SIMD acceleration

C 751Updated: 2 y ago License: Permissive (BSD-2-Clause)

Scalable identity resolution, entity resolution, data mastering and deduplication using ML

Java 739Updated: 2 y ago License: Strong Copyleft (AGPL-3.0)

Apache Livy is an open source REST interface for interacting with Apache Spark from anywhere.

Scala 735Updated: 2 y ago License: Permissive (Apache-2.0)

Productionise & schedule your Jupyter Notebooks as easily as you wrote them.

Python 731Updated: 2 y ago License: Strong Copyleft (AGPL-3.0)

Library for specialized dense and sparse matrix operations, and deep learning primitives.

C 729Updated: 2 y ago License: Permissive (BSD-3-Clause)

Mirror of Apache Bahir Flink

Java 727Updated: 2 y ago License: Permissive (Apache-2.0)

C++ 720Updated: 2 y ago License: Permissive (Apache-2.0)

Read - Write JSON SerDe for Apache Hive.

Java 717Updated: 2 y ago License: Proprietary (Proprietary)

A place for all things related to ye olde Spark Thermostat Hackathon

Ruby 717Updated: 4 y ago License: Permissive (MIT)

Essential Spark extensions and helper methods ✨😲

Scala 713Updated: 2 y ago License: Permissive (MIT)

Mirror of Apache Toree (Incubating)

Scala 712Updated: 2 y ago License: Permissive (Apache-2.0)

An open source framework for building data analytic applications.

Java 706Updated: 2 y ago License: Proprietary (Proprietary)

Python DB API 2.0 client for Impala and Hive (HiveServer2 protocol)

Python 702Updated: 2 y ago License: Permissive (Apache-2.0)

Modular node graph based noise generation library using SIMD, C++17 and templates

C++ 702Updated: 2 y ago License: Permissive (MIT)

AR相册 Photo Album For AR

Swift 680Updated: 2 y ago License: No License (No License)

A Ruby client for the Cassandra distributed database

Ruby 677Updated: 4 y ago License: Permissive (Apache-2.0)

docker-compose.yml files for cp-all-in-one , cp-all-in-one-community, cp-all-in-one-cloud, Apache Kafka Confluent Platform

Python 674Updated: 2 y ago License: No License (No License)

Apache HAWQ

C 673Updated: 2 y ago License: Permissive (Apache-2.0)

The testing ground for the future of portable SIMD in Rust

Rust 673Updated: 2 y ago License: Permissive (Apache-2.0)

TonY is a framework to natively run deep learning frameworks on Apache Hadoop.

Java 672Updated: 3 y ago License: Proprietary (Proprietary)

OpenShift 3 and 4 product and community documentation

HTML 670Updated: 2 y ago License: Permissive (Apache-2.0)

The MongoDB Spark Connector

Java 669Updated: 2 y ago License: Permissive (Apache-2.0)