Hadoop Libraries - Page 3

A common bricks library for building scalable and portable distributed machine learning.

C++ 835Updated: 1 y ago License: Permissive (Apache-2.0)

Apache Metron

Java 826Updated: 3 y ago License: Permissive (Apache-2.0)

Apache Metron

Java 825Updated: 3 y ago License: Permissive (Apache-2.0)

equivalent to kafka-streams :octopus: for nodejs :sparkles::turtle::rocket::sparkles:

TypeScript 734Updated: 2 y ago License: Permissive (MIT)

docker-compose.yml files for cp-all-in-one , cp-all-in-one-community, cp-all-in-one-cloud, Apache Kafka Confluent Platform

Python 674Updated: 1 y ago License: No License (No License)

Apache HAWQ

C 673Updated: 1 y ago License: Permissive (Apache-2.0)

TonY is a framework to natively run deep learning frameworks on Apache Hadoop.

Java 672Updated: 2 y ago License: Proprietary (Proprietary)

distributed_computing include mapreduce kvstore etc.

Go 669Updated: 3 y ago License: Permissive (MIT)

This page is a summary to keep the track of Hadoop related projects, and relevant projects around Big Data scene focused on the open source, free software environment.

HTML 667Updated: 3 y ago License: Permissive (Apache-2.0)

Scalable, redundant, and distributed object store for Apache Hadoop

Java 658Updated: 10 mo ago License: Permissive (Apache-2.0)

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Functions, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.

Python 657Updated: 11 mo ago License: Permissive (MIT)

TonY is a framework to natively run deep learning frameworks on Apache Hadoop.

Java 640Updated: 3 y ago License: Proprietary (Proprietary)

Quantcast File System

C++ 632Updated: 1 y ago License: Permissive (Apache-2.0)

Golang framework for streaming ETL, observability data pipeline, and event processing apps

Go 629Updated: 11 mo ago License: Proprietary (Proprietary)

💎🔥大数据学习笔记

Java 622Updated: 1 y ago License: No License (No License)

Distributed Deep Learning, with a focus on distributed training, using Keras and Apache Spark.

Python 615Updated: 3 y ago License: Strong Copyleft (GPL-3.0)

Spring for Apache Hadoop is a framework for application developers to take advantage of the features of both Hadoop and Spring.

Java 612Updated: 3 y ago License: No License (No License)

Mirror of Apache Giraph

Java 610Updated: 12 mo ago License: Permissive (Apache-2.0)

Apache ORC - the smallest, fastest columnar storage for Hadoop workloads

HTML 607Updated: 10 mo ago License: Permissive (Apache-2.0)

Web UI for Trino, Hive and SparkSQL

Java 602Updated: 11 mo ago License: Permissive (Apache-2.0)

A distributed system designed to ingest and process time series data

Java 592Updated: 2 y ago License: Permissive (Apache-2.0)

Hadoop library for large-scale data processing, now an Apache Incubator project

Java 588Updated: 4 y ago License: No License (No License)

A collection of spouts, bolts, serializers, DSLs, and other goodies to use with Storm

Java 588Updated: 3 y ago License: Proprietary (Proprietary)

Hadoop library for large-scale data processing, now an Apache Incubator project

Java 588Updated: 3 y ago License: No License (No License)

Kyuubi is a distributed multi-tenant JDBC server for large-scale data processing and analytics, built on top of Apache Spark

Scala 566Updated: 3 y ago License: Permissive (Apache-2.0)

This code base is retained for historical interest only, please visit Apache Incubator Repo for latest one

Java 561Updated: 2 y ago License: Permissive (Apache-2.0)

eclipse plugin for hadoop 2.2.0 , 2.4.1

Java 556Updated: 3 y ago License: No License (No License)

AWS Glue Libraries are additions and enhancements to Spark for ETL operations.

Python 555Updated: 10 mo ago License: Proprietary (Proprietary)

A tool to move your data between any clouds or regions.

Go 554Updated: 1 y ago License: Permissive (Apache-2.0)

大数据生态解决方案数据平台：基于大数据、数据平台、微服务、机器学习、商城、自动化运维、DevOps、容器部署平台、数据平台采集、数据平台存储、数据平台计算、数据平台开发、数据平台应用搭建的大数据解决方案。

Java 541Updated: 3 y ago License: Strong Copyleft (GPL-3.0)

Distributed database specialized in exporting key/value data from Hadoop

Java 540Updated: 3 y ago License: Permissive (BSD-3-Clause)

A simplified, lightweight ETL Framework based on Apache Spark

Scala 539Updated: 1 y ago License: Permissive (MIT)

RDBMS のしくみを学ぶための小さな RDBMS 実装

Rust 537Updated: 11 mo ago License: Permissive (MIT)

HPCC Systems (High Performance Computing Cluster) is an open source, massive parallel-processing computing platform for big data processing and analytics.

C++ 534Updated: 11 mo ago License: Proprietary (Proprietary)

大数据生态解决方案数据平台：基于大数据、数据平台、微服务、机器学习、商城、自动化运维、DevOps、容器部署平台、数据平台采集、数据平台存储、数据平台计算、数据平台开发、数据平台应用搭建的大数据解决方案。

Java 533Updated: 3 y ago License: Strong Copyleft (GPL-3.0)

Refactored version of code.google.com/hadoop-gpl-compression for hadoop 0.20

Shell 533Updated: 2 y ago License: Strong Copyleft (GPL-3.0)

The Apache Spark - Apache HBase Connector is a library to support Spark accessing HBase table as external data source or sink.

Scala 531Updated: 3 y ago License: Permissive (Apache-2.0)

基于 scrapy-redis 的通用分布式爬虫框架

Python 514Updated: 11 mo ago License: Permissive (MIT)

Fast and low overhead web framework fastify benchmarks.

JavaScript 505Updated: 1 y ago License: Permissive (MIT)

Data Lineage Tracking And Visualization Solution

Scala 503Updated: 11 mo ago License: Permissive (Apache-2.0)

Minos is beyond a hadoop deployment system.

Python 502Updated: 3 y ago License: Permissive (Apache-2.0)

A Scala productivity framework for Hadoop.

Scala 485Updated: 2 y ago License: No License (No License)

Riak client for Javascript

JavaScript 479Updated: 3 y ago License: No License (No License)

Spring Hadoop Samples

Java 476Updated: 3 y ago License: No License (No License)

Simplifying robust end-to-end machine learning on Apache Spark.

Scala 472Updated: 3 y ago License: Permissive (Apache-2.0)

Time Series Prediction with tf.contrib.timeseries

Python 462Updated: 3 y ago License: No License (No License)

Spark Streaming+Flume+Kafka+HBase+Hadoop+Zookeeper实现实时日志分析统计；SpringBoot+Echarts实现数据可视化展示

Java 461Updated: 10 mo ago License: No License (No License)

Deploying complex solutions, magically.

Python 455Updated: 3 y ago License: Permissive (MIT)

Kafka Connect HDFS connector

Java 452Updated: 11 mo ago License: Proprietary (Proprietary)

Generic Data Ingestion & Dispersal Library for Hadoop

Java 449Updated: 2 y ago License: Proprietary (Proprietary)