Hadoop Libraries - Page 4

An open-source columnar data format designed for fast & realtime analytic with big data.

Java 443Updated: 2 y ago License: Permissive (Apache-2.0)

Scala examples for learning to use Spark

Scala 425Updated: 3 y ago License: Permissive (MIT)

Storm-yarn enables Storm clusters to be deployed into machines managed by Hadoop YARN.

Java 418Updated: 3 y ago License: Proprietary (Proprietary)

Ansible playbook that installs a Hadoop cluster, with HBase, Hive, Presto for analytics, and Ganglia, Smokeping, Fluentd, Elasticsearch and Kibana for monitoring and centralized log indexing.

Shell 415Updated: 3 y ago License: Permissive (Apache-2.0)

Apache Tez

Java 408Updated: 1 y ago License: Permissive (Apache-2.0)

An open source indexing subsystem that brings index-based query acceleration to Apache Spark™ and big data workloads.

Scala 408Updated: 1 y ago License: Permissive (Apache-2.0)

Unicorn for node.js

JavaScript 404Updated: 3 y ago License: Permissive (MIT)

Web tool for Kafka Connect |

JavaScript 400Updated: 3 y ago License: Proprietary (Proprietary)

大数据实践项目 Hadoop、Spark、Kafka、Hbase、Flink.....

Java 398Updated: 11 mo ago License: Permissive (Apache-2.0)

Read-only mirror of ASF Git Repo for jclouds

Java 383Updated: 3 y ago License: No License (No License)

Oozie - workflow engine for Hadoop

Java 376Updated: 3 y ago License: Permissive (Apache-2.0)

Repository holding configuration files for running an HDFS cluster in Kubernetes

Shell 372Updated: 1 y ago License: Permissive (Apache-2.0)

A scalable, event-driven and event-sourced Java EE application

Java 371Updated: 3 y ago License: Permissive (Apache-2.0)

This library allows Scala and Java-based projects (including Apache Flink, Apache Hive, Apache Beam, and PrestoDB) to read from and write to Delta Lake.

Java 367Updated: 12 mo ago License: Permissive (Apache-2.0)

This is a tool which used to manage and monitor ClickHouse database

Go 366Updated: 12 mo ago License: Permissive (Apache-2.0)

Includes notes on Apache Spark, Spark for Physics, Jupyter notebook examples for Spark, Oracle and other DB systems.

Jupyter Notebook 354Updated: 11 mo ago License: Permissive (Apache-2.0)

Rails app for tracking trends in server logs - powered by the Cloudera Hadoop Distribution on EC2

Ruby 352Updated: 3 y ago License: No License (No License)

t-Digest data structure in Python. Useful for percentiles and quantiles, including distributed enviroments like PySpark

Python 350Updated: 1 y ago License: Permissive (MIT)

Ytk-learn is a distributed machine learning library which implements most of popular machine learning algorithms(GBDT, GBRT, Mixture Logistic Regression, Gradient Boosting Soft Tree, Factorization Machines, Field-aware Factorization Machines, Logistic Regression, Softmax).

Java 348Updated: 2 y ago License: Permissive (MIT)

hadoop-common-2.2.0/bin

Shell 347Updated: 3 y ago License: No License (No License)

Mirror of Apache Apex core

Java 344Updated: 3 y ago License: Permissive (Apache-2.0)

My Insight Data Engineering Fellowship project. I implemented a big data processing pipeline based on ​lambda architecture​, that aggregates Twitter and US stock market data for user sentiment analysis using open source tools - ​Apache Kafka ​for data ingestions, Apache Spark ​& ​Spark Streaming ​for batch & real-time processing, ​Apache Cassandra f​ or storage, ​Flask​, ​Bootstrap and ​HighCharts f​ or frontend.

Scala 341Updated: 12 mo ago License: No License (No License)

CDP Public Cloud is an integrated analytics and data management platform deployed on cloud services. It offers broad data analytics and artificial intelligence functionality along with secure user access and data governance features.

Java 340Updated: 11 mo ago License: Permissive (Apache-2.0)

Gathers scalable Tensorflow and Python infrastructure deployment, Husein Go-To for development, 100% Docker.

Jupyter Notebook 337Updated: 3 y ago License: Permissive (MIT)

Cascading is a feature rich API for defining and executing complex and fault tolerant data processing flows locally or on a cluster.

Java 337Updated: 12 mo ago License: Proprietary (Proprietary)

HDFS-alike in Go. Written in 2014 to learn the language and get a job.

Go 336Updated: 3 y ago License: No License (No License)

Next-generation web analytics processing with Scala, Spark, and Parquet.

JavaScript 335Updated: 3 y ago License: Permissive (Apache-2.0)

Harmonious distributed data analysis in Rust.

Rust 332Updated: 3 y ago License: Permissive (Apache-2.0)

Create clusters of VMs on the cloud and configure them with Ansible.

Python 329Updated: 1 y ago License: Strong Copyleft (GPL-3.0)

:sunny: 英语学习 :feet: 项目预览：https://jgsrty.github.io 国内访问：https://rtyxmd.gitee.io

Shell 323Updated: 2 y ago License: Permissive (MIT)

Prophecis is a one-stop cloud native machine learning platform.

Go 317Updated: 2 y ago License: Permissive (Apache-2.0)

Apache hadoop management system

PHP 313Updated: 1 y ago License: Strong Copyleft (GPL-3.0)

Cloudflow enables users to quickly develop, orchestrate, and operate distributed streaming applications on Kubernetes.

Scala 312Updated: 2 y ago License: Permissive (Apache-2.0)

Serverless proxy for Spark cluster

Scala 310Updated: 3 y ago License: Permissive (Apache-2.0)

Morpheus brings the leading graph query language, Cypher, onto the leading distributed processing platform, Spark.

Scala 307Updated: 3 y ago License: Permissive (Apache-2.0)

Go 304Updated: 3 y ago License: Permissive (Apache-2.0)

Preprocess files based off environment configuration

JavaScript 300Updated: 3 y ago License: Proprietary (Proprietary)

Connect Spark to HBase for reading and writing data with ease

Scala 299Updated: 11 mo ago License: Permissive (Apache-2.0)

Source of shouldideploy.today

TypeScript 297Updated: 12 mo ago License: Permissive (WTFPL)

This is a research prototype of the Dryad and DryadLINQ data-parallel processing frameworks running on Hadoop YARN.

C# 296Updated: 3 y ago License: Permissive (Apache-2.0)

Scala translations of Robert Sedgewick's Java Algorthms

Scala 296Updated: 11 mo ago License: No License (No License)

GoldenOrb is an open-source implementation of Pregel, Google's graph processing framework

Java 293Updated: 4 y ago License: Permissive (Apache-2.0)

Mirror of Apache Hivemall (incubating)

Java 292Updated: 3 y ago License: Permissive (Apache-2.0)

Behemoth is an open source platform for large scale document analysis based on Apache Hadoop.

Java 286Updated: 3 y ago License: Proprietary (Proprietary)

Example application for analyzing Twitter data using CDH - Flume, Oozie, Hive

Java 284Updated: 3 y ago License: No License (No License)

hadoop-mini-clusters provides an easy way to test Hadoop projects directly in your IDE

Java 284Updated: 11 mo ago License: Permissive (Apache-2.0)

基于Spark的新闻推荐系统，包含爬虫项目、web网站以及spark推荐系统

Scala 282Updated: 1 y ago License: No License (No License)

hadoop_storm_spark结合实验的例子，模拟淘宝双11节，根据订单详细信息，汇总出总销售量，各个省份销售排行，以及后期的SQL分析，数据分析，数据挖掘等。 --------大概流程------- 第一阶段（storm实时报表） 第二阶段（离线报表）第三阶段（大规模订单即席查询,和多维度查询） 第四阶段（数据挖掘和图计算）

Java 279Updated: 3 y ago License: No License (No License)

给flink开发的web系统。支持页面上定义udf，进行sql和jar任务的提交；支持source、sink、job的管理；可以管理openshift上的flink集群

Java 279Updated: 2 y ago License: Permissive (Apache-2.0)

Spark RDD to read, write and delete from HBase

Scala 279Updated: 3 y ago License: Permissive (Apache-2.0)