ffmpeg + hadoop + shell 实现视频的分布式转码
Support
Quality
Security
License
Reuse
Crawl gomovies and grab all the links to watch free movies, the next step is to grab their binary data and store it to my local machine
Support
Quality
Security
License
Reuse
S
Spark-Kafka-Cassandra-Airflow-Dockerby pramoddatamantra
Shell 2 Version:Current License: No License (No License)
Support
Quality
Security
License
Reuse
hadoop hive install script
Support
Quality
Security
License
Reuse
针对2B场景下的大数据基础组件快速落地解决方案-cloudera manager+docker
Support
Quality
Security
License
Reuse
Basic web user stat with Apache Kafka and Apache Spark structured steaming
Support
Quality
Security
License
Reuse
Support
Quality
Security
License
Reuse
h
hadoop-hbase-phoenix-zookeeper-integrationby luckyp71
Shell 2 Version:Current License: No License (No License)
Hadoop, HBase, Phoenix, and Zookeeper Integration
Support
Quality
Security
License
Reuse
Support
Quality
Security
License
Reuse
Sorting of large dataset files(80GB) using Hadoop(Mapreduce) techniques and Apache Spark in Java and scheduled job on the virtual cluster(using 4 nodes) using a SLURM scheduler with bash scripting
Support
Quality
Security
License
Reuse
Golang SQL driver for Apache Drill database
Support
Quality
Security
License
Reuse
a
apache-drill-tpch-experimentsby crazyboycjr
Shell 2 Version:Current License: Permissive (Apache-2.0)
Run TPC-H dataset on Apache Drill on HDFS, all applications are running in container
Support
Quality
Security
License
Reuse
cloudera manager extension to launch processes
Support
Quality
Security
License
Reuse
Minimal example of golang with gorilla mux and cassandra as a database
Support
Quality
Security
License
Reuse
🐘Yet another Hadoop playground
Support
Quality
Security
License
Reuse
cloudera hadoop auto install
Support
Quality
Security
License
Reuse
Solves big data problems at the root
Support
Quality
Security
License
Reuse
Examples of successfully clustering CouchDB 2.1.1 in Docker containers
Support
Quality
Security
License
Reuse
Auto install hadoop 自动安装 hadoop 环境一键脚本
Support
Quality
Security
License
Reuse
Support
Quality
Security
License
Reuse
Hadoop on Docker Containers
Support
Quality
Security
License
Reuse
Basic Twitter Sentiment Analytics using Apache Spark Streaming APIs and Python
Support
Quality
Security
License
Reuse
网站点击流数据清洗
Support
Quality
Security
License
Reuse
A docker container supporting both airflow and Apache spark. For use with projects that need to using `spark-submit` from airflow workers.
Support
Quality
Security
License
Reuse
codebox ueba project
Support
Quality
Security
License
Reuse
odroid cluster (xu3lite and xu4) as a headless distributed system
Support
Quality
Security
License
Reuse
使用kubernetes构建hadoop集群
Support
Quality
Security
License
Reuse
Thinking of learning Hadoop
Support
Quality
Security
License
Reuse
Cloudera Hadoop (CDH5) Cluster Setup Guide
Support
Quality
Security
License
Reuse
d
distributed-programming-abstractionsby mohitreddy1996
Go 2 Version:Current License: Permissive (MIT)
Attempt to implement all the algorithms presented in "introduction to secure and reliable distributed programming" in golang/c++.
Support
Quality
Security
License
Reuse
These playbooks will help you and your organization fully build and automate your Docker Swarm.
Support
Quality
Security
License
Reuse
This explains how to collect(stream) Docker logs to EFK (Elasticsearch + Fluentd + Kibana) stack.
Support
Quality
Security
License
Reuse
Run hadoop use docker
Support
Quality
Security
License
Reuse
a pool of byte slice, without the memory fragmentation
Support
Quality
Security
License
Reuse
Support
Quality
Security
License
Reuse
Install Hadoop + Hive + Spark by Vagrant
Support
Quality
Security
License
Reuse
hadoop + hbase + zookeeper 基于docker 集群部署。
Support
Quality
Security
License
Reuse
Support
Quality
Security
License
Reuse
Containing codes around Big Data technologies
Support
Quality
Security
License
Reuse
from kiwenlau/hadoop-cluster-docker
Support
Quality
Security
License
Reuse
Apache Spark to run on Kubernetes
Support
Quality
Security
License
Reuse
JDK、Hadoop、HBase、Phoenix、lzo集群自动部署脚本
Support
Quality
Security
License
Reuse
Docker with basic requirements to use it for technical training
Support
Quality
Security
License
Reuse
An example project with oozie workflows of (Ingest, Reconcile, Compact and Purge). Uses Hive, Sqoop , Shell. Puts data so that Apache Drill and Tableau can access the content in _reports schema
Support
Quality
Security
License
Reuse
Hosts the cassandra-keygen bash script
Support
Quality
Security
License
Reuse
This repository contains the H1B_Visa Applicants Data Analysis project/case study using Hadoop undertaken during the training at NIIT. MapReduce,Hive,Pig,Scoop and Shell-scripting are the technologies used.
Support
Quality
Security
License
Reuse
jdk spark hadoop .. environment-variable-script 环境变量脚本
Support
Quality
Security
License
Reuse
Unix Shell Script to build java/Scala fat-jars and make the distributions and deployment of Scala applications easier.
Support
Quality
Security
License
Reuse
hbase cluster dockerfile
Support
Quality
Security
License
Reuse
H2O™ Sparkling Water® Deep Learning docker image with multiple deployment environment
Support
Quality
Security
License
Reuse
f
ffencodeby xiashine
ffmpeg + hadoop + shell 实现视频的分布式转码
Shell 2Updated: 4 y ago License: No License (No License)
Support
Quality
Security
License
Reuse
m
moviecrawlerby calvinfeng
Crawl gomovies and grab all the links to watch free movies, the next step is to grab their binary data and store it to my local machine
Go 2Updated: 4 y ago License: No License (No License)
Support
Quality
Security
License
Reuse
S
Spark-Kafka-Cassandra-Airflow-Dockerby pramoddatamantra
Shell 2Updated: 5 y ago License: No License (No License)
Support
Quality
Security
License
Reuse
h
hadoop-install-scriptby zhuchuangang
hadoop hive install script
Shell 2Updated: 4 y ago License: No License (No License)
Support
Quality
Security
License
Reuse
d
docker-clouderaby osenlin
针对2B场景下的大数据基础组件快速落地解决方案-cloudera manager+docker
Shell 2Updated: 5 y ago License: No License (No License)
Support
Quality
Security
License
Reuse
w
web-statby NicolasPA
Basic web user stat with Apache Kafka and Apache Spark structured steaming
Shell 2Updated: 4 y ago License: Permissive (MIT)
Support
Quality
Security
License
Reuse
S
SEBCby imran273
Shell 2Updated: 5 y ago License: No License (No License)
Support
Quality
Security
License
Reuse
h
hadoop-hbase-phoenix-zookeeper-integrationby luckyp71
Hadoop, HBase, Phoenix, and Zookeeper Integration
Shell 2Updated: 4 y ago License: No License (No License)
Support
Quality
Security
License
Reuse
d
docker-hadoopby bowzar
Shell 2Updated: 5 y ago License: No License (No License)
Support
Quality
Security
License
Reuse
S
Sort-on-Hadoop-Sparkby Sabareesh19
Sorting of large dataset files(80GB) using Hadoop(Mapreduce) techniques and Apache Spark in Java and scheduled job on the virtual cluster(using 4 nodes) using a SLURM scheduler with bash scripting
Shell 2Updated: 4 y ago License: No License (No License)
Support
Quality
Security
License
Reuse
g
go-drillby pinpt
Golang SQL driver for Apache Drill database
Go 2Updated: 3 y ago License: Permissive (MIT)
Support
Quality
Security
License
Reuse
a
apache-drill-tpch-experimentsby crazyboycjr
Run TPC-H dataset on Apache Drill on HDFS, all applications are running in container
Shell 2Updated: 4 y ago License: Permissive (Apache-2.0)
Support
Quality
Security
License
Reuse
c
cloudera-launcherby kabike
cloudera manager extension to launch processes
Shell 2Updated: 6 y ago License: Permissive (Apache-2.0)
Support
Quality
Security
License
Reuse
g
gomvcndbby chaudharisuresh997
Minimal example of golang with gorilla mux and cassandra as a database
Go 2Updated: 5 y ago License: No License (No License)
Support
Quality
Security
License
Reuse
h
hadoop-playgroundby arkady-emelyanov
🐘Yet another Hadoop playground
Shell 2Updated: 5 y ago License: No License (No License)
Support
Quality
Security
License
Reuse
c
cdh-toolsby dengshaochun
cloudera hadoop auto install
Shell 2Updated: 3 y ago License: Permissive (MIT)
Support
Quality
Security
License
Reuse
b
brig-databy SpasmodicSoftware
Solves big data problems at the root
Shell 2Updated: 3 y ago License: Strong Copyleft (AGPL-3.0)
Support
Quality
Security
License
Reuse
c
couchdb-docker-clustering-examplesby cacois
Examples of successfully clustering CouchDB 2.1.1 in Docker containers
Shell 2Updated: 4 y ago License: Permissive (MIT)
Support
Quality
Security
License
Reuse
a
auto-install-hadoopby sunriseydy
Auto install hadoop 自动安装 hadoop 环境一键脚本
Shell 2Updated: 4 y ago License: No License (No License)
Support
Quality
Security
License
Reuse
k
kinesis-ddb-consumerby atsushi-ishibashi
Go 2Updated: 5 y ago License: Permissive (MIT)
Support
Quality
Security
License
Reuse
h
hadoop-on-dockerby madaibaba
Hadoop on Docker Containers
Shell 2Updated: 4 y ago License: Permissive (Apache-2.0)
Support
Quality
Security
License
Reuse
b
basic-sentiment-analysisby Aminoid
Basic Twitter Sentiment Analytics using Apache Spark Streaming APIs and Python
Shell 2Updated: 6 y ago License: No License (No License)
Support
Quality
Security
License
Reuse
w
Support
Quality
Security
License
Reuse
d
docker-airflow-sparkby covertspartan
A docker container supporting both airflow and Apache spark. For use with projects that need to using `spark-submit` from airflow workers.
Shell 2Updated: 3 y ago License: No License (No License)
Support
Quality
Security
License
Reuse
c
Support
Quality
Security
License
Reuse
o
odroidclusterby hiryou
odroid cluster (xu3lite and xu4) as a headless distributed system
Shell 2Updated: 5 y ago License: Permissive (MIT)
Support
Quality
Security
License
Reuse
k
kubernetes-hadoop-clusterby happyshui
使用kubernetes构建hadoop集群
Shell 2Updated: 5 y ago License: No License (No License)
Support
Quality
Security
License
Reuse
L
LearningHadoopby bluecryolite
Thinking of learning Hadoop
Shell 2Updated: 6 y ago License: No License (No License)
Support
Quality
Security
License
Reuse
h
hadoop-cdhby Piboonsak
Cloudera Hadoop (CDH5) Cluster Setup Guide
Shell 2Updated: 5 y ago License: No License (No License)
Support
Quality
Security
License
Reuse
d
distributed-programming-abstractionsby mohitreddy1996
Attempt to implement all the algorithms presented in "introduction to secure and reliable distributed programming" in golang/c++.
Go 2Updated: 6 y ago License: Permissive (MIT)
Support
Quality
Security
License
Reuse
B
Build-and-Automate-Swarm-AWSby edwardofclt
These playbooks will help you and your organization fully build and automate your Docker Swarm.
Shell 2Updated: 6 y ago License: No License (No License)
Support
Quality
Security
License
Reuse
E
Elasticsearch-Fluentd-Kibanaby sbruksha
This explains how to collect(stream) Docker logs to EFK (Elasticsearch + Fluentd + Kibana) stack.
Shell 2Updated: 4 y ago License: No License (No License)
Support
Quality
Security
License
Reuse
d
docker-hadoopby altiplanogao-clustering
Run hadoop use docker
Shell 2Updated: 6 y ago License: Permissive (Apache-2.0)
Support
Quality
Security
License
Reuse
b
bufferpoolby workshop-depot
a pool of byte slice, without the memory fragmentation
Go 2Updated: 3 y ago License: Permissive (MIT)
Support
Quality
Security
License
Reuse
h
hive-goby 3-shake
Go 2Updated: 6 y ago License: Permissive (Apache-2.0)
Support
Quality
Security
License
Reuse
h
hadoop-hive-spark-vagrantby bryanyang0528
Install Hadoop + Hive + Spark by Vagrant
Shell 2Updated: 6 y ago License: Permissive (Apache-2.0)
Support
Quality
Security
License
Reuse
h
hadoop-hbase-zookeeper-dockerby Liyndon
hadoop + hbase + zookeeper 基于docker 集群部署。
Shell 2Updated: 4 y ago License: Permissive (MIT)
Support
Quality
Security
License
Reuse
h
hadoop_experimentationby TheBeege
Shell 2Updated: 6 y ago License: Permissive (MIT)
Support
Quality
Security
License
Reuse
h
hadoop-and-sparkby dprateek1991
Containing codes around Big Data technologies
Shell 2Updated: 6 y ago License: No License (No License)
Support
Quality
Security
License
Reuse
h
hadoopby yydai
from kiwenlau/hadoop-cluster-docker
Shell 2Updated: 4 y ago License: Permissive (Apache-2.0)
Support
Quality
Security
License
Reuse
s
spark-k8sby felixcheung
Apache Spark to run on Kubernetes
Shell 2Updated: 5 y ago License: Permissive (Apache-2.0)
Support
Quality
Security
License
Reuse
h
hadoops-auto-ins-shscriptby sumbrez
JDK、Hadoop、HBase、Phoenix、lzo集群自动部署脚本
Shell 2Updated: 5 y ago License: Permissive (Apache-2.0)
Support
Quality
Security
License
Reuse
d
docker-odoo-trainingby Vauxoo
Docker with basic requirements to use it for technical training
Shell 2Updated: 4 y ago License: No License (No License)
Support
Quality
Security
License
Reuse
h
hadoop-oozie-flowsby merrillpaul
An example project with oozie workflows of (Ingest, Reconcile, Compact and Purge). Uses Hive, Sqoop , Shell. Puts data so that Apache Drill and Tableau can access the content in _reports schema
Shell 2Updated: 5 y ago License: No License (No License)
Support
Quality
Security
License
Reuse
c
cassandra-keygenby Darkstar90
Hosts the cassandra-keygen bash script
Shell 2Updated: 6 y ago License: No License (No License)
Support
Quality
Security
License
Reuse
H
H1B_VisaProjectby NikhilURao
This repository contains the H1B_Visa Applicants Data Analysis project/case study using Hadoop undertaken during the training at NIIT. MapReduce,Hive,Pig,Scoop and Shell-scripting are the technologies used.
Shell 2Updated: 5 y ago License: Permissive (Apache-2.0)
Support
Quality
Security
License
Reuse
e
environment-variable-scriptby vbay
jdk spark hadoop .. environment-variable-script 环境变量脚本
Shell 2Updated: 4 y ago License: No License (No License)
Support
Quality
Security
License
Reuse
b
build-fat-jarby caiorss
Unix Shell Script to build java/Scala fat-jars and make the distributions and deployment of Scala applications easier.
Shell 2Updated: 5 y ago License: Permissive (Unlicense)
Support
Quality
Security
License
Reuse
h
hbase-dockerby NeoJRotary
hbase cluster dockerfile
Shell 2Updated: 7 y ago License: No License (No License)
Support
Quality
Security
License
Reuse
s
sparkling-waterby hellgate75
H2O™ Sparkling Water® Deep Learning docker image with multiple deployment environment
Shell 2Updated: 3 y ago License: Proprietary (Proprietary)
Support
Quality
Security
License
Reuse