Amazon S3 Libraries - Page 1

High Performance Object Storage for AI

Go 39447Updated: 1 y ago License: Strong Copyleft (AGPL-3.0)

"rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Yandex Files

Go 38853Updated: 1 y ago License: Permissive (MIT)

🌩支持多家云存储的云盘系统 (Self-hosted file management and sharing system, supports multiple storage providers)

Go 18195Updated: 1 y ago License: Strong Copyleft (GPL-3.0)

SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding.

Go 14297Updated: 2 y ago License: Permissive (Apache-2.0)

Universal Command Line Interface for Amazon Web Services

Python 13865Updated: 1 y ago License: Proprietary (Proprietary)

Abstraction for local and remote filesystems

PHP 12923Updated: 1 y ago License: Permissive (MIT)

Node.js middleware for handling `multipart/form-data`.

JavaScript 10750Updated: 1 y ago License: Permissive (MIT)

Python Serverless Microframework for AWS

Python 9771Updated: 1 y ago License: Permissive (Apache-2.0)

A declarative JavaScript library for application development using cloud services.

TypeScript 9224Updated: 1 y ago License: Permissive (Apache-2.0)

Node.js: extra methods for the fs object like copy(), remove(), mkdirs()

JavaScript 9008Updated: 1 y ago License: Permissive (MIT)

Store securely encrypted backups in the cloud!

C# 8926Updated: 1 y ago License: Weak Copyleft (LGPL-2.1)

JuiceFS is a distributed POSIX file system built on top of Redis and S3.

Go 8149Updated: 1 y ago License: Permissive (Apache-2.0)

AWS SDK for Python

Python 8140Updated: 1 y ago License: Permissive (Apache-2.0)

Production infrastructure for machine learning at scale

Go 7938Updated: 1 y ago License: Permissive (Apache-2.0)

NoSQL data store using the seastar framework, compatible with Apache Cassandra

C++ 7734Updated: 2 y ago License: Strong Copyleft (AGPL-3.0)

It's a new file uploader solution!

JavaScript 7677Updated: 1 y ago License: Permissive (BSD-3-Clause)

AWS SDK for JavaScript in the browser and Node.js

JavaScript 7403Updated: 1 y ago License: Permissive (Apache-2.0)

FUSE-based file system backed by Amazon S3

C++ 7221Updated: 1 y ago License: Strong Copyleft (GPL-2.0)

An integrated shell for working with the AWS CLI.

Python 6925Updated: 1 y ago License: Permissive (Apache-2.0)

The most used, flexible, fast and streaming parser for multipart form data. Supports uploading to serverless environments, AWS S3, Azure, GCP or the filesystem. Used in production.

JavaScript 6654Updated: 1 y ago License: Permissive (MIT)

Dropbox Uploader is a BASH script which can be used to upload, download, list or delete files from Dropbox, an online file sharing, synchronization and backup service.

Shell 6490Updated: 1 y ago License: Strong Copyleft (GPL-3.0)

For the latest version of boto, see https://github.com/boto/boto3 -- Python interface to Amazon Web Services

Python 6475Updated: 1 y ago License: Proprietary (Proprietary)

A modern cloud data warehouse focusing on reducing cost and complexity for your massive-scale analytics needs. Open source alternative to Snowflake. Also available in the cloud: https://app.databend.com 🧠

Rust 6130Updated: 1 y ago License: Proprietary (Proprietary)

Official repository of the AWS SDK for PHP (@awsforphp)

PHP 5845Updated: 1 y ago License: Permissive (Apache-2.0)

a high-performance, POSIX-ish Amazon S3 file system written in Go

Go 4683Updated: 1 y ago License: Permissive (Apache-2.0)

Security Monkey monitors AWS, GCP, OpenStack, and GitHub orgs for assets and their changes over time.

Python 4309Updated: 2 y ago License: Permissive (Apache-2.0)

Upserts, Deletes And Incremental Processing on Big Data.

Java 4276Updated: 1 y ago License: Permissive (Apache-2.0)

A generic JSON document store with sharing and synchronisation capabilities.

Python 4264Updated: 1 y ago License: Proprietary (Proprietary)

Official s3cmd repo -- Command line tool for managing Amazon S3 and CloudFront services

Python 4180Updated: 1 y ago License: Strong Copyleft (GPL-2.0)

Gluster Filesystem : Build your distributed storage in minutes

C 4114Updated: 1 y ago License: Strong Copyleft (GPL-2.0)

Cross-platform backup tool for Windows, macOS & Linux with fast, incremental backups, client-side end-to-end encryption, compression and data deduplication. CLI and GUI included.

Go 3769Updated: 1 y ago License: Permissive (Apache-2.0)

The official AWS SDK for Java.

Java 3634Updated: 3 y ago License: Permissive (Apache-2.0)

go-fastdfs 是一个简单的分布式文件系统(私有云存储)，具有无中心、高性能，高可靠，免维护等优点，支持断点续传，分块上传，小文件合并，自动同步，自动修复。Go-fastdfs is a simple distributed file system (private cloud storage), with no center, high performance, high reliability, maintenance free and other advantages, support breakpoint continuation, block upload, small file merge, automatic synchronization, automatic repair.(similar fastdfs).

Go 3568Updated: 1 y ago License: Permissive (Unlicense)

An index & manager of Onedrive based on serverless. Can be deployed to Heroku/Glitch/Vercel/Replit/SCF/FG/FC/CFC/PHP web hosting/VPS.

PHP 3504Updated: 1 y ago License: No License (No License)

The official AWS SDK for Ruby.

Ruby 3447Updated: 1 y ago License: Permissive (Apache-2.0)

lakeFS - Data version control for your data lake | Git for data

Go 3443Updated: 1 y ago License: Permissive (Apache-2.0)

Continuous Archiving for Postgres

Python 3380Updated: 1 y ago License: Permissive (BSD-3-Clause)

a featureful union filesystem

C++ 3180Updated: 1 y ago License: Proprietary (Proprietary)

File Attachment toolkit for Ruby applications

Ruby 3071Updated: 1 y ago License: Permissive (MIT)

Utils for streaming large files (S3, HDFS, gzip, bz2...)

Python 2880Updated: 1 y ago License: Permissive (MIT)

Create full-fledged APIs for slowly moving datasets without writing a single line of code.

Rust 2825Updated: 1 y ago License: Permissive (Apache-2.0)

local storage wrapper for both react-native and browser. Support size controlling, auto expiring, remote data auto syncing and getting batch data in one query.

JavaScript 2773Updated: 3 y ago License: Permissive (MIT)

《蓝眼云盘》(Eyeblue Cloud Storage)

Go 2739Updated: 1 y ago License: Permissive (MIT)

Pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

Python 2734Updated: 2 y ago License: Permissive (Apache-2.0)

AWS SDK for Rust

Rust 2629Updated: 1 y ago License: Permissive (MIT)

Archival and Restoration for databases in the Cloud

Go 2574Updated: 1 y ago License: Proprietary (Proprietary)

ChubaoFS (abbrev. CBFS) is a cloud native distributed file system and object store.

Go 2499Updated: 3 y ago License: Permissive (Apache-2.0)

Simple | Fast tool to manage MinIO clusters :cloud:

Go 2468Updated: 1 y ago License: Strong Copyleft (AGPL-3.0)

The simplest, most powerful way to build a functional web app (fwa)

JavaScript 2378Updated: 1 y ago License: Permissive (Apache-2.0)

A pythonic interface to Amazon's DynamoDB

Python 2157Updated: 1 y ago License: Permissive (MIT)