Storage Libraries - Page 1

High Performance Object Storage for AI

Go 39447Updated: 1 y ago License: Strong Copyleft (AGPL-3.0)

"rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Yandex Files

Go 38853Updated: 1 y ago License: Permissive (MIT)

💾 Offline storage, improved. Wraps IndexedDB, WebSQL, or localStorage using a simple but powerful API.

JavaScript 22355Updated: 1 y ago License: Permissive (Apache-2.0)

Spacedrive is an open source cross-platform file explorer, powered by a virtual distributed filesystem written in Rust.

Rust 18868Updated: 1 y ago License: Strong Copyleft (AGPL-3.0)

🌩支持多家云存储的云盘系统 (Self-hosted file management and sharing system, supports multiple storage providers)

Go 18195Updated: 1 y ago License: Strong Copyleft (GPL-3.0)

SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding.

Go 17571Updated: 1 y ago License: Permissive (Apache-2.0)

An IPFS implementation in Go

Go 15121Updated: 1 y ago License: Proprietary (Proprietary)

SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding.

Go 14297Updated: 3 y ago License: Permissive (Apache-2.0)

Cross-browser storage for all use cases, used across the web.

JavaScript 13900Updated: 2 y ago License: Permissive (MIT)

IPFS implementation in Go

Go 13201Updated: 3 y ago License: Proprietary (Proprietary)

Abstraction for local and remote filesystems

PHP 12923Updated: 1 y ago License: Permissive (MIT)

Ceph is a distributed object, block, and file storage platform

C++ 12014Updated: 1 y ago License: Proprietary (Proprietary)

Highly available Prometheus setup with long term storage capabilities. A CNCF Incubating project.

Go 11816Updated: 1 y ago License: Permissive (Apache-2.0)

High performance file syncing and sharing, with also Markdown WYSIWYG editing, Wiki, file label and other knowledge management features.

C 10709Updated: 1 y ago License: Proprietary (Proprietary)

FastDFS is an open source high performance distributed file system (DFS). It's major functions include: file storing, file syncing and file accessing, and design for high capacity and load balance. Wechat/Weixin public account (Chinese Language): fastdfs

C 8562Updated: 1 y ago License: Strong Copyleft (GPL-3.0)

JuiceFS is a distributed POSIX file system built on top of Redis and S3.

Go 8149Updated: 1 y ago License: Permissive (Apache-2.0)

🦄 A modern web client for SFTP, S3, FTP, WebDAV, Git, Minio, LDAP, CalDAV, CardDAV, Mysql, Backblaze, ...

JavaScript 7948Updated: 1 y ago License: Strong Copyleft (AGPL-3.0)

NAS媒体库管理工具

Python 7835Updated: 2 y ago License: No License (No License)

Peer-to-Peer Databases for the Decentralized Web

JavaScript 7651Updated: 1 y ago License: Permissive (MIT)

IPFS implementation in JavaScript

JavaScript 7429Updated: 1 y ago License: Proprietary (Proprietary)

A Minimalistic Wrapper for IndexedDB

JavaScript 7275Updated: 3 y ago License: Permissive (Apache-2.0)

FUSE-based file system backed by Amazon S3

C++ 7221Updated: 1 y ago License: Strong Copyleft (GPL-2.0)

HTML Standard

HTML 6875Updated: 1 y ago License: Proprietary (Proprietary)

Python client for Baidu Yun (Personal Cloud Storage) 百度云/百度网盘Python客户端

Python 6864Updated: 1 y ago License: Permissive (MIT)

The most used, flexible, fast and streaming parser for multipart form data. Supports uploading to serverless environments, AWS S3, Azure, GCP or the filesystem. Used in production.

JavaScript 6654Updated: 1 y ago License: Permissive (MIT)

Dropbox Uploader is a BASH script which can be used to upload, download, list or delete files from Dropbox, an online file sharing, synchronization and backup service.

Shell 6490Updated: 2 y ago License: Strong Copyleft (GPL-3.0)

For the latest version of boto, see https://github.com/boto/boto3 -- Python interface to Amazon Web Services

Python 6475Updated: 2 y ago License: Proprietary (Proprietary)

Official repository of the AWS SDK for PHP (@awsforphp)

PHP 5845Updated: 1 y ago License: Permissive (Apache-2.0)

💾 Persist and rehydrate your Vuex state between page reloads.

JavaScript 5756Updated: 2 y ago License: Permissive (MIT)

libp2p implementation in Go

Go 5247Updated: 1 y ago License: Permissive (MIT)

Easy and blazing-fast book searcher, create and search your private library. Index metadata for over 10 million books in one minute as well as search in 30µs.

TypeScript 5223Updated: 1 y ago License: Permissive (BSD-3-Clause)

Cloud-Native distributed storage built on and for Kubernetes

Shell 4763Updated: 1 y ago License: Permissive (Apache-2.0)

a high-performance, POSIX-ish Amazon S3 file system written in Go

Go 4683Updated: 1 y ago License: Permissive (Apache-2.0)

Produces persistent, respawning "super" cookies in a browser, abusing over a dozen techniques. Its goal is to identify users after they've removed standard cookies and other privacy data such as Flash cookies (LSOs), HTML5 storage, SilverLight storage, and others.

JavaScript 4277Updated: 2 y ago License: No License (No License)

A generic JSON document store with sharing and synchronisation capabilities.

Python 4264Updated: 1 y ago License: Proprietary (Proprietary)

Official s3cmd repo -- Command line tool for managing Amazon S3 and CloudFront services

Python 4180Updated: 1 y ago License: Strong Copyleft (GPL-2.0)

Gluster Filesystem : Build your distributed storage in minutes

C 4114Updated: 1 y ago License: Strong Copyleft (GPL-2.0)

An asynchronous, persistent, key-value storage system for React Native.

TypeScript 4096Updated: 1 y ago License: Permissive (MIT)

Simple data persistence for your Electron app or module - Save and load user preferences, app state, cache, etc

JavaScript 4047Updated: 1 y ago License: Permissive (MIT)

Useful resources for using IPFS and building things on top of it

JavaScript 4029Updated: 1 y ago License: Permissive (CC0-1.0)

Decentralized video-sharing social media platform, built using Lens protocol. 🌿

TypeScript 3962Updated: 1 y ago License: Strong Copyleft (GPL-3.0)

A generic dynamo implementation for different k-v storage engines

C 3723Updated: 3 y ago License: Permissive (Apache-2.0)

go-fastdfs 是一个简单的分布式文件系统(私有云存储)，具有无中心、高性能，高可靠，免维护等优点，支持断点续传，分块上传，小文件合并，自动同步，自动修复。Go-fastdfs is a simple distributed file system (private cloud storage), with no center, high performance, high reliability, maintenance free and other advantages, support breakpoint continuation, block upload, small file merge, automatic synchronization, automatic repair.(similar fastdfs).

Go 3568Updated: 1 y ago License: Permissive (Unlicense)

lakeFS - Data version control for your data lake | Git for data

Go 3443Updated: 1 y ago License: Permissive (Apache-2.0)

Continuous Archiving for Postgres

Python 3380Updated: 2 y ago License: Permissive (BSD-3-Clause)

CubeFS is a cloud native file storage

Go 3347Updated: 1 y ago License: Permissive (Apache-2.0)

The Decentralized and Scaled Blockchain

Rust 3128Updated: 1 y ago License: No License (No License)

:nut_and_bolt: A relentless key-value store for the browser.

JavaScript 3028Updated: 1 y ago License: Permissive (MIT)

A transparent bridge between Git and Dropbox - use a Dropbox (shared) folder as a Git remote! 🎁

Python 2989Updated: 2 y ago License: Permissive (MIT)

An AngularJS module that gives you access to the browsers local storage with cookie fallback

JavaScript 2849Updated: 2 y ago License: Proprietary (Proprietary)