s3fs-fuse | FUSE-based file system backed by Amazon S3 | Cloud Storage library

by s3fs-fuse C++ Version: v1.92 License: GPL-2.0

X-Ray Key Features Code Snippets Community Discussions(8)Vulnerabilities Install Support

kandi X-RAY | s3fs-fuse Summary

s3fs-fuse is a C++ library typically used in Storage, Cloud Storage, Amazon S3 applications. s3fs-fuse has no bugs, it has no vulnerabilities, it has a Strong Copyleft License and it has medium support. You can download it from GitHub.

FUSE-based file system backed by Amazon S3

Support

Quality

Security

License

Reuse

Support

s3fs-fuse has a medium active ecosystem.

It has 7221 star(s) with 962 fork(s). There are 171 watchers for this library.

There were 1 major release(s) in the last 12 months.

There are 204 open issues and 910 have been closed. On average issues are closed in 199 days. There are 12 open pull requests and 0 closed requests.

It has a neutral sentiment in the developer community.

The latest version of s3fs-fuse is v1.92

Quality

s3fs-fuse has 0 bugs and 0 code smells.

Security

s3fs-fuse has no vulnerabilities reported, and its dependent libraries have no vulnerabilities reported.

s3fs-fuse code analysis shows 0 unresolved vulnerabilities.

There are 0 security hotspots that need review.

License

s3fs-fuse is licensed under the GPL-2.0 License. This license is Strong Copyleft.

Strong Copyleft licenses enforce sharing, and you can use them when creating open source projects.

Reuse

s3fs-fuse releases are available to install and integrate.

Installation instructions, examples and code snippets are available.

It has 74 lines of code, 7 functions and 1 files.

It has medium code complexity. Code complexity directly impacts maintainability of the code.

Top functions reviewed by kandi - BETA

kandi's functional review helps you automatically verify the functionalities of the libraries and avoid rework.
Currently covering the most popular Java, JavaScript and Python libraries. See a Sample of s3fs-fuse

Get all kandi verified functions for this library.

s3fs-fuse Key Features

No Key Features are available at this moment for s3fs-fuse.

s3fs-fuse Examples and Code Snippets

No Code Snippets are available at this moment for s3fs-fuse.

Community Discussions

Trending Discussions on s3fs-fuse

s3fs use credentials and config within $HOME/.aws as opposed to a /passwd-s3fs file

How to make S3FS use IMDS v2 when mounting s3 buckets from EC2 instance

Why s3fs is showing "invalid option -- 'j'" when I have no Js using Docker?

How to access Amazon S3 bucket to the Kubernetes pods using IAM roles instead of Access key & secret keys?

Centralized & versioned file based system for a web application deployed in Kubernetes

Problem installing S3FS on the RHEL 6 system

s3fs: Could not load mime types for curl library

How To Create docker-compose.yml file

QUESTION

s3fs use credentials and config within $HOME/.aws as opposed to a /passwd-s3fs file

Asked 2021-Dec-31 at 10:09

I'm looking at the readme of s3fs repo.

I wouldlike to mount an S3 dir locally using this tool. The readme says:

s3fs supports the standard AWS credentials file stored in ${HOME}/.aws/credentials. Alternatively, s3fs supports a custom passwd file.

The subsequent examples all seem to use the custom passwd file as opposed to the credentials in ~/.aws. I would like to use credentials in ~/.aws.

my .aws credentials and config file looks something like this:

~/.aws/credentials:

...

ANSWER

Answered 2021-Dec-31 at 10:09

If you want to use the "work" profile from ${HOME}/.aws/credentials then you need to add the -o profile=work option.

Source https://stackoverflow.com/questions/69928235

QUESTION

How to make S3FS use IMDS v2 when mounting s3 buckets from EC2 instance

Asked 2021-Sep-06 at 06:26

We are unable to mount a S3 bucket on an AWS EC2 instance that requires IMDS v2 (IMDS v1 works fine, though!). We're using s3fs-fuse v1.90 which is supposed to support IMDS v2 (on Ubuntu 18.04).

This is how we've been trying to mount our S3 bucket:

...

ANSWER

Answered 2021-Sep-02 at 16:18

Does it work if you specify the IAM role explicitly?

It looks like there may be an issue with retrieval of the IAM role information (needed with iam_role=auto) when tokens are required.

Additionally, when testing this, I had issues with when the -f option is used, so also try removing that.

Below are logs that show the proper token retrieval when mounting a bucket with the following command. Bucket access via the mount point works as expected.

$ sudo s3fs /mnt -o iam_role=s3fs-testing,allow_other,uid=1000,gid=1000,mp_umask=007,use_cache=/tmp/s3foldercache,dbglevel=debug

Source https://stackoverflow.com/questions/69031023

QUESTION

Why s3fs is showing "invalid option -- 'j'" when I have no Js using Docker?

Asked 2021-Apr-16 at 17:56

I´m building a docker image using that has a log file that must be mounted as an S3 folder. I´m using s3fs for the trick; however, I cannot run it, I´m constantly getting this bug:

s3fs: invalid option -- 'j'

This is an example of my Dockerfile:

...

ANSWER

Answered 2021-Apr-16 at 17:56

My solution, thanks to Charles Duffy hints.

I created a sh file (start.sh) that contains:

Source https://stackoverflow.com/questions/67127077

QUESTION

How to access Amazon S3 bucket to the Kubernetes pods using IAM roles instead of Access key & secret keys?

Asked 2021-Mar-17 at 21:55

I am trying to mount S3 bucket using s3fs-fuse to the Kubernetes pod. My S3 bucket is protected by IAM roles and i dont have Access Keys and Secret Keys to access S3 bucket. I know how to access a S3bucket from the Kubernetes pod using Access & Secrets Keys, but how do we access S3 bucket using IAM roles ?

Does anyone has suggestion on doing this ?

...

ANSWER

Answered 2021-Jan-16 at 05:43

You use the IRSA system, attaching an IAM role to a Kubernetes service account and then attaching that K8s SA to your pod. See https://docs.aws.amazon.com/eks/latest/userguide/iam-roles-for-service-accounts.html for a starting point.

Source https://stackoverflow.com/questions/65745591

QUESTION

Centralized & versioned file based system for a web application deployed in Kubernetes

Asked 2021-Jan-13 at 00:59

I am trying to create an Centralized file based repository where I can upload all the configuration files needed for an application to run which is deployed as a pod inside the Kubernetes. Any suggestion on achieving this functionality ? Can the file based repository version the files uploaded ?

I see that s3fs-fuse can be used to achieve this, but i lack to see that, it wont support versioning the added config files in the S3 bucket. https://github.com/s3fs-fuse/s3fs-fuse

Any other suggestion ?

...

ANSWER

Answered 2021-Jan-11 at 23:57

You could use elastic file system which is supported by EKS:

Applications running in Kubernetes can use EFS file systems to share data between pods in a scale-out group, or with other applications running within or outside of Kubernetes. EFS can also help Kubernetes applications be highly available because all data written to EFS is written to multiple AWS Availability zones. If a Kubernetes pod is terminated and relaunched, the CSI driver will reconnect the EFS file system, even if the pod is relaunched in a different AWS Availability Zone.

But its not S3 and it does not have versioning of files such as S3 has. You would have to add such functionality yourself, e.g. by keeping everything in a git repository on the EFS file system.

Source https://stackoverflow.com/questions/65675591

QUESTION

Problem installing S3FS on the RHEL 6 system

Asked 2020-Nov-17 at 18:17

We're trying to move off a physical RHEL 6 server, with the help of some S3 storage. I'm following the special RHEL 6 install process call out in the install instructions. The fuse 2.8.4 install appears to work but when I try to install s3fs it appears to fail.

Is there some other steps I need to make sure are installed, other then those in the install instructions?

...

ANSWER

Answered 2020-Aug-09 at 02:05

s3fs master branch requires a newer kernel and glibc:

https://github.com/s3fs-fuse/s3fs-fuse/issues/1354

You can work around this by compiling s3fs 1.86 instead.

Source https://stackoverflow.com/questions/63303833

QUESTION

s3fs: Could not load mime types for curl library

Asked 2020-Apr-28 at 09:09

I have a strange problem. Last thursday my code has worked, so I'm a little bit confused.

What I want: Mount an S3-Bukket via S3FS to an EC2-Instance.

What thursday worked: Successfully mounted that S3-Bucket to my EC2-Instance.

What today is not working: Mounting that S3-Bucket to my EC2-Instance.

My EC2 Userdata:

...

ANSWER

Answered 2020-Apr-14 at 12:46

You can install the mime types via: yum install mailcap.

Source https://stackoverflow.com/questions/61207571

QUESTION

How To Create docker-compose.yml file

Asked 2020-Apr-02 at 11:50

I am a beginner in docker so I have no good knowledge but I am keen to learn more. So I hope this community can guide me. Now I have a Dockerfile.

...

ANSWER

Answered 2020-Apr-02 at 07:26

If you want to set up many containers at one time you need to configure docker-compose file and that's all. You needn't build the container from the image manually. It docker-compose does when first time builds and runs containers.

Create an empty folder called 'docker' and inside 'docker' directory create a directory with the name 's3', put there your docker file there. Move there and there in terminal type:

Source https://stackoverflow.com/questions/60984684

Community Discussions, Code Snippets contain sources that include Stack Exchange Network

Vulnerabilities

No vulnerabilities reported

Install s3fs-fuse

Many systems provide pre-built packages:. Note: Homebrew has deprecated osxfuse and s3fs may not install any more, see #1618. Otherwise consult the compilation instructions.
Amazon Linux via EPEL: sudo amazon-linux-extras install epel sudo yum install s3fs-fuse
Arch Linux: sudo pacman -S s3fs-fuse
Debian 9 and Ubuntu 16.04 or newer: sudo apt install s3fs
Fedora 27 or newer: sudo dnf install s3fs-fuse
Gentoo: sudo emerge net-fs/s3fs
RHEL and CentOS 7 or newer via EPEL: sudo yum install epel-release sudo yum install s3fs-fuse
SUSE 12 and openSUSE 42.1 or newer: sudo zypper install s3fs
macOS via Homebrew: brew install --cask osxfuse brew install s3fs