minio | Minio Cluster - S3 Compatible Object Storage | Cloud Storage library

Does anybody install DVC on MinIO storage?

I have read docs but not all clear for me.

Which command should I use for setup MinIO storage with this entrance parameters:

storage url: https://minio.mysite.com/minio/bucket-name/ login: my_login password: my_password

I searched for a solution to have confluentic-kafka work with ingress, and I reached this PR that did such implementation, but this PR isn't accepted (yet - the repository owner dropped and the repo doesn't exist any more).

So, I tried to implement something very simple as a proof of concept using as a reference this manual.

Currently I have ingress enabled:

I need to retrieve the filename for a bash script. I thought mc ls could do all that ls can do, but I seem to be mistaken. So now I'm struggling with regex.

When I do mc ls minio/bucket1/, I'll get:

I'm running Kubeflow in a local machine that I deployed with multipass using these steps but when I tried running my pipeline, it got stuck with the message ContainerCreating. When I ran kubectl describe pod train-pipeline-msmwc-1648946763 -n kubeflow I found this on the Events part of the describe:

I'm getting this issue below. Anyone has an idea what could be wrong?

Need to move from use of minio client to a docker image having gcloud/gsutil and mysql images.

What i have currently:

1. /tmp/mc alias set gcs1 https://storage.googleapis.com $ACCESS_KEY $SECRET_KEY
2. mysqldump --skip-lock-tables --triggers --routines --events --set-gtid-purged=OFF --single-transaction --host=$PXC_SERVICE -u root --all-databases | /tmp/mc pipe gcs1/mysql-test-dr/mdmpdb10.sql

What i need to change to: 3. 4. mysqldump --skip-lock-tables --triggers --routines --events --set-gtid-purged=OFF --single-transaction --host=$PXC_SERVICE -u root --all-databases --skip-add-locks > $FILE_NAME && gsutil cp $FILE_NAME gs://$BUCKET_NAME/$FILE_NAME

Is there any replacement in gcloud/gsutil for the line no.1? I was able to find gcloud auth activate-service-account [ACCOUNT] --key-file=[KEY_FILE] But that would be the service account key. I need to authenticate to the bucket using hmac keys.

I have set a MinIO bucket's access permission to "download" so that files can be read (but not written) by anyone, but this has enabled an "index page" that shows the contents of the entire bucket. For example, consider the bucket store/test that contains the file example.png. I would like example.png to be readable by the world wide web, so I set the access permission for store/test to "download", which means that https://store.example.com/test/example.png is now readable by anyone, but it also means that https://store.example.com/test now shows a listing of all files in the bucket:

Kubeflow pipeline runs generate artifacts, which from what i can see in the dashboard are saved on minio. How can I delete them?

Saving multiple corpuses takes a lot of disk space, so sooner or later I'll be running out of memory.

I am bit confused about minio s3 gateway. Do we required aws sdk when we are running the minio server with s3 gateway? MY server started running and browsers is showing me the s3 buckets but I can't connect to the server through my node app. It is stating that port 9000 is invalid. Is that anything relevent to aws sdk or something else needs to be done here?

I have gone through the document of minio but didn't find anything for this in proper way. The docs are divided in different blocks and It doesn't stating anything like this. I've been stuck into this since 2 days. I would really grateful if someone can help me in this.

The error log as as below: