gslib | sparse communication library
kandi X-RAY | gslib Summary
kandi X-RAY | gslib Summary
sparse communication library
Support
Quality
Security
License
Reuse
Top functions reviewed by kandi - BETA
Currently covering the most popular Java, JavaScript and Python libraries. See a Sample of gslib
gslib Key Features
gslib Examples and Code Snippets
Community Discussions
Trending Discussions on gslib
QUESTION
This might be a duplicate but none of the previous answers match my conditions.
I installed gsutil as part of the google-cloud-sdk following https://cloud.google.com/sdk/docs/install. I could configure gcloud properly without errors.
Every time I try to use gsutil, like for example with gsutil -D ls
, I get
ANSWER
Answered 2021-May-31 at 20:27After giving up on this I decided to reinstall one last time the whole google-cloud-sdk suite, but this time using the snap version. Installing it via snap solved the issue for me. I think this points to some issue with my environment that was bypassed thanks to the snap containerization.
So no clear answer here, but if anyone is experiencing the same problem giving a chance to snap may solve the issue as it did for me
QUESTION
While transferring file(s) from a Linux system to Google Cloud Platform using the gsutil cp
command, it fails at some old ".eml" files when trying to process its content (not just file name!) which contains non-English characters not encoded in Unicode.
The command attempted was:
...ANSWER
Answered 2021-May-20 at 01:12I took your string with Chinese characters and was able to reproduce your error. I fixed it after updating to gsutil 4.62
. Here's the merged PR and issue tracker as reference.
Update Cloud SDK by running:
QUESTION
I was trying to back up my whole computer drive to google cloud storage, people mainly told me that was nonsensical, and while pondering it all, I decided just to do documents and desktop, and my goal was to use the google cloud SDK as I'm new to this and I like a challenge. So I type in:
...ANSWER
Answered 2020-Dec-13 at 18:48Your problem is caused by MAX_PATH. The default is 260 characters.
Method 1 - Specify UNC Paths
Prefix paths with "\\?\"
. This changes maximum path names to 32,767 characters.
QUESTION
do you know if its possible to remove the retention of a bucket including any subfolder in it?
I've tried with the -m option and it includes only the objects (files) but not the subfolders and the objects inside those subfolders which is actually what I want:
...ANSWER
Answered 2020-Aug-04 at 15:50You can add as much asterisks as subfolder levels you may have, like so:
QUESTION
What I am trying to do: copy contents of a folder to a bucket. I have successfully done this in earlier versions of gsutil. Not sure if its the python version OR the gsutil version that caused this to break now. Any insights?
Command: gsutil -m cp -r . gs://target-bucket-url
Running: MacOS 10.15.5
Got the following error when trying the above command:
...ANSWER
Answered 2020-Jul-02 at 20:09This is a known issue and the Google team is taking a look at it at this issue tracker, I recommend you to go there and add more information if possible: AttributeError: module 'gslib' has no attribute 'USER_AGENT'
QUESTION
gsutil
command (with or without arguments) is returning the error:
ModuleNotFoundError: No module named 'gslib'
How to solve that, please?
...ANSWER
Answered 2020-May-15 at 22:59I solved the problem running this command:
QUESTION
ANSWER
Answered 2020-Apr-23 at 17:36Adding --psm 7
to the Tesseract call solved the problem (tesseract screenshot-cropped.png screenshot-ocred -l eng --psm 7
).
QUESTION
so I'm trying to add automatic backups to my minecraft server and I'm using a bash script that auto saves the world and puts it in cloud storage. Whenever I run the script, I get this error:
raise error, v # invalid expression sre_constants.error: bad character range
I have installed Python 3 after hearing that it is a Python 2.7 problem and the script runs 2.7 anyways with the same error.
Python versions: 2.7.13 (used) and 3.5.3. Debian Linux
The bash script:
...ANSWER
Answered 2019-Dec-23 at 08:25This error raise error, v # invalid expression
is triggered by gsutil. This is triggered because you are not following the object naming rules
This part is invalid $(date "+%Y%m%d-%H%M%S")
because you are using wildcards characters which are being taken literally by gsutil and you are also leaving a space in the name which isn't accepted.
I suggest you get the date and time in another step of your batch and then add it directly as a String to the gsutil command.
QUESTION
I have set up a bucket within a project to store uploaded files. Trying to make sure I can write to bucket with a test node program that uploads file to the bucket which fails. Then I tried to copy a file to the bucket using gsutil and it retries until it times out. Upon further investigation every command using gsutil results in a time out error. There seems to be little information on this error on the internet.
I have removed and regenerated the .boto file with gcloud init
This command works. I have also done a clean reinstall of the sdk twice and still have the issue. The ACL for the project and the bucket have me included. Below is the node program and the timeout error from gsutil cp test.txt gs://mybucket
ANSWER
Answered 2019-Jan-25 at 22:17I am assuming that this is a node.js project running as a server and not code bundled to run in a browser.
Your problem is defined in this line:
QUESTION
I have used gsutil rsync
without -d
argument, even without any argument, but I still got ResumableUploadAbortException: 403 abc@xyz.iam.gserviceaccount.com does not have storage.objects.delete access
.
I want to create an application only for upload files to google cloud storage, using gsutil rsync
from google compute engine.
I have added permission to read and list,
because I don't want the application able to delete any of file in the bucket, so I did not give permission for storage.objects.delete
.
Is there any parameter to use the gsutil rsync
command without having to give access to delete a file?
I want to use rsync
because I have to transfer gigabytes of files.
thank you.
[EDIT] add additional information and debug:
I want to add additional information, this app running as cron, upload timestamp generated filename, so it would be different everytime it executed.
The upload process actually worked, the file uploaded to the bucket, but I still got ResumableUploadAbortException
at the end.
so I run gsutil -D rsync
to debug:
ANSWER
Answered 2019-Jan-20 at 02:15If I had to guess, you're trying to overwrite an existing object. This will delete the existing object, replacing it with another object of the same name.
One alternative might be gsutil cp -n
, which will not overwrite existing files at the destination. But if you want to be able to overwrite objects, you'll need delete permission.
As mentioned in the comments below, this can also happen as the result of parallel composite uploads being enabled (at the point where gsutil attempts to delete the component objects). This behavior can be disabled by setting parallel_composite_upload_threshold=0
in your boto file, or inline in the command, e.g. gsutil -o "GSUtil:parallel_composite_upload_threshold=0" ...
.
Community Discussions, Code Snippets contain sources that include Stack Exchange Network
Vulnerabilities
No vulnerabilities reported
Install gslib
Support
Reuse Trending Solutions
Find, review, and download reusable Libraries, Code Snippets, Cloud APIs from over 650 million Knowledge Items
Find more librariesStay Updated
Subscribe to our newsletter for trending solutions and developer bootcamps
Share this Page