container-builder | Website code for container-builder.com | Continuous Deployment library

I'm trying to build a build pipeline for my application and share a specific folder between steps using volumes.

The problem is because on my first step (unit-tests) I have to install all the libs on the requirements.txt to be able to run my unit tests. And after that I have to build my application running my Dockerfile in other step. I don't want to re-install all the requirements again, so, I thought in copy the requirements already installed and paste them inside the docker build step. Am I able to do that? I followed this thread and tried to replicate to my reality but I still have problems.

Passing files from Google Cloud Container Builder to Docker build task

Here is a sample of what I've done:

My cloudbuild.yaml:

After the latest updates to gcloud and docker I'm unable to access images on my google container repository. Locally when I run: gcloud auth configure-docker as per the instructions after updating gcloud, I get the following message:

I am running my monolith application in a docker container and k8s on GKE.

The application contains python & node dependencies also webpack for front end bundle.

We have implemented CI/CD which is taking around 5-6 min to build & deploy new version to k8s cluster.

Main goal is to reduce the build time as much possible. Written Dockerfile is multi stage.

Webpack is taking more time to generate the bundle.To buid docker image i am using already high config worker.

To reduce time i tried using the Kaniko builder.

Issue :

As docker cache layers for python code it's working perfectly. But when there is any changes in JS or CSS file we have to generate bundle.

When there is any changes in JS & CSS file instead if generate new bundle its use caching layer.

Is there any way to separate out build new bundle or use cache by passing some value to docker file.

Here is my docker file :

I would like to use Google Cloud SDK (including the Python Extensions for App Engine) inside Compute Engine, so I can replicate my local development setup in a virtual machine. I.e. run local dev_appserver.py and unit-testing on the VM, or deploy new app versions to Google App Engine.

After creating a new VM instance from the default Ubuntu 16.04 image and (machine type n1-standard-1), I have noticed that gcloud is already pre-installed.

I'm trying the following tutorial.

Automatic serverless deployments with Cloud Source Repositories and Container Builder

But I got the error below.

we're testing out CB and part of our requirements is sending messages to Slack.

This tutorial works great, but it'd be helpful if we could specify the source of the build, so we don't have to click in to the message to see what repo/trigger failed/succeeded.

Is there a variable we can pass to the cloud function in the tutorial? I couldn't find helpful documentation.

Ideally, it would be great if CB had an integration/slack GUI that made these options configurable but c'est la vie.

I am using Container Builder to process huge JSON files and transform them. It's a nice possibility of a non-standard usage of it as described here.

Is it possible to trigger a container builder build and pass a parameter to it via cloud functions? This would allow to act on newly uploaded files in GCS and process them via container builder automatically.

Currently I am trying to use the REST API for triggering it (I am new to Node.js), but I get a 404 on my URL. I am developing on a Cloud Shell instance with full API access.

The URL that I am trying to trigger via a PUT request and a JSON body containing the JSON equivalent of a successfully ran cloudbuild.yaml is: https://cloudbuild.googleapis.com/v1/projects/[PROJECT_ID]/builds

I am using the requests library from Node.js:

I'm a bit new to Google Cloud and am using a storage bucket to host a static website.

I've integrated automated builds via a build trigger when my master branch gets updated. I'm successfully able to see the changes when I push to GitHub, but when a preexisting file such as index.html gets updated, the file looses the permission to "Share publicly"

I've followed the tutorial below with the only difference being you the object permissions are now handled at the individual file level on the platform rather then a the top level for the bucket.

https://cloud.google.com/community/tutorials/automated-publishing-container-builder

This is my cloudbuild.yaml file

In the Google Source Repositories docs, it asks you to use git config credential.helper gcloud.sh to allow Git to authenticate

Recently, that's prevented me from using osxkeychain auth with GitHub - after adding that command, I get this error message when I attempt to pull from GitHub (on a repo whose only remotes are GitHub remotes):