docker-on-windows | Code samples for the book `` Docker on Windows | Continuous Deployment library

When working behind a corporate proxy (automatically activated in Windows) by Cisco AnyConnect(v4.7.03052) VPN, I'm unable to pull any docker image either from our docker nexus registry or the official registry.
Funny enough, if I set the proxy settings in the config.json and pass the proxy as build-arg my containers are able to build(from previously pulled images) and talk to the exterior.
Only the docker engine is unable to access the internet through the proxy.

I've already tried the following:

• Set the HTTP_PROXY/HTTPS_PROXY as environments variables
• Set the proxy settings in the Docker Desktop proxy section - Docker doc
• Set the resources network IP to the non-secured Cisco AnyConnect routes IPv4
• No firewall rules seems to block the outbound request from the docker engine service.
• Edit the deamon.json used by the docker service to register the mirror registries.

Stackoverflow answers not working in this case: docker-win10; docker on windows; docker image proxy

Platform info:

• Win 10 - Build 19401
• Docker Desktop 4.4.4(73704)
• Docker Engine 20.12.12 (Linux container on Hyper-V)
• Cisco AnyConnect v4.7.03052

Error message on docker pull:

I want to use Docker to manage multiple Python versions (I recently got a Mac with Apple Silicon and I use old Python environment).

Since I need to read Python scripts on Docker and save the output files (for later use outside the Docker environment), I tried to mount a folder (on my Mac) following this post.

However, it shows this error:

A while back I had installed Docker and created some base images. I noticed a lot of folders were being created in folders C:\ProgramData\docker\containers and C:\ProgramData\docker\windowsfilter. Besides that I don't know exactly how these folders are different, I wanted to start from scratch, just so I know exactly when and how these folders were created and also to make sure I know how to limit the amount of folders. For that I need a deeper understanding of what happened and how I got here. So I removed all folders from both of the above folders.

Then in PowerShell ran command docker image pull mcr.microsoft.com/windows/servercore:ltsc2019 (as described here).

However, then I get error:

Trying to install Docker in process isolation on Windows Server 2019 and following these steps. (I can't use Hyper-V on this server) when running PowerShell in admin mode.

I however get the error

Get-PackageProvider : A parameter cannot be found that matches parameter name 'ListAvailableget-packagesource'

I also tried Install-Package -Name docker -ProviderName DockerMsftProvider I then get:

When I try to run dotnet watch through docker (on windows, wsl) I get an error like Unhandled exception. System.ArgumentException: An item with the same key has already been added. Key: /src/bin/Debug/net5.0/Tickets.runtimeconfig.json. The Key: ... is always different.

This error sometimes happens while building:

I have a ReactJS 17 app, in which I would like to substitute environment variables from my global environment into my src/index.html file. However, we're not using .env files, as this answer suggests -- Create React App: using environment variables in index.html . Here is the src/index.html file ...

I have dotnet solution which consists of console project, webapi project and mysql db. I put them in separate docker images, wrote docker-compose to start and tested on my machine. Next, I wrote a test using FluentDocker, which allows me to start docker-compose programmatically and verify that containers are up and running.

Now I want to do this on Gitlab CI. Previously I used image: mcr.microsoft.com/dotnet/core/sdk:3.1 and run test stage against test project. It worked fine because there was no docker integration. I cant run FluentDocker test on Gitlab CI because the image does not contain docker. So I started researching.

1. Solution to incorporate db in CI job is here https://docs.gitlab.com/ee/ci/docker/using_docker_images.html#what-is-a-service , but I doubt that I can use docker as service.

2. Next is using docker intergration for gitlab runner https://docs.gitlab.com/ee/ci/docker/using_docker_build.html#use-docker-in-docker-workflow-with-docker-executor or https://tomgregory.com/running-docker-in-docker-on-windows/ I cant use that because I use free runner from Gitlab itself and cant configure it. I tried to run docker info command, it fails in my script.

3. I thought of building my own image based on dotnet sdk with docker included, but it seems like a bad idea. And I did not make it working in the end.

4. Solution that seems working is to use dind and start docker-compose: How to run docker-compose inside docker in docker which runs inside gitlab-runner container? or https://gitlab.com/gitlab-org/gitlab-foss/-/issues/30426 But to use it I will need to install dotnet-sdk to build and test my app in before-script section, and sdk is not a small package to download each time.

5. I can try to build my image based on docker:dind and include dotnet sdk there, publish it on dockerhub then use it in gitlab runner. Now it seems to me as the last option.

So, whats the correct approach here?

-----------edit--------------

I made this working! See the very thorough answer from Konrad Botor with dockerfile and yml file. I built my own image with sdk and docker and used it for test stage with dind service linked. My image is hosted on dockerhub, so gitlab downloads it for usage.

Also some notes:

1 - how to use dind as service https://gitlab.com/gitlab-org/gitlab-runner/-/issues/25344

2 - where to get modprobe.sh and docker-entrypoint.sh https://github.com/docker-library/docker (go inside latest release). Very important is to clone repo and copy files from there, because I tried to copy-paste contents and it did not work.

3 - docker-compose repo https://github.com/tmaier/docker-compose/blob/master/Dockerfile

4 - dind example https://gitlab.com/gitlab-examples/docker/-/blob/master/.gitlab-ci.yml

Ref: https://rominirani.com/docker-on-windows-mounting-host-directories-d96f3f056a2c

I want to manipulate my data by using docker image of gdal. The problem is I have to create a GUI wrapper in Java using Swing. How can run the docker command from Java ProcessBuilder? That is run the powershell commands from Java.

OS: Ubuntu 19.10
git: 2.20.1

I just spend a lot of time writing up some documentation. I saved the markdown file in my documentation site's project folder as: content/topics/workflow/docker/git-workflow.md