filesystem | Provides basic utilities for the filesystem | File Utils library

You have a column with a "struct type" and you want to flatten it. To do so call flatten before calling to_pandas

The remote path must be /, not \.

And the argument to createCopyCommand cannot be Path, as on Windows, that will translate the / to \.

Your code first tests that your input exists (as a File) and is not a directory, then you go ahead and try to read it as a resource from the class path using getClass().getResourceAsStream(path). This is usually not what you want.

Try instead InputStream in = new FileInputStream(path);.

Like this:

Support for _PIP_ADDITIONAL_REQUIREMENTS environment variable has not been released yet. It is only supported by the developer/unreleased version of the docker image. It is planned that this feature will be available in Airflow 2.1.1. For more information, see: Adding extra requirements for build and runtime of the PROD image.

For the older version, you should build a new image and set this image in the docker-compose.yaml. To do this, you need to follow a few steps.

1. Create a new Dockerfile with the following content:

A concept is not a type, so it can’t appear as a container element type—neither in the type of an object (this is why you have to use std::vector to approximate std::vector) nor in the type for your concept ContainerOf. Moreover, you can’t use a concept as a template argument, so you can’t have a higher-order ContainerLike concept.

What you can do is make a Container concept that checks only for empty, add the constraint

$schema is only valid at the root, and properties values MUST be schemas.

You have a "$schema" : "#" inside properties. This means that you're trying to say that your JSON object should have a property called schema that can validate against the schema #. But # isn't a valid schema object, so the parse fails.

You need to remove the $schema from your properties.

I'd also suggest using a later draft of the schema spec (if you have control over the schema). Draft 6 is the oldest version that's compatible with the latest, 2020-12.

But for this you'll likely need to use a different validation package. There are several available. Mine is JsonSchema.Net.

Found the reason;

I couldn't commit the changes while having VS Code open. maybe it was a thing regarding only the first commit.

Now able to commit without having to close VS Code.

thanks to those who tried to help.

It seems like you can use update() instead of finishobjects() :

The thing is, the value does not change.

It's not supposed to. The filesystem::hash_value is a hash of the path to the file, not the contents of the file. If you want to compute a CRC of the contents of a file, you're going to have to read those contents and apply a CRC algorithm to them.