aws-mwaa-local-runner | This repository provides a command line interface (CLI) utility that replicates an Amazon Managed Wo | AWS library

by aws Shell Version: v2.0.2 License: MIT-0

X-Ray Key Features Code Snippets Community Discussions(3)Vulnerabilities Install Support

kandi X-RAY | aws-mwaa-local-runner Summary

aws-mwaa-local-runner is a Shell library typically used in Cloud, AWS applications. aws-mwaa-local-runner has no bugs, it has no vulnerabilities, it has a Permissive License and it has low support. You can download it from GitHub.

This repository provides a command line interface (CLI) utility that replicates an Amazon Managed Workflows for Apache Airflow (MWAA) environment locally.

Support

Quality

Security

License

Reuse

Support

aws-mwaa-local-runner has a low active ecosystem.

It has 448 star(s) with 486 fork(s). There are 18 watchers for this library.

It had no major release in the last 12 months.

There are 34 open issues and 98 have been closed. On average issues are closed in 50 days. There are 18 open pull requests and 0 closed requests.

It has a neutral sentiment in the developer community.

The latest version of aws-mwaa-local-runner is v2.0.2

Quality

aws-mwaa-local-runner has no bugs reported.

Security

aws-mwaa-local-runner has no vulnerabilities reported, and its dependent libraries have no vulnerabilities reported.

License

aws-mwaa-local-runner is licensed under the MIT-0 License. This license is Permissive.

Permissive licenses have the least restrictions, and you can use them in most projects.

Reuse

aws-mwaa-local-runner releases are available to install and integrate.

Installation instructions are not available. Examples and code snippets are available.

Top functions reviewed by kandi - BETA

kandi's functional review helps you automatically verify the functionalities of the libraries and avoid rework.
Currently covering the most popular Java, JavaScript and Python libraries. See a Sample of aws-mwaa-local-runner

Get all kandi verified functions for this library.

aws-mwaa-local-runner Key Features

No Key Features are available at this moment for aws-mwaa-local-runner.

aws-mwaa-local-runner Examples and Code Snippets

No Code Snippets are available at this moment for aws-mwaa-local-runner.

Community Discussions

Trending Discussions on aws-mwaa-local-runner

MWAA requirements installation issue

Cannot configure docker-compose as an interpreter in PyCharm

AWS Airflow v2.0.2 doesn't show Google Cloud connection type

QUESTION

MWAA requirements installation issue

Asked 2022-Mar-17 at 15:09

I am building an airflow pipeline for Ml training using PyTorch. Each of my steps is a python operator.

It's currently a very simply pipeline: setup >> preprocess >> train

This is my requirements file:

...

ANSWER

Answered 2022-Mar-17 at 15:09

I found the solution:

Increase the computer size for the MWAA hosting service.

Source https://stackoverflow.com/questions/71316496

QUESTION

Cannot configure docker-compose as an interpreter in PyCharm

Asked 2021-Sep-14 at 16:01

I have a problem with configuration of Docker-compose as a remote interpreter in PyCharm. Inside of "Services" section I can select only "services" or "networks".

I am using this docker-compose file: https://raw.githubusercontent.com/aws/aws-mwaa-local-runner/main/docker/docker-compose-local.yml

...

ANSWER

Answered 2021-Aug-18 at 14:48

Either disable "Docker Compose V2" experimental feature in "Docker for Windows" app settings or update PyCharm to 2021.2.1 RC. See the relevant ticket in PyCharm's issue tracker - PY-49305.

Source https://stackoverflow.com/questions/68831844

QUESTION

AWS Airflow v2.0.2 doesn't show Google Cloud connection type

Asked 2021-Jul-19 at 17:26

I want to load data from Google Storage to S3

To do this I want to use GoogleCloudStorageToS3Operator, which requires gcp_conn_id

So, I need to set up Google Cloud connection type

To do this, I added

apache-airflow[google]==2.0.2

to requirements.txt

but Google Cloud connection type is still not in Dropdown list of connections in MWAA

Same approach works well with mwaa local runner

https://github.com/aws/aws-mwaa-local-runner

I guess it does not work in MWAA because of security reasons discussed here https://lists.apache.org/thread.html/r67dca5845c48cec4c0b3c34c3584f7c759a0b010172b94d75b3188a3%40%3Cdev.airflow.apache.org%3E

But still, is there any workaround to add Google Cloud connection type in MWAA?

...

ANSWER

Answered 2021-Jul-16 at 06:17

Connections can be created and managed using either the UI or environment variables.

To my understanding the limitation that MWAA have over installation of some provider packages are only on the web server machine which is why the connections are not listed on the UI. This doesn't mean you can't create the connection at all, it just means you can't do it from the UI.

You can define it from CLI:

Source https://stackoverflow.com/questions/68404064

Community Discussions, Code Snippets contain sources that include Stack Exchange Network

Vulnerabilities

No vulnerabilities reported

Install aws-mwaa-local-runner

You can download it from GitHub.

Support

The following section describes where to add your DAG code and supporting files. We recommend creating a directory structure similar to your MWAA environment.

Find more information at: