flytekit | Extensible Python SDK for developing Flyte tasks | BPM library

by flyteorg Python Version: 1.12.0b7 License: Apache-2.0

X-Ray Key Features Code Snippets Community Discussions(2)Vulnerabilities Install Support

kandi X-RAY | flytekit Summary

flytekit is a Python library typically used in Automation, BPM, Spark applications. flytekit has no bugs, it has no vulnerabilities, it has build file available, it has a Permissive License and it has low support. You can install using 'pip install flytekit' or download it from GitHub, PyPI.

Flytekit Python is the Python SDK built on top of Flyte.

Support

Quality

Security

License

Reuse

Support

flytekit has a low active ecosystem.

It has 141 star(s) with 157 fork(s). There are 249 watchers for this library.

There were 10 major release(s) in the last 6 months.

flytekit has no issues reported. There are 67 open pull requests and 0 closed requests.

It has a neutral sentiment in the developer community.

The latest version of flytekit is 1.12.0b7

Quality

flytekit has 0 bugs and 0 code smells.

Security

flytekit has no vulnerabilities reported, and its dependent libraries have no vulnerabilities reported.

flytekit code analysis shows 0 unresolved vulnerabilities.

There are 0 security hotspots that need review.

License

flytekit is licensed under the Apache-2.0 License. This license is Permissive.

Permissive licenses have the least restrictions, and you can use them in most projects.

Reuse

flytekit releases are available to install and integrate.

Deployable package is available in PyPI.

Build file is available. You can build the component from source.

Installation instructions, examples and code snippets are available.

Top functions reviewed by kandi - BETA

kandi has reviewed flytekit and discovered the below as its top functions. This is intended to give you an instant insight into flytekit implemented functionality, and help decide if they suit your requirements.

Validate the given value and return it
Translate a file into a single file
Generate the flyte schema
Create a launch plan
Transform inputs into a dictionary
Create launch plan
Execute the data connector
Get the file name of a given dataset
Returns the file name of the given dataset
Register a new image
Create a new entity from entity mapping
Get the full path to an entity
Execute local execution
Run the shell script
Setup the configuration directory
Run a shell script
Terminate execution
Convert lv to a python value
Get the entity from the given entity mapping
Register the default transformer
Register files
Dispatch the task to execute
Local execute helper
List launch plan versions
Dispatch a task
Convert a value to a file
Execute the workflow

Get all kandi verified functions for this library.

flytekit Key Features

No Key Features are available at this moment for flytekit.

flytekit Examples and Code Snippets

No Code Snippets are available at this moment for flytekit.

Community Discussions

Trending Discussions on flytekit

Flyte 0.16.2: Error loading Blob - How to get Types.Blob.fetch() to work in task decorated function?

Pass blobs between tasks in Flyte

QUESTION

Flyte 0.16.2: Error loading Blob - How to get Types.Blob.fetch() to work in task decorated function?

Asked 2021-Apr-06 at 17:42

I have a Flyte task function like this:

...

ANSWER

Answered 2021-Apr-06 at 17:42

Could you please give a bit more information about the code? This is flytekit version 0.15.x? I'm a bit confused since that version shouldn't have the @task decorator. It should only have @python_task which is an older API. If you want to use the new python native typing API you should install flytekit==0.17.0 instead.

Also, could you point to the documentation you're looking at? We've updated the docs a fair amount recently, maybe there's some confusion around that. These are the examples worth looking at. There's also two new Python classes, FlyteFile and FlyteDirectory that have replaced the Blob class in flytekit (though that remains what the IDL type is called).

(would've left this as a comment but I don't have the reputation to yet.)

Some code to help with fetching outputs and reading from a file output

Source https://stackoverflow.com/questions/66957164

QUESTION

Pass blobs between tasks in Flyte

Asked 2020-Oct-22 at 05:18

I'm trying to create a Flyte workflow that needs to pass data between several tasks. I looked at one of the examples in the documentation, but trying to recreate the blob-passing as minimally as possible I still can't get it to work.

Here's my workflow definition, in full (my real use case produces a lot more data, of course):

...

ANSWER

Answered 2020-Oct-22 at 05:18

I am assuming you are running this on a local sandbox environment (you are using minio, which is test blob store that we deploy in the sandbox environment). Can you please share your flytekit.config file that you used to register the workflow.

So Flyte automatically stores intermediate data in a bucket (S3 / GCS) based on how you configure it.

The prefix setting is used to automatically upload the data to the configured bucket and prefix https://github.com/lyft/flytesnacks/blob/b980963e48eac4ab7e4a9a3e58b353ad523cee47/cookbook/sandbox.config#L7

Versions prior to v0.7.0 - the shard formatter setting in the config is used- https://github.com/lyft/flytesnacks/blob/b980963e48eac4ab7e4a9a3e58b353ad523cee47/cookbook/sandbox.config#L14-L17

Please also tell us what version of Flyte you are running. Please join the slack channel and I can help you get started. Sorry for all the troubles

Source https://stackoverflow.com/questions/64467317

Community Discussions, Code Snippets contain sources that include Stack Exchange Network