py-amqp | amqplib fork - | Reactive Programming library

I can't open the socket using celery and WSL.

See the following info:

• [ ] output of celery -A proj report:

We quite often have the need to enqueue many messages (we chunk them into groups of 1000) using Celery (backed by RabbitMQ). Does anyone have a way to do this? We're basically trying to "batch" a large group of messages in one send_task call.

If i were to guess we would need to go a step "deeper" and hook into kombu or even py-amqp.

Regards,
Niklas

I can't figure out how to define celery tasks in a modular way (i.e. not all tasks in the same file) and register them correctly for asynchronous use. I've tried all options I can think off:

• using the decorator based tasks
• using class based tasks
• using autodiscover_tasks on celery app object
• registering tasks manually, i.e. app.tasks.register(Task1()) for a class based task
• executing celery worker in same directory as celery_app.py
• executing celery worker in the directory above the one containing celery_app.py
• specifying the app for the celery worker command with the -A option.
• not specifying the app for the celery worker
• specifying an empty "name" property in the class based task.
• specifying a name property containing with the correct module

Whatever I do, I always end up with 'KeyError' thrown by the task registry, but only when executing with apply_async. The synchronous version always works fine.

If anyone could give me a hint on what I should do to fix this, please share.

Here is a minimal example:

• minimal
  • task1
    • __init__.py
    • task.py
  • task2
    • __init__.py
    • task.py
  • __init__.py
  • celery_app.py
  • start.sh
  • test.py

minimal.task1.task

I am struggling to make the airflow worker run tasks. I started services: