faust | Functional programming language for signal processing | Audio Utils library

As I understand it you use both with Kafka, and both from Python, but with the difference that:

• Faust is for stream processing (filtering, joining, aggregating, etc)
• kafka-python (just like confluent-kafka-python also) is a client library providing Consumer, Producer, and Admin APIs for Kafka.

So you could easily use both, for different purposes, from Python.

Changed code structure for this:

No, it is not possible to search package descriptions with conda search. The query results of conda search, including those with the --info|-i flag, do not include package description info.

There is limited functionality for retrieving package summaries from Anaconda Cloud. This is provided by the anaconda show command in the package anaconda-client and only provides exact matching (channel and package). For example,

Keeping in mind that the offsets are controlled by the Kafka server using a consumer group with the same name as your faust app, I've been using the kafaka-consumer-groups CLI ( part of your kafka install ) to do this.

Force pytest to use Faust's asyncio event loop as the default global loop. Add the following fixture to your test code:

You're causing undefined behavior when you call strcat(end, "X"); because end points to src, and src doesn't have a null terminator and doesn't have enough bytes allocated to concatenate anything.

If you're reading the file one byte at a time, you don't need an array. Just read into a char variable. When the character is a newline, write an X to the output file before writing the character.

Another problem: when you call open() to create the output file, you have to pass a third argument containing the desired file permissions.

The Faust worker will also expose a web server on every instance, that by default runs on port 6066.

The server will use the aiohttp HTTP server library and you can take advantage of this thing and create a server-side event streaming (SSE) like in your example code.

You can create an agent that will read from Kafka topic test and will update a variable last_message_from_topic with the last message from the topic, this variable will be visible also from your web pages.

In the index page (@app.page('/')) the EventSource interface is used to receive server-sent events. It connects to the server over HTTP and receives events in text/event-stream format from the page /hello without closing the connection.

The web page /hello at every second is sending a message text with the last message from the Kafka topic test and with the current time from the server.

here is my file my_worker.py code:

In the constructor, the assignment to this.radius is an assignment to the "radius" property of this. The value of this is of course the newly-created object, and the prototype chain of that object is already set up by the time the constructor code runs. Thus the setter for "radius" will definitely be called, and you'll get the exception.

The setter and getter methods are indeed on the prototype, but the whole point of doing that is to make it so that every instance shares that behavior. The object referenced by this in the constructor function is one of those instances.

For "simple" prototype properties that don't have getter/setter functions, assignment to this.whatever in the constructor function or anywhere else will always create a property locally on the target object instead of changing the property value on the prototype. Properties with getter/setter methods don't work that way.

Note that the code in the constructor function does not follow different rules than code in any other function. Special things happen on the way in to the function and on the way out, but otherwise it's plain ordinary code.

I think this might be what you're looking for: https://faust.readthedocs.io/en/latest/reference/faust.transport.consumer.html#faust.transport.consumer.Consumer.seek

It can go to a specific offset, however I don't think there's an easy way to tell it to go to a specific time or date without some extra logic (maybe binary search your way there using the offset?).