brokerd | Message broker with log-structured storage and HTTP API | Pub Sub library

brokerd is a C++ library typically used in Messaging, Pub Sub, Kafka applications. brokerd has no bugs, it has no vulnerabilities, it has a Strong Copyleft License and it has low support. You can download it from GitHub.

brokerd is a minimalistic message broker service. A brokerd instance manages a number of "channels". Each channel maps to a file on disk and supports two operations: append(channel, msg) and getnext(channel, offset). The append operation appends a message at the end of the file. Messages are then identified by the (logical) file offset at which they were written. The initial offset for the first message in a channel is zero and then increases monotonically with each subsequent message. The getnext operation reads a batch of messages from a channel starting at a given offset. When consuming messages from a channel the client is responsible for storing the last offset it has consumed. If a disk space limit is configured using --disklimit, old messages will eventually be deleted from the beginning of the channel to reclaim space. When a client tries to read a message (offset) that has been garbage collected, brokerd will return the next valid message in the channel. Reading from offset zero is therefore always a valid operation and returns the first/oldest retained message from the channel.