Show HN: Walrus – a Kafka alternative written in Rust
19 points
2 days ago
| 2 comments
| github.com
| HN
k_bx
24 minutes ago
[-]
There's also Iggy https://github.com/apache/iggy

Never tried it, but looks promising

reply
roncohen
1 hour ago
[-]
As someone who myself worked on a hobby-level Rust based Kafka alternative that used Raft for metadata coordination for ~8 months: nice work!

Wasn't immediately clear to me if the data-plane level replication also happens through Raft or something home-rolled? Getting consistency and reliability right with something home-rolled is challenging.

Notes:

- Would love to see it in an S3-backed mode, either entirely diskless like WarpStream or as tiered storage.

- Love the simplified API. If possible, adding a Kafka compatible API interface is probably worth it to connect to the broader ecosystem.

Best of luck!

reply
seanhunter
15 minutes ago
[-]
It says on the github page

   " It provides fault-tolerant streaming with automatic leadership rotation, segment-based partitioning, and Raft consensus for metadata coordination."
So I guess that's a "yes" to raft?
reply