Ask HN: What Is the SQLite of Queues?
24 points
1 year ago
| 11 comments
| HN
I love how simple and lightweight sqlite is.

I'm looking for an open source queue solution with similar qualities. All I really want are topics/messages/publishers/subscribers. That's it.

I do not want to run ZooKeeper.

illuminant
1 year ago
[-]
https://github.com/yudhasubki/blockqueue

Literally, the sqlite of queues.

reply
deterministic
1 year ago
[-]
SQLite is the SQLite of queues. Simply use a table per queue. And use your choice of SQL to implement the types of queues you want.
reply
withinboredom
1 year ago
[-]
beanstalkd might be what you are looking for. It's ancient but solid af. I know of systems still running today that use it. For something more modern, check out Nats—and if you are using Go, you can embed the server in your executable.
reply
rl1987
1 year ago
[-]
If you need them for IPC within same host then POSIX queues (see https://pubs.opengroup.org/onlinepubs/7908799/xsh/mqueue.h.h...) are a thing.

Redis can be used as simple message queue as well.

reply
ivanr
1 year ago
[-]
Try NATS @ https://nats.io

It's a single binary and can operate as a message bus, persistent queue, KV store, object store, provide services, and so on.

reply
Zambyte
1 year ago
[-]
I really like NATS, but it's worth noting that it's only really "the SQLite of queues" in the context of their Go client, which can embed a NATS server into an application.

Otherwise I would really say it is more like the Postgres of queues (still great, but potentially not what OP is looking for)

reply
ttymck
1 year ago
[-]
reply
enjoyyourlife
1 year ago
[-]
RabbitMQ
reply
caprock
1 year ago
[-]
reply
ttymck
1 year ago
[-]
Notably not a persistent queue, correct?
reply
yamumsahoe
1 year ago
[-]
this is redis for me.
reply
toast0
1 year ago
[-]
/var/queue/
reply
brudgers
1 year ago
[-]
Serious engineering question:

Will SQLite work for your application?

I’m sure there are better solutions on paper and for performance under common workloads. But if SQLite is good enough for your use case, it’s good enough for your use case.

It probably isnt. Good luck.

reply
turtle_heck
1 year ago
[-]
Was wondering this for OP as well, I've used a database as a queue for small projects in the past and it was fine.
reply