Ask HN: What Is the SQLite of Queues?
24 points
2 months ago
| 11 comments
| HN
I love how simple and lightweight sqlite is.

I'm looking for an open source queue solution with similar qualities. All I really want are topics/messages/publishers/subscribers. That's it.

I do not want to run ZooKeeper.

illuminant
2 months ago
[-]
https://github.com/yudhasubki/blockqueue

Literally, the sqlite of queues.

reply
deterministic
2 months ago
[-]
SQLite is the SQLite of queues. Simply use a table per queue. And use your choice of SQL to implement the types of queues you want.
reply
withinboredom
2 months ago
[-]
beanstalkd might be what you are looking for. It's ancient but solid af. I know of systems still running today that use it. For something more modern, check out Nats—and if you are using Go, you can embed the server in your executable.
reply
rl1987
2 months ago
[-]
If you need them for IPC within same host then POSIX queues (see https://pubs.opengroup.org/onlinepubs/7908799/xsh/mqueue.h.h...) are a thing.

Redis can be used as simple message queue as well.

reply
ivanr
2 months ago
[-]
Try NATS @ https://nats.io

It's a single binary and can operate as a message bus, persistent queue, KV store, object store, provide services, and so on.

reply
Zambyte
2 months ago
[-]
I really like NATS, but it's worth noting that it's only really "the SQLite of queues" in the context of their Go client, which can embed a NATS server into an application.

Otherwise I would really say it is more like the Postgres of queues (still great, but potentially not what OP is looking for)

reply
ttymck
2 months ago
[-]
reply
enjoyyourlife
2 months ago
[-]
RabbitMQ
reply
caprock
2 months ago
[-]
reply
ttymck
2 months ago
[-]
Notably not a persistent queue, correct?
reply
yamumsahoe
2 months ago
[-]
this is redis for me.
reply
toast0
2 months ago
[-]
/var/queue/
reply
brudgers
2 months ago
[-]
Serious engineering question:

Will SQLite work for your application?

I’m sure there are better solutions on paper and for performance under common workloads. But if SQLite is good enough for your use case, it’s good enough for your use case.

It probably isnt. Good luck.

reply
turtle_heck
2 months ago
[-]
Was wondering this for OP as well, I've used a database as a queue for small projects in the past and it was fine.
reply