What Is the SQLite of Queues?

Question

I love how simple and lightweight sqlite is.I'm looking for an open source queue solution with similar qualities. All I really want are topics/messages/publishers/subscribers. That's it.I do not want to run ZooKeeper.

illuminant · Accepted Answer

https://github.com/yudhasubki/blockqueueLiterally, the sqlite of queues.

deterministic · Answer

SQLite is the SQLite of queues. Simply use a table per queue. And use your choice of SQL to implement the types of queues you want.

withinboredom · Answer

beanstalkd might be what you are looking for. It's ancient but solid af. I know of systems still running today that use it. For something more modern, check out Nats&mdash;and if you are using Go, you can embed the server in your executable.

rl1987 · Answer

If you need them for IPC within same host then POSIX queues (see https://pubs.opengroup.org/onlinepubs/7908799/xsh/mqueue.h.h...) are a thing.Redis can be used as simple message queue as well.

ivanr · Answer

Try NATS @ https://nats.ioIt's a single binary and can operate as a message bus, persistent queue, KV store, object store, provide services, and so on.

ttymck · Answer

ElasticMQ: https://github.com/softwaremill/elasticmq

enjoyyourlife · Answer

RabbitMQ

caprock · Answer

ZeroMQ - https://zeromq.org/

yamumsahoe · Answer

this is redis for me.

toast0 · Answer

/var/queue/

brudgers · Answer

Serious engineering question:Will SQLite work for your application?I&rsquo;m sure there are better solutions on paper and for performance under common workloads. But if SQLite is good enough for your use case, it&rsquo;s good enough for your use case.It probably isnt. Good luck.

What Is the SQLite of Queues?

I love how simple and lightweight sqlite is.
I'm looking for an open source queue solution with similar qualities. All I really want are topics/messages/publishers/subscribers. That's it.
I do not want to run ZooKeeper.

https://github.com/yudhasubki/blockqueue
Literally, the sqlite of queues.

SQLite is the SQLite of queues. Simply use a table per queue. And use your choice of SQL to implement the types of queues you want.

beanstalkd might be what you are looking for. It's ancient but solid af. I know of systems still running today that use it. For something more modern, check out Nats—and if you are using Go, you can embed the server in your executable.

If you need them for IPC within same host then POSIX queues (see https://pubs.opengroup.org/onlinepubs/7908799/xsh/mqueue.h.h...) are a thing.
Redis can be used as simple message queue as well.

Try NATS @ https://nats.io
It's a single binary and can operate as a message bus, persistent queue, KV store, object store, provide services, and so on.

ElasticMQ: https://github.com/softwaremill/elasticmq

RabbitMQ

ZeroMQ - https://zeromq.org/

this is redis for me.

/var/queue/

Serious engineering question:
Will SQLite work for your application?
I’m sure there are better solutions on paper and for performance under common workloads. But if SQLite is good enough for your use case, it’s good enough for your use case.
It probably isnt. Good luck.