Some time ago I wrote how to implement a reactive message queue with Akka Streams. The queue supports streaming send and receive operations with back-pressure, but has one downside: all messages are stored in-memory, and hence in case of a restart are lost. But this can be easily solved with…
Category: Mongo
Evaluating persistent, replicated message queues (updated w/ Kafka)
An updated and extended version of this post is available on SoftwareMill’s website. Below you can find the original content containing benchmarks from 2014. Update 17/07/2014: added Kafka benchmarks Update 20/03/2015: updated HornetQ replication description Update 4/05/2015: updated & extended version here Message queues are useful in a number of…
Event streaming with MongoDB
MongoDB is a really great “NoSQL” database, with a very wide range of applications. In one project that we are developing at SoftwareMill, we used it as a replicated event storage, from which we stream the events to other components. Introduction The basic idea is pretty simple (see also Martin…