In the last two posts on reactmq, I described how to write a reactive, persistent message queue. The queue has the following characteristics: there is a single broker storing the … Continue Reading →
Category Archives: Distributed
Evaluating persistent, replicated message queues (updated w/ Kafka)
An updated and extended version of this post is available on SoftwareMill’s website. Below you can find the original content containing benchmarks from 2014. Update 17/07/2014: added Kafka benchmarks Update … Continue Reading →
Benchmarking SQS
SQS, Simple Message Queue, is a message-queue-as-a-service offering from Amazon Web Services. It supports only a handful of messaging operations, far from the complexity of e.g. AMQP, but thanks to … Continue Reading →
Cluster-wide Java/Scala application deployments with Docker, Chef and Amazon OpsWorks
Docker is great for running isolated containers on a single node. However, most software systems run on multiple nodes, so in addition to Docker, we need some way of specifying … Continue Reading →
Reactive Queue with Akka Reactive Streams
Update 15/09/2014: introduced API changes from akka-streams 0.7.Update 30/10/2014: introduced API changes from akka-streams 0.9.Update 15/12/2014: introduced API changes from akka-streams 1.0-M1. Reactive streams is a recently announced initiative to … Continue Reading →
Big data: when single node is better than clustered
There’s a lot of hype about “big data” and a general trend to try to apply Hadoop to almost every problem. However, sometimes it turns out that you can get … Continue Reading →
Using Amazon’s Elastic Map Reduce to compute recommendations with Apache Mahout 0.8
Apache Mahout is a “scalable machine learning library” which, among others, contains implementations of various single-node and distributed recommendation algorithms. In my last blog post I described how to implement … Continue Reading →
Akka vs Storm
I was recently working a bit with Twitter’s Storm, and it got me wondering, how does it compare to another high-performance, concurrent-data-processing framework, Akka. What’s Akka and Storm? Let’s start … Continue Reading →
Event streaming with MongoDB
MongoDB is a really great “NoSQL” database, with a very wide range of applications. In one project that we are developing at SoftwareMill, we used it as a replicated event … Continue Reading →
Unexpected problems with Apache and mod_rewrite under high load
In one of the projects that we are currently working on we have a fairly typical setup with one server (Apache with mod_rewrite) proxying traffic to backend servers. We also … Continue Reading →