Datastax acquires Kesque as it gets into data streaming

Datastax, the company best known for commercializing the open-source Apache Cassandra database, is moving beyond databases. As the company announced today, it has acquired Kesque, a cloud messaging service.

The Kesque team built its service on top of the Apache Pulsar messaging and streaming project. Datastax has now taken that team's knowledge in this area and, combined with its own expertise, is launching its own Pulsar-based streaming platform by the name of Datastax Luna Streaming, which is now generally available.

This move comes right as Datastax is also now, for the first time, announcing that it is cash-flow positive and profitable, as the company's chief product officer, Ed Anuff, told me. We are at over $150 million in [annual recurring revenue]. We are cash-flow positive and we are profitable," he told me. This marks the first time the company is publically announcing this data. In addition, the company also today revealed that about 20 percent of its annual contract value is now for DataStax Astra, its managed multi-cloud Cassandra service and that the number of self-service Asta subscribers has more than doubled from Q3 to Q4.

The launch of Luna Streaming now gives the 10-year-old company a new area to expand into - and one that has some obvious adjacencies with its existing product portfolio.

We looked at how a lot of developers are building on top of Cassandra," Anuff, who joined Datastax after leaving Google Cloud last year, said. What they're doing is, they're addressing what people call data-in-motion' use cases. They have huge amounts of data that are coming in, huge amounts of data that are going out - and they're typically looking at doing something with streaming in conjunction with that. As we've gone in and asked, What's next for Datastax?,' streaming is going to be a big part of that."

Given Datastax's open-source roots, it's no surprise the team decided to build its service on another open-source project and acquire an open-source company to help it do so. Anuff noted that while there has been a lot of hype around streaming and Apache Kafka, a cloud-native solution like Pulsar seemed like the better solution for the company. Pulsar was originally developed at Yahoo! (which, full disclosure, belongs to the same Verizon Media Group family as TechCrunch) and even before acquiring Kesque, Datastax already used Pulsar to build its Astra platform. Other Pulsar users include Yahoo, Tencent, Nutanix and Splunk.

What we saw was that when you go and look at doing streaming in a scale-out way, that Kafka isn't the only approach. We looked at it, and we liked the Pulsar architecture, we like what's going on, we like the community - and remember, we're a company that grew up in the Apache open-source community - we said, okay, we think that it's got all the right underpinnings, let's go and get involved in that," Anuff said. And in the process of doing so, the team came across Kesque founder Chris Bartholomew and eventually decided to acquire his company.

The new Luna Streaming offering will be what Datastax calls a subscription to success with Apache Pulsar.' It will include a free, production-ready distribution of Pulsar and an optional, SLA-backed subscription tier with enterprise support.

Unsurprisingly, Datastax also plans to remain active in the Pulsar community. The team is already making code contributions, but Anuff also stressed that Datastax is helping out with scalability testing. This is one of the things that we learned in our participation in the Apache Cassandra project," Anuff said. A lot of what these projects need is folks coming in doing testing, helping with deployments, supporting users. Our goal is to be a great participant in the community."