Open Sourcing Vespa, Yahoo’s Big Data Processing and Serving Engine

Oath, parent company of Yahoo, has announcedthat it has released Vespa as an open sourceproject on GitHub."Building applications increasingly means dealing with huge amounts of data. While developers can use the the Hadoop stack to store and batch process big data, and Storm to stream-process data, these technologies do not help with serving results to end users. Serving is challenging at large scale, especially when it is necessary to make computations quickly over data while a user is waiting, as with applications that feature search, recommendation, and personalization.By releasing Vespa, we are making it easy for anyone to build applicationsthat can compute responses to user requests, over large datasets, at realtime and at internet scale - capabilities that up until now, have beenwithin reach of only a few large companies." (Thanks to Paul Wise)