Storm + Kafka is a very effective log processing solution. A number of users of Storm use this combination, including us at Twitter in a few instances. Kafka gives you a high throughput, reliable way to persist/replay log messages, and Storm gives you the
ability to process those messages in arbitrarily complex ways.
<a href="http://www.drdobbs.com/open-source/easy-real-time-big-data-analysis-using-s/240143874">http://www.drdobbs.com/open-source/easy-real-time-big-data-analysis-using-s/240143874</a>
<a href="http://bigdataprocessing.wordpress.com/2013/01/04/storm-a-real-time-log-processing-framework-real-time-hadoop/">http://bigdataprocessing.wordpress.com/2013/01/04/storm-a-real-time-log-processing-framework-real-time-hadoop/</a>