Saturday, July 18, 2009

Hadoop is getting bigger!

This July has been a Hadoop / Map Reduce month till now..

• Hadoop Core is renamed Hadoop Common.
With the growth of Haddop and addition of specialized sub-projects, hadoop core no longer was the core of haddop rather just the common libraries of hadoop and hadoop abstraction projects.

• MapReduce and the Hadoop Distributed File System (HDFS) are now separate subprojects.

• Avro and Chukwa are new Hadoop subprojects
MapReduce programming model and Hadoop filesystem seems to take more buzz in the world and more related projects are getting released. The latest sub project releases on Apache were Avro and Chukwa

Avro is optimized cross-language data serialzation system for RPC and persistent storage. Its backed by a schema defined in JSON. The first release supports APIs in Java, C and Python.

Chukwa is data collection system for managing large distributed systems

No comments:

Post a Comment