Project 2

Project Description

This project has an individual component and one in teams of 2-3persons.

For this project, you will design, implement, and thoroughly test the runtime system for Google MapReduce.

The project would be done a part in the class workshops and a part outside of the class.

Grading

Your project grade will be based on the quality of your report, on the usefulness of the system you’ve built, on the extent to which your design is a good fit for the problem you’re solving, and the quality of the code submitted.

Specification

This project consists of the next modules:

  • Homework – Individual
  • Applications on top of MapReduce
  • MapReduce Distributed Files System on top of Azure Services
  • MapReduce Master
  • Communication Patterns
  • Worker Creation
  • Map Reduce Workers
  • Completed MapReduce Runtime

Libraries and tools that may be handy

Azure HDInsight, Azure Blob storage, ZMQ, Hadoop MapReduce, ssh, wget, scp, Google Protobuf

Week by Week

References

Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s