Module: Batch Layer : Map-Reduce

Learning Outcomes

Understand How to Engineer Batch Processing Systems

You understand

• the requirements of the batch layer in lambda architecture
• how distributed file systems work
• how map-reduce works
• the trade-offs between alternatives
• how to model queries using pipe diagrams
• how to translate pipe diagrams to Map-Reduce jobs.
• how to model queries using JCascalog
• the relationship between queries and batch views

Readings

Experiential Learning