Hierarchical database model

Multi-core processor

Linguistics

Scheme (mathematics)

Engineering

Philosophy

Locality

Parallelism (grammar)

Exploit

CUDA

Computer security

Node (physics)

GPU cluster

Operating system

Programming paradigm

Economics

Scalability

Parallel computing

Computer science

Cloud computing

CPU cache

Distributed computing

Database

Task (project management)

Fault tolerance

Mathematics

Management

Cache

Mathematical analysis

Structural engineering

Programming language

In this paper, we argued that Hadoop has limitations in exploiting data locality and task parallelism for multi-core platforms. We then extended Hadoop with a hierarchical MapReduce scheme. An in-memory cache scheme is also seamlessly integrated to cache data that is likely to be accessed in memory. Evaluation showed that the hierarchical scheme outperforms Hadoop ranging from 1.4x to 3.5x.

A Hierarchical Approach to Maximizing MapReduce Efficiency