preview

Nt1310 Unit 3 Teamwork

Satisfactory Essays

1 Design 1.1 Known Issues An overt symptom is a poor predictor of the root cause of a failure. Errors show up far from the cause of the problem. Clusters have a lot of components. Example: – Symptom: A Hadoop job that previously was able to run now fails to run – Cause: Disk space on many nodes has filled up, so intermediate data cannot be copied to Reducers. Common Sources of Problems: 1. Misconfiguration 2. Hardware failure 3. Resource exhaustion – Not enough disk – Not enough RAM – Not enough network bandwidth 4. Inability to reach hosts on the network – Naming issues – Network hardware issues – Network delays 6.2 Architectural Bottlenecks [23] 1. Implement a Hadoop configuration which is “rack aware” and configure 2 racks

Get Access