cs553-hw4

.pdf

School

Illinois Institute Of Technology *

*We aren’t endorsed by this school

Course

553

Subject

Computer Science

Date

Dec 6, 2023

Type

pdf

Pages

2

Uploaded by SargentFreedomCapybara39

CS553 Homework #4 Instructions: Assigned date: Wednesday November 8th, 2023 Due date: 11:59 PM on Monday November 20th, 2023 Maximum Points: 100%. This is an individual assignment. Upload your assignment on the Blackboard with the following name: Section_LastName1_FirstName1-HW4.pdf Direct copying from AI tools like Chat-GPT will be penalized. Late submission will be penalized at 10% per day. 1.Your Assignment 1. (10 points) What is MapReduce and what are its characteristics? List its advantages and disadvantages. Compare it with MPI-based approaches to parallelize a certain task. 2. (20 points) Provide pseudocode for sorting integers in an out-of-core fashion (i.e., integers cannot fit in memory) both in MapReduce (both mapper and reducer code) and in MPI. Think about the flow of sorting: reading the input, perform the sorting algorithm, merge all intermediate results, write the final sorted output. 3. (20 points) How does data distribution work in HDFS? Who is responsible for distributing data? What would you optimize in the distribution policies to make the system faster and more reliable? 4. (10 points) What are some key features of Apache Flink that make it suitable for stream computing? 5. (12 points) How does Apache Flink handle out-of-order events and late data in stream processing? 6. (12 points) How do message queues enable reliable communication between processes, and what are some best practices for their use? 7. (6 points) What is the role of distributed queues in distributed systems, and how do they support reliable message delivery? 8. (10 points) What are the core tools and frameworks for making AI models, and how do they differ in their approaches and popularity?
2. What will you submit? When you have finished your written responses, you should hand in: 1. Report: A written document (typed, pdf format) describing your answers to the above questions. Include all students’ names and A numbers. Only one submission per group is needed. Submit the report through Blackboard. Grades for late programs will be lowered 10% per day late. 3. Where you will submit? When you have finished implementing the complete assignment as described above, you should submit your solution to the blackboard. The timestamp on the BB submission will be used to determine if the submission is on time. Please put your homework content into one .pdf file and upload it to the blackboard. The PDF file should include all students’ names and A numbers. The name of your file should follow this format: Section_LastName1_FirstName1-HW4.pdf
Your preview ends here
Eager to read complete document? Join bartleby learn and gain access to the full version
  • Access to all documents
  • Unlimited textbook solutions
  • 24/7 expert homework help