cs553-hw4

pdf

School

Illinois Institute Of Technology *

*We aren’t endorsed by this school

Course

553

Subject

Computer Science

Date

Dec 6, 2023

Type

pdf

Pages

Uploaded by SargentFreedomCapybara39

CS553 Homework #4 Instructions: ● Assigned date: Wednesday November 8th, 2023 ● Due date: 11:59 PM on Monday November 20th, 2023 ● Maximum Points: 100%. ● This is an individual assignment. ● Upload your assignment on the Blackboard with the following name: Section_LastName1_FirstName1-HW4.pdf ● Direct copying from AI tools like Chat-GPT will be penalized. ● Late submission will be penalized at 10% per day. 1.Your Assignment 1. (10 points) What is MapReduce and what are its characteristics? List its advantages and disadvantages. Compare it with MPI-based approaches to parallelize a certain task. 2. (20 points) Provide pseudocode for sorting integers in an out-of-core fashion (i.e., integers cannot fit in memory) both in MapReduce (both mapper and reducer code) and in MPI. Think about the flow of sorting: reading the input, perform the sorting algorithm, merge all intermediate results, write the final sorted output. 3. (20 points) How does data distribution work in HDFS? Who is responsible for distributing data? What would you optimize in the distribution policies to make the system faster and more reliable? 4. (10 points) What are some key features of Apache Flink that make it suitable for stream computing? 5. (12 points) How does Apache Flink handle out-of-order events and late data in stream processing? 6. (12 points) How do message queues enable reliable communication between processes, and what are some best practices for their use? 7. (6 points) What is the role of distributed queues in distributed systems, and how do they support reliable message delivery? 8. (10 points) What are the core tools and frameworks for making AI models, and how do they differ in their approaches and popularity?

2. What will you submit? When you have finished your written responses, you should hand in: 1. Report: A written document (typed, pdf format) describing your answers to the above questions. Include all students’ names and A numbers. Only one submission per group is needed. Submit the report through Blackboard. Grades for late programs will be lowered 10% per day late. 3. Where you will submit? When you have finished implementing the complete assignment as described above, you should submit your solution to the blackboard. The timestamp on the BB submission will be used to determine if the submission is on time. Please put your homework content into one .pdf file and upload it to the blackboard. The PDF file should include all students’ names and A numbers. The name of your file should follow this format: Section_LastName1_FirstName1-HW4.pdf

Your preview ends here

Eager to read complete document? Join bartleby learn and gain access to the full version

Access to all documents
Unlimited textbook solutions
24/7 expert homework help

Related Documents

written3_solution(1).pdf

Python Week 2(1).pdf

documentation.pdf

CS484_IML_Assignment_5.docx

F23 PA4.docx

PA5.pdf

Prob Stat task 2.docx

Recommended textbooks for you

Microsoft Visual C#

Computer Science

ISBN:9781337102100

Author:Joyce, Farrell.

Publisher:Cengage Learning,

COMPREHENSIVE MICROSOFT OFFICE 365 EXCE

Computer Science

ISBN:9780357392676

Author:FREUND, Steven

Publisher:CENGAGE L

EBK JAVA PROGRAMMING

Computer Science

ISBN:9781337671385

Author:FARRELL

Publisher:CENGAGE LEARNING - CONSIGNMENT

New Perspectives on HTML5, CSS3, and JavaScript

Computer Science

ISBN:9781305503922

Author:Patrick M. Carey

Publisher:Cengage Learning

Np Ms Office 365/Excel 2016 I Ntermed

Computer Science

ISBN:9781337508841

Author:Carey

Publisher:Cengage

Microsoft Windows 10 Comprehensive 2019

Computer Science

ISBN:9780357392607

Author:FREUND

Publisher:Cengage

SEE MORE TEXTBOOKS

Recommended textbooks for you

Microsoft Visual C#
Computer Science
ISBN:9781337102100
Author:Joyce, Farrell.
Publisher:Cengage Learning,
COMPREHENSIVE MICROSOFT OFFICE 365 EXCE
Computer Science
ISBN:9780357392676
Author:FREUND, Steven
Publisher:CENGAGE L
EBK JAVA PROGRAMMING
Computer Science
ISBN:9781337671385
Author:FARRELL
Publisher:CENGAGE LEARNING - CONSIGNMENT
New Perspectives on HTML5, CSS3, and JavaScript
Computer Science
ISBN:9781305503922
Author:Patrick M. Carey
Publisher:Cengage Learning
Np Ms Office 365/Excel 2016 I Ntermed
Computer Science
ISBN:9781337508841
Author:Carey
Publisher:Cengage
Microsoft Windows 10 Comprehensive 2019
Computer Science
ISBN:9780357392607
Author:FREUND
Publisher:Cengage