Write a function that removes objects from the dataset, if they have more than 50% of missing values.

Computer Networking: A Top-Down Approach (7th Edition)
7th Edition
ISBN:9780133594140
Author:James Kurose, Keith Ross
Publisher:James Kurose, Keith Ross
Chapter1: Computer Networks And The Internet
Section: Chapter Questions
Problem R1RQ: What is the difference between a host and an end system? List several different types of end...
icon
Related questions
Question
100%

def drop_uninformative_objects(X, y):
# your code here

return X_subset, y_subset

 

 

# TEST drop_uninformative_objects function
A = pd.DataFrame(np.array([
[0, 3, np.nan],
[4, np.nan, np.nan],
[np.nan, 6, 7],
[np.nan, np.nan, np.nan],
[5, 5, 5],
[np.nan, 8, np.nan],
]))
b = pd.Series(np.arange(6))
A_subset, b_subset = drop_uninformative_objects(A, b)

assert A_subset.shape == (3, 3)
assert b_subset.shape == (3,)

Write a function that removes objects from the dataset, if they have more than 50% of missing values.
• Use pandas isnull() method to find missing (NaN) values. See example above.
• Compute number of missing values in each row. Use argument axis to specify the dimention of summation.
• From both the object matrix X and the target variable y, select a subset of rows with at most 50% of missing values.
• See this pandas tutorial if you struggle to implement this task.
Transcribed Image Text:Write a function that removes objects from the dataset, if they have more than 50% of missing values. • Use pandas isnull() method to find missing (NaN) values. See example above. • Compute number of missing values in each row. Use argument axis to specify the dimention of summation. • From both the object matrix X and the target variable y, select a subset of rows with at most 50% of missing values. • See this pandas tutorial if you struggle to implement this task.
Expert Solution
trending now

Trending now

This is a popular solution!

steps

Step by step

Solved in 2 steps

Blurred answer
Recommended textbooks for you
Computer Networking: A Top-Down Approach (7th Edi…
Computer Networking: A Top-Down Approach (7th Edi…
Computer Engineering
ISBN:
9780133594140
Author:
James Kurose, Keith Ross
Publisher:
PEARSON
Computer Organization and Design MIPS Edition, Fi…
Computer Organization and Design MIPS Edition, Fi…
Computer Engineering
ISBN:
9780124077263
Author:
David A. Patterson, John L. Hennessy
Publisher:
Elsevier Science
Network+ Guide to Networks (MindTap Course List)
Network+ Guide to Networks (MindTap Course List)
Computer Engineering
ISBN:
9781337569330
Author:
Jill West, Tamara Dean, Jean Andrews
Publisher:
Cengage Learning
Concepts of Database Management
Concepts of Database Management
Computer Engineering
ISBN:
9781337093422
Author:
Joy L. Starks, Philip J. Pratt, Mary Z. Last
Publisher:
Cengage Learning
Prelude to Programming
Prelude to Programming
Computer Engineering
ISBN:
9780133750423
Author:
VENIT, Stewart
Publisher:
Pearson Education
Sc Business Data Communications and Networking, T…
Sc Business Data Communications and Networking, T…
Computer Engineering
ISBN:
9781119368830
Author:
FITZGERALD
Publisher:
WILEY