3. Consider a home energy storage (battery) system that can store up to 2 units of energy. At every time step, there is a demand for energy in the home which is drawn from 0, 1, 2 units with equal probability independent of the demands in the previous time steps. At every point in time, you have to satisfy the demand either by discharging the needed energy from the battery or purchasing power from the grid (or a combination of the two). You could also choose to purchase power from the grid to charge your battery. The grid energy price is either H(igh) or L(ow) according to a Markov chain (Price moves from H to L with probability p, and from L to H with probability q). (a) Model the decision making as an infinite horizon MDP where the objective is to minimize the discounted cost of energy purchased over an infinite horizon. (b) Write down a policy 7 of your choosing. Perform two steps of the operator T, for your policy, followed by one step of T,.

ENGR.ECONOMIC ANALYSIS
14th Edition
ISBN:9780190931919
Author:NEWNAN
Publisher:NEWNAN
Chapter1: Making Economics Decisions
Section: Chapter Questions
Problem 1QTC
icon
Related questions
Question
3. Consider a home energy storage (battery) system that can store up to 2 units of energy. At every time step, there
is a demand for energy in the home which is drawn from 0,1,2 units with equal probability independent of the
demands in the previous time steps. At every point in time, you have to satisfy the demand either by discharging
the needed energy from the battery or purchasing power from the grid (or a combination of the two). You could
also choose to purchase power from the grid to charge your battery. The grid energy price is either H(igh) or L(ow)
according to a Markov chain (Price moves from H to L with probability p, and from L to H with probability q).
(a) Model the decision making as an infinite horizon MDP where the objective is to minimize the discounted cost
of energy purchased over an infinite horizon.
(b) Write down a policy a of your choosing. Perform two steps of the operator T, for your policy, followed by one
step of T..
Transcribed Image Text:3. Consider a home energy storage (battery) system that can store up to 2 units of energy. At every time step, there is a demand for energy in the home which is drawn from 0,1,2 units with equal probability independent of the demands in the previous time steps. At every point in time, you have to satisfy the demand either by discharging the needed energy from the battery or purchasing power from the grid (or a combination of the two). You could also choose to purchase power from the grid to charge your battery. The grid energy price is either H(igh) or L(ow) according to a Markov chain (Price moves from H to L with probability p, and from L to H with probability q). (a) Model the decision making as an infinite horizon MDP where the objective is to minimize the discounted cost of energy purchased over an infinite horizon. (b) Write down a policy a of your choosing. Perform two steps of the operator T, for your policy, followed by one step of T..
Expert Solution
trending now

Trending now

This is a popular solution!

steps

Step by step

Solved in 2 steps with 2 images

Blurred answer
Knowledge Booster
Risk Aversion
Learn more about
Need a deep-dive on the concept behind this application? Look no further. Learn more about this topic, economics and related others by exploring similar questions and additional content below.
Similar questions
  • SEE MORE QUESTIONS
Recommended textbooks for you
ENGR.ECONOMIC ANALYSIS
ENGR.ECONOMIC ANALYSIS
Economics
ISBN:
9780190931919
Author:
NEWNAN
Publisher:
Oxford University Press
Principles of Economics (12th Edition)
Principles of Economics (12th Edition)
Economics
ISBN:
9780134078779
Author:
Karl E. Case, Ray C. Fair, Sharon E. Oster
Publisher:
PEARSON
Engineering Economy (17th Edition)
Engineering Economy (17th Edition)
Economics
ISBN:
9780134870069
Author:
William G. Sullivan, Elin M. Wicks, C. Patrick Koelling
Publisher:
PEARSON
Principles of Economics (MindTap Course List)
Principles of Economics (MindTap Course List)
Economics
ISBN:
9781305585126
Author:
N. Gregory Mankiw
Publisher:
Cengage Learning
Managerial Economics: A Problem Solving Approach
Managerial Economics: A Problem Solving Approach
Economics
ISBN:
9781337106665
Author:
Luke M. Froeb, Brian T. McCann, Michael R. Ward, Mike Shor
Publisher:
Cengage Learning
Managerial Economics & Business Strategy (Mcgraw-…
Managerial Economics & Business Strategy (Mcgraw-…
Economics
ISBN:
9781259290619
Author:
Michael Baye, Jeff Prince
Publisher:
McGraw-Hill Education