Q2 Solving MDPs 6 Points Consider the gridworld MDP for which \text{Left}Left and \text{Right}Right actions are 100% successful. Specifically, the available actions in each state are to move to the neighboring grid squares. From state aa, there is also an exit action available, which results in going to the terminal state and collecting a reward of 10. Similarly, in state ee, the reward for the exit action is 1. Exit actions are successful 100% of the time.

An external consultant recommends that a plant installs a bank of capacitors for power factor correction. this will reduce the peak electrical demand charges by an average of 93 kw every month. the plant current pays $13 per kw in peak demand charges. the capacitor bank will include 223 kw of fixed capacitors, and 183 of variable capacitors. the fixed capacitors cost $59 per kw, and the variable capacitors will cost $65 per kw. the consultant charges 21% of the equipment costs to install the capacitors. because this project will reduce the demand for the electric utility, they are prepared to provide a one-time rebate of $42 per kw of reduced demand. what is the simple payback period for this project (in years)?