subject
Mathematics, 14.10.2020 01:01 CSelmon23

It is well-known that ridge regression tends to give similar coefficient values to correlated variables, whereas lasso may give quite different coefficient values to correlated variables. We will now explore this property in a very simple setting. Assume n are the number of training samples, p the number of dimensions, x in the input and y the output. Suppose that n = 2, p = 2, x11 = x12, and x21 = x22. Furthermore, suppose that y1 + y2 = 0 and x11 + x21 = 0 and x12 + x22 = 0, so that the estimate for the intercept in a least squares, ridge regression, or lasso model is zero: βˆ 0 = 0. (a) Write out the ridge regression optimization problem in this setting. (b) Argue that in this setting, the ridge coefficient estimates satisfy βˆ 1 = βˆ 2. (c) Write out the lasso optimization problem in this setting. (d) Argue that in this setting, the lasso coefficients βˆ 1 and βˆ 2 are not unique – in other words, there are many possible solutions to the optimization problem. Describe these solutions

ansver
Answers: 2

Another question on Mathematics

question
Mathematics, 21.06.2019 15:30
Determine whether the set of whole numbers is closed under addition. explain why the set is or is not closed. give an example.
Answers: 1
question
Mathematics, 21.06.2019 19:00
45% of the trees in a park are apple trees. there are 27 apple trees in the park. how many trees are in the park in all?
Answers: 1
question
Mathematics, 21.06.2019 19:00
The probability that you roll a two on a six-sided die is 1 6 16 . if you roll the die 60 times, how many twos can you expect to roll
Answers: 1
question
Mathematics, 21.06.2019 19:30
Which inequalities can be used to find the solution set of the following inequality? check all that apply. |2x – 5| (2x – 5) (2x + 5) –(2x – 5) –(2x + 5)
Answers: 1
You know the right answer?
It is well-known that ridge regression tends to give similar coefficient values to correlated variab...
Questions
question
Mathematics, 17.11.2020 20:50
question
Mathematics, 17.11.2020 20:50
question
Mathematics, 17.11.2020 20:50
Questions on the website: 13722361