Optimization Problem 6.1

[mvalsania]

Hello everyone,

I just wanted to validate my answer to this question.

My current answer is:

• The approximation error is not affected, as the family of functions remains unaltered.
• The optimization error will remain the same, as it is chosen by the user (although one could argue that if n decreases, you could afford to choose a smaller optimization error).
• The estimation error increases because our generalization error increases. A higher generalization error implies that both Ein and Eout will be further apart from each other, and thus, further from the approximation error.

I would appreciate any feedback or corrections!