Answered step by step
Verified Expert Solution
Link Copied!

Question

1 Approved Answer

Consider the more general version of theminimum - normproblem, also referred to as thelinearly constrainedleast squaresproblem ( or just constrained least squares problem ) minimize

Consider the more general version of theminimum-normproblem, also referred to as thelinearly constrainedleast squaresproblem (or just constrained least squares problem)minimize\| Axb\|2subject toCx=dHerex, the variable to be found, is ann-vector. The problem data (which are given) are them\times nmatrixA,them-vectorb, thep\times nmatrixC, and thep-vectord, andCx=drepresentplinear equality constraints.(a) Derive the optimality conditions using Lagrange multipliers and write them in a matrix vector form.(b) Show that the optimal point is a unique minimum (See section 16.2 in Boyds book)(c) Generate a random 20\times 10 matrixAand a random 5\times 10 matrixC. Then generate random vectorsbanddof appropriate dimensions for the constrained least squares problem and compute the solutionxby form and solvingKKTequations usingQRfactorization, using Matlab or Python.(d) Use Matlabsfmincon()or Pythonsscipy.optimize.minimize()to verify your solution. See thedocumentation on how to use these functions.(e)(Approximate Solutions using Penalty Method) Form a new augmented objective function\| Axb\|2+\rho \| Cxd\|2and solve the problem as constrained optimization problem for\rho =1,10,100,1000, everytime using the solution of previous\rho for the next run for the initial guessx0using (i) Gradient Descentalgorithm (ii) Newtons Method. You can use fixed step size or backtracking line search and comparewith the results obtained in the earlier parts. You will need to use some seeding method so the randomnumbers are used for matrices when comparing results, or just pick some fixed numbers for the matrices.The gradients and hessians have to be calculated for the augmented cost function.

Step by Step Solution

There are 3 Steps involved in it

Step: 1

blur-text-image

Get Instant Access with AI-Powered Solutions

See step-by-step solutions with expert insights and AI powered tools for academic success

Step: 2

blur-text-image

Step: 3

blur-text-image

Ace Your Homework with AI

Get the answers you need in no time with our AI-driven, step-by-step assistance

Get Started

Students also viewed these Databases questions