MATH 6610 Lecture 14 October 5, 2020 Trefethen & Bau ...
Transcript of MATH 6610 Lecture 14 October 5, 2020 Trefethen & Bau ...
![Page 1: MATH 6610 Lecture 14 October 5, 2020 Trefethen & Bau ...](https://reader031.fdocuments.in/reader031/viewer/2022012205/61de8ffa5d054a02d13653a3/html5/thumbnails/1.jpg)
L14-S00
Least-squares problems
MATH 6610 Lecture 14
October 5, 2020
Trefethen & Bau: Lecture 11
MATH 6610-001 – U. Utah LS problems
![Page 2: MATH 6610 Lecture 14 October 5, 2020 Trefethen & Bau ...](https://reader031.fdocuments.in/reader031/viewer/2022012205/61de8ffa5d054a02d13653a3/html5/thumbnails/2.jpg)
L14-S01Least-squares problems
If A P Cmˆn and b P n, we are interested in computing the least-squaressolution to
Ax “ b
This arises in several situations, e.g., data fitting.
MATH 6610-001 – U. Utah LS problems
![Page 3: MATH 6610 Lecture 14 October 5, 2020 Trefethen & Bau ...](https://reader031.fdocuments.in/reader031/viewer/2022012205/61de8ffa5d054a02d13653a3/html5/thumbnails/3.jpg)
![Page 4: MATH 6610 Lecture 14 October 5, 2020 Trefethen & Bau ...](https://reader031.fdocuments.in/reader031/viewer/2022012205/61de8ffa5d054a02d13653a3/html5/thumbnails/4.jpg)
![Page 5: MATH 6610 Lecture 14 October 5, 2020 Trefethen & Bau ...](https://reader031.fdocuments.in/reader031/viewer/2022012205/61de8ffa5d054a02d13653a3/html5/thumbnails/5.jpg)
L14-S02Least-squares solutions
The following is a result we have essentially already proven:
TheoremSuppose A P mˆn has full column rank (n). Then, for any b P n, there isa unique solution x that solves
Ax “ b
in the least-square sense. Furthermore, this solution x is the unique solutionto A˚Ax “ A˚b, and the residual r :“ b ´ Ax is orthogonal to rangepAq.
The system A˚Ax “ A˚b is called the normal equations.
MATH 6610-001 – U. Utah LS problems
![Page 6: MATH 6610 Lecture 14 October 5, 2020 Trefethen & Bau ...](https://reader031.fdocuments.in/reader031/viewer/2022012205/61de8ffa5d054a02d13653a3/html5/thumbnails/6.jpg)
L14-S02Least-squares solutions
The following is a result we have essentially already proven:
TheoremSuppose A P mˆn has full column rank (n). Then, for any b P n, there isa unique solution x that solves
Ax “ b
in the least-square sense. Furthermore, this solution x is the unique solutionto A˚Ax “ A˚b, and the residual r :“ b ´ Ax is orthogonal to rangepAq.
The system A˚Ax “ A˚b is called the normal equations.
MATH 6610-001 – U. Utah LS problems
![Page 7: MATH 6610 Lecture 14 October 5, 2020 Trefethen & Bau ...](https://reader031.fdocuments.in/reader031/viewer/2022012205/61de8ffa5d054a02d13653a3/html5/thumbnails/7.jpg)
![Page 8: MATH 6610 Lecture 14 October 5, 2020 Trefethen & Bau ...](https://reader031.fdocuments.in/reader031/viewer/2022012205/61de8ffa5d054a02d13653a3/html5/thumbnails/8.jpg)
![Page 9: MATH 6610 Lecture 14 October 5, 2020 Trefethen & Bau ...](https://reader031.fdocuments.in/reader031/viewer/2022012205/61de8ffa5d054a02d13653a3/html5/thumbnails/9.jpg)
![Page 10: MATH 6610 Lecture 14 October 5, 2020 Trefethen & Bau ...](https://reader031.fdocuments.in/reader031/viewer/2022012205/61de8ffa5d054a02d13653a3/html5/thumbnails/10.jpg)
L14-S03Computational solutions
While the normal equations are typically useful for analysis, they are typicallynot used for computation.
A “ QR ùñ x “ R´1Q˚b.
In most cases, the QR decomposition is used, largely for stability reasons.
MATH 6610-001 – U. Utah LS problems
![Page 11: MATH 6610 Lecture 14 October 5, 2020 Trefethen & Bau ...](https://reader031.fdocuments.in/reader031/viewer/2022012205/61de8ffa5d054a02d13653a3/html5/thumbnails/11.jpg)