SVD Visualized, Singular Value Decomposition explained | SEE Matrix , Chapter 3 #SoME2

SVD Visualized, Singular Value Decomposition explained | SEE Matrix , Chapter 3 #SoME2

Visual Kernel

2 года назад

160,723 Просмотров

A video explains Singular Value Decomposition, and visualize the linear transformation in action.

Chapters:
0:00 SVD Intro
1:17 Visualize a Rectangular Matrix ?
5:16 Creating Symmetric Matrix
7:17 Singular Vectors and Singular Values
8:55 SVD Formula Dissection
10:05 The Visualization
12:54 Is this SVD ?
15:16 The Next Journey


Video Sins:
1. Regarding the eigenvectors of symmetric, it is correct to say the eigen vectors are orthogonal if the matrix is full rank. However, the formal definition is there always exist a orthornormal basis which contains the eigen vectors of the symmetric matrix, for details refer to https://www.youtube.com/watch?v=UCc9q_cAhho&t=812s, where professor Strang explains the case with eigen vectors with eigen value of 0.
2. When S_L or S_R right has eigen values of multiplicity more than 1, there is an entire subspace of them, therefore, we need to put an orthonormal basis of the subspace to sure all the eigen vectors are perpendicular. Of course, this is already getting more involved with the details with the derivation of the SVD formula in the first place, I think I will leave this to the expert: https://www.youtube.com/watch?v=rYz83XPxiZo&list=RDCMUCEBb1b_L6zDS3xTUrIALZOw

This video wouldn’t be possible without the inspiration of the legendary 3b1b :
https://www.youtube.com/c/3blue1brown

and the animation software - Manim, which he wrote:
https://www.youtube.com/c/3blue1brown

and the Manim Community:
https://docs.manim.community/en/stabl...

Music Credit:
1. Lord of the ring lofi by Sam Cisco: https://www.youtube.com/watch?v=AfIvjUYbie4
2. "First Layer" ost from an anime called Made In Abyss
3. "My War" lofi from AOT, music made by Kijugo https://www.youtube.com/watch?v=oCXIEfHR1Qk
Ссылки и html тэги не поддерживаются


Комментарии:

Dill Du
Dill Du - 23.09.2023 20:31

Thank you sooo much for making these videos. They inspire me a lot!

Ответить
Soumyajit Ganguly
Soumyajit Ganguly - 22.09.2023 11:21

still waiting for PCA and Fourier Transform videos

Ответить
xin han
xin han - 21.09.2023 12:04

VERY NICE bro come back and upload new video!!!

Ответить
Dr. Glitch
Dr. Glitch - 19.09.2023 05:38

PCA. Make a video.

Ответить
K Laotische
K Laotische - 15.09.2023 19:18

This is an extraordinary video; however, i have two important questions.

Firstly,
In spectral decomposition, we know that Q's columns are matrix A's eigenvectors. Here, it is A'A and AA' 's eigenvectors. What's the intuition for such operation?

Secondly,
In spectral decomposition, it can only be done with symmetric matrices, so if it's not symmetric, should we just do SVD to the square matrices to get it's decomposition?
And is spectral decomposition a subset of SVD?

Ответить
Vinam Arora
Vinam Arora - 13.09.2023 18:34

This is so good!

Ответить
MYSTERIOUS CREATURE
MYSTERIOUS CREATURE - 07.09.2023 20:29

I need u to make hard topics easy for us.....pls make more videos😢❤

Ответить
Marcelo Granja
Marcelo Granja - 06.09.2023 07:01

After 10 years of struggle I can finally understand SVD. Congratulations Sir!

Ответить
Wiktor M
Wiktor M - 30.08.2023 08:32

Thank you for your effort, even I understood this now! 😆

Ответить
Wiktor M
Wiktor M - 30.08.2023 08:31

No PCA video?.. Any other good source to recommend?

Ответить
Nick Fruneaux
Nick Fruneaux - 29.08.2023 21:53

So good!!!

Ответить
cs02421
cs02421 - 28.08.2023 08:33

I am gonna remember these concepts for the rest of my life - all because your videos provided an intuitive insight which cannot be any simpler. Hats off! SVD always scared me, but far less now. :)

Ответить
Sayak Dhar
Sayak Dhar - 26.08.2023 16:51

Amazing

Ответить
The unknown scientist
The unknown scientist - 24.08.2023 14:30

For a student who studies more general objects then matrices, such as operators, this playlist is amazing. I come from reading 7 chapters from the book "Linear Algebra Done Right". And chapter 7 in itself is an ending of Linear Algebra, but never truly entails the intuition behind hermitian and normal operators. This playlist did the job for me. Great piece of art I'd say, and I'd love to put my hands on those animation apps that do the transformations, can't really find something good on the internet.

P.S: the Made in Abyss soundtrack really fit here, considering matrices are as misterious as an abyss itself. The more you delve into them, the more you're amazed by certain creatures and the levels of complexity to them. Just to see that only some are truly fundamental.

Ответить
Rohit Kamble
Rohit Kamble - 22.08.2023 21:25

Waiting for PCA

Ответить
Metanick
Metanick - 21.08.2023 19:52

Great analysis

Ответить
Marco
Marco - 20.08.2023 23:37

Had SVD in controlsystems, and this video made me understand it so much deeper, thanks 👍

Ответить
Pratyansh Vaibhav
Pratyansh Vaibhav - 19.08.2023 22:23

did not expect such an amazing explanation bro!!

Ответить
Tomi
Tomi - 19.08.2023 19:19

Thank you!
Why rotate twice?

Ответить
B S
B S - 17.08.2023 11:04

To me the jump from Spectral Decomposition to SVD needs some more insight. Why did we see SVD of a matrix A in terms of the spectral decomposition of the A(A^T) matrix? I think setting A to be equal to S_L, S_R and the dimension erases matrix is not properly explained. One should be able to start with a symetric matrix A(A^T) and them arrive at the SVD of A to show the equivalence. So, I think the video needs some more tinkering.

Ответить
rishabh gupta
rishabh gupta - 13.08.2023 23:47

Man, this interpretation is divine level stuff. You are so good! Please make more such videos

Ответить
Peleg Bar Sapir
Peleg Bar Sapir - 08.08.2023 01:32

Superb

Ответить
Mihailo Bush
Mihailo Bush - 04.08.2023 11:58

Ur amazing, thank you

Ответить
Raisha Rafa
Raisha Rafa - 04.08.2023 09:29

this is brilliant but got no time to watch them all ugh exam season

Ответить
FRANK X
FRANK X - 04.08.2023 06:15

Thank you ! I dony know what else to say. Still waiting for that PCA chapter 🎉🎉

Ответить
Teddy Wong
Teddy Wong - 03.08.2023 11:20

This is great. I wish I had videos like this in grad school. Did you ever make the principal component video?

Ответить
Prianshu Bhatia
Prianshu Bhatia - 02.08.2023 09:15

This four part series should be part of every linear algebra curriculum!

Ответить
some-devl
some-devl - 01.08.2023 15:22

Really amazing, take a bow

Ответить
Vishesh Goyal
Vishesh Goyal - 30.07.2023 09:43

please also make a video on PCA

Ответить
Chris Won
Chris Won - 27.07.2023 12:05

Wow. At loss of words.

Ответить
Yehia Moustafa
Yehia Moustafa - 22.07.2023 20:48

These 4 vedios are the best at explaining the matrices and the SVD , thanks a lot for your great effort

Ответить
Jjer
Jjer - 21.07.2023 22:21

❤❤

Ответить
Kenny Bainbridge
Kenny Bainbridge - 17.07.2023 06:22

This video series was fantastic. It does a great job explaining everything that leads up to the SVD. I tremendously look forward to any more videos from you. :)

Ответить
瑋銓 李
瑋銓 李 - 16.07.2023 16:36

I know what it's going on, but dunno what it's going on also

Ответить
heyman
heyman - 15.07.2023 18:16

What a masterpiece!

Ответить
Nikita
Nikita - 14.07.2023 23:46

This video saved so much time, very well done! But i wasn´t expecting the crossover between Math and Aot.

Ответить
Idan Philosoph
Idan Philosoph - 14.07.2023 21:53

the subtle anime music in the background though XD

Ответить
guywac
guywac - 06.07.2023 20:56

These videos are excellent. Very rare to see an explanation that reveals the intuitive and REAL meaning of these processes and not just a bunch of equations. The most important thing is to understand what concept.

Ответить
Khang Nguyen
Khang Nguyen - 06.07.2023 15:33

Thanks for another point of view in SVD my friend! I'm really appreciated.

Ответить
Medaphysics Repository
Medaphysics Repository - 05.07.2023 01:35

this was amazing, great job!

Ответить
Saleemun
Saleemun - 01.07.2023 11:01

This is by far the most brilliant and entertaining videos for understanding linear algebra. You've done a very great job man! Thank you so much.

Ответить
Shivam Sahni
Shivam Sahni - 27.06.2023 20:19

I was listening to AOT ost a couple of days before I watched this. In the middle of the video I realized I am humming to AOT tunes which was unusual. It took me some time to realize that you had a background score and I was just humming to that.
Btw really liked the explanation.

Ответить
razzlejazzles
razzlejazzles - 24.06.2023 22:24

Thank You so much for this video <3

Ответить
clrs
clrs - 22.06.2023 04:36

top notch 💯

Ответить
zilong Huang
zilong Huang - 21.06.2023 19:28

Come from another platform bilibili after watching a Chinese translated version. I have to say that this serie of video could be the best linear algebra visual interpretation. Thanks for delivering contents of such high quality.❤❤❤

Ответить
Yuanpu Li
Yuanpu Li - 20.06.2023 06:13

You are an amazing teacher making everything so easy to understand.

Ответить