Adam Optimization Algorithm (C2W2L08)

It would be easier if you just typed instead of handwrite I can’t read it

-1 no knowledge about why Adam works better then previous algorithms is provided

Hey there I know I am late to the party but I have a pressing question the rest of the internet has failed to answer so far.
I currently have to work with a model and network I didn't design and my job is to basically find out whats wrong so naturally I need to understand the LOC used.
There was a line I havent found any example for: optimizer = keras.optimizers.Adam(0.002, 0.5)
I am still studying so I am not that well versed in Keras or anything AI so far really but I wanna know if this second value refers to the beta_1 or any other value I am not noticing.
The documentation has me puzzled so far so I hope theres someone here who can answer this.

this man is a Legend!!

The very best and most succinct explanation of ADAM I've ever seen. Things become crystal clear if one watches L06 to L08 in a row.

what is t I do not completely understand

First task of significance is for me to figure out how to spell Andrews last name then I move on to the algorithm 🤓

Could anyone give me a list of the notations he mentions in the video or direct me towards a video that has those explained? Main issue with understanding the concept in the video is the lack of explanation of the notations used.

Ow my ears

Only understood his friend has nothing to do with Adam optimization!

what is s and v

great explntion.Meed to watch again

比助教講得好太多了

This video is closely related to the video "Bias Correction of Exponentially Weighted Averages". Please revisit that video if you feel this is too confusing.

Eve Optimization Algorithm will come soon!

Roasting at the end ! Hahaha

You are my god.

any time I want to implement ML from scratch, I watch all Andrew's videos from beginning to end! I don't know how to express my appreciation to this great man.

you really dont think that statement of the problem that ADAM solves is of relevance, when you are introducing ADAM?

You are so sweet. Thank you Sir, for these awesome videos!

This nailed down the Adam paper. Thanks alot

there is roasting in the end

God of lucid explanation <3

i am confuse to the maximum level, can i buy more brain power like i buy more rams?

Haha showing Adam there was hilarious :>

please apply a low pass filter on the audio of this video

SGD vs ADADELTA? If I only had those 2 choices.

Yay

is that you beatthebush?

why do this-> m1 /(1-beta1) , m2/(1-beta2) ? ? this operation zoom it 10 times and 1000 times, reason? bias correction? what does it means?

It would be appreciated if teachers would revisit their videos and replace torturous live digital pen notes with elegant text and diagrams. Chalk on a board is fine, but digital pens are painful to endure.

I don't understand why some people hating, - yes, Proff missed a couple of symbols (once in a lifetime)
The matter of truth - without his or Geoffrey's videos to watch we would be totally fucked ))

Why do we need correction in momentum or rms using T elimination?

shouldnt db at Sdb be squared ?!

what does db mean here? derivative of the bias?

How can we use it for facial recognition