Top AWS Services A Data Engineer Should Know

Woah woah
I know nothing about AWS
Then why the heck did i totally totally understand this video
It was crystal clear
I usually don't subscribe to channel but this time it was not even a question 👍🏾
Man I wish you could teach me all about data engineer

Thank you so much for this video! I have an interview tomorrow and this boosted my understanding and confidence. Great explanations!

can you do entire project for this?

Hands down the number 1 video for beginner Data Engineers

Thanks for creating this video. You explained the concepts very clearly.

Great Video..!! AWS App flow is missing........... Thank you

Great video I working as AWS data engineer from past two years overall experience is 11 years.
Could you recommend what certification I have to do as data engineer confused as different types of AWS certification exists

You sir, are the main man. Thank you.

I have one doubt. Can we host multiple kafka producers in one ec2 instance?

Great video. Something to add here: S3 Select can be used for quick and adhoc querying dealing with single S3 file. Athena can also work directly with S3 files if you just need some quick data understanding and investigation. EMR Serverless can address the headache for managing EMR cluster and in the meantime gives your more power for ML.

Is there a pdf file to print out the diagrams

I'm currently working on my AWS certification and will be referencing the diagram from this video often. Thanks for the clear and concise walk through of the context of each of these services!

Very informative, thanks!

Can you do the same but for Azure services?

Hi, Great video. Can you give suggestions on how to start learning these services?

Great overview and I think your method of slowly explaining the diagram section by section is brilliant! A follow up video of a real use case would be even better. Subbed!

What's the alternative to load data from curated zone to Redshit and Athena. Lambda + Glue or it isn't necessary?

I'm preparing for an data engineer interview. The company is looking for someone good at creating pipelines in aws. I'm going to use your videos. I read so many different definition for "ingestion". Ingestion comes right after extraction in the ETL process, right.

Very well done! Don't forget the importance of data lineage though. Big time clients always want the capability to visually track data lineage.

Wowww excellent video. Thank you very much. Is there any course that you could recommend to learn these specific tools?

i had watched so many other videos on same topic..this is the one i was looking for even though i didn't know what exactly i was looking for as everything was new

Thank you for the great video.
I have one question. Wouldn't it be very costly to use all of the AWS services? I store lots of data in S3 and it costs $100-150 a month.

He’s a real pro with pro-cessing

One of the best AWS explanation I saw so far

Millions or billions...

It works! Thanks a lot.

Great video! 2 questions:
1) Any reason you didn’t mention DMS?
2) What services help you out with database changes (deltas)?

Channel name checks out

Interesting! Great job but the author di not speak on Security. I think we need security too.

great introduction to these services. is there a specific data integration service to get data from salesforce (cRM) source?

I am glad I found this video. Brilliant overview. cheers !!

Such a great video! Summarized basic AWS services for data engineering very nicely! One of the best! Thanks!

Use AWS Batch to Batch Data Ingestion

simply well articulated

Bruh, thank you SO MUCH!

aws is a not a career but just a cloud platform right? where we can put our skills and start working in cloud based environment right or not? pls clear me out that if i just directly with a non tech or no data anylytics background persue data analytics certification of aws but prepare through the learning material provided by aws and also hands on practice would i get the job easily? or i need to specialize all the 200 services? and also other python etc pls guide pls not getting answer to this anywhere

Subscribed

Hi there, thanks for such a wonderful explanation of a complex topic. Can you share the diagram picture through a link please?

Great video!

Hi, What Services should I use if I have a source which sends CSV files and the schema changes every week? The column names are different and new columns were added each time. Ideally need to expose the data from these files into tables. Any suggestions as to which services should I use?

Precise. Brilliant!

It is so far the most helpful video I saw about aws services for DE. I hope there are more likewise. Thanks a lot for sharing!

Great video!! Thanks for sharing, it really help me to better understand AWS tools

Love your clarity on the topic. Subscribed! Can't wait to explore all your videos👀

thanks for this. do you have a course on Udemy on Data Engineering?

I found this video very useful as a learner. Thank you!

You are awesome

This was perfect! Exactly what I was looking for lol.

If we clean the data after loading it into S3, this would be ELT right?

Thanks for sharing