02. Databricks | PySpark: RDD, Dataframe and Dataset

A doubt: As you said, ultimately spark converts dataframes into RDDs while processing. Then how the benefits like avoiding GC-process and others will eventually comes into play while using DFs instead of RDDs? I'm fairly new in this area. And thanks for this playlist.

dataset also has catalyst optimizations, but in slide it is just "optimization"

Hi, could you please activate the subtitles for this and other videos? these are really great sources, i don't wanna miss anything.

Great work. 👍👏👏

RDD is not type safety right? they don't enforce datatype; This means that the type of the data in an RDD can change at runtime. This can lead to errors if the data is not properly checked.

Hi, could you please provide the slides and notebooks, that would be really helpful for a quick revisions before interview

So pyspark uses dataframe and not dataset right?

DataFrames are strong Type safety and RDD are not right. I think you need modify the slide.

Raja Bro could you please provide your email id i need to learn This couse

Hi Raja, could you please fix the order of the playlist? thanks in advance

Dataframes are mutable .

can we have the github link for these PPT and code.

Could you make a repo for all your videos.. Otherwise it is hard to follow you , thanks a lot Raja

Hi Raja, Your videos are very informative and interms of RDD/DataFrame/Dataset if some one which one is faster in execution what would be your answer?

Can you please provide sequence number for your vedioes please

very informative, please come up with end to end projects using databricks

Thanks, very valuable information. Can you provide your email id/mobile number to contact.
Will you provide training on same ?

Super