Olympic Data Analytics | Azure End-To-End Data Engineering Project

incremental loading ja tutorial miljata to mja ajata...

encountered this error " Failed to detect schema
Please review and update the file format settings to allow file schema detection" ....

Quick question. In real-time, will companies use only Synapse analytics alone for data processing and for storage? If yes, during what scenarios they will use, will it not be challenge for testing?

Thanks you!

One question Darshil - Does this project including the Coursera preparation course enough for one to sit for the Azure Data Engineer Certification(Associate)?

Thank you so much!! really well explained

Excelente video!

Really good project! two things to point out. you don't need to calculate the total medals won by each country because the row is unique by country so the data is already in a usable format for this task. 2) your query for average number of entries by gender is not correct. Again, each row is unique by country so the avg() will not work. here is the right code: select
Discipline
,cast(female as float) / total as average_female
,cast(male as float) / total as average_male
from entriesgender .

Thank you very much Darshil Sir. The way you have explained the project is very Awesome. You made the explanation as much simpler to understand us. I loved it.

Sir, I am requesting to do more project videos on Azure technology

can you share how to connect to synapse analytics using serverless SQL pool.

Exactly what i was looking for, thank you so much!

Excellent tutorial, I will definitely get in touch for your other courses

have an issue while publishing the data : InternalServerError executing request:

Good one

Nice tutorial, do you have a similar one for GCP cloud?

The explanation was on point and really good. I liked it.

Your video is very clear and convenient to understand and gain confidence. Thanks a lot.

Excellent!

Synapse analytics does not work for student account

Nice . quick question, after creating databricks and synapse how much cost it would take if we keep in pause state if not using.

Also for databricks, is there any pause options?

Thank you for this Darshil. After ETL if we dont want to do analytics and want to implement some ML library prediction, what would be the best way to achieve that in azure platform ?

Thank you Darshill. It was a very good tutorial on how to work with different tools.

Thank you for this project sir.

Great explanation and this helps me a lot.

In the real world which service will you choose between datafactory, databricks and synapse?

Hi sir
I personally thank you very much for the AWS Data Engineering Project series and we are learning a lot from them. We all are really grateful for this level of your generosity. Our humble request you to create an Azure Data Engineering Project using SQL & SSMS as there is only one project of Azure Data Engineer. We want to learn more about the Azure Data Engineering Project as there is no Azure Data Engineer project using Bronze, Silver & Gold layer transformation in PySpark DataBricks and SSMS respectively.

I hope our request will soon be accepted from your end.


Thank you so much for your valuable guidance & support.

Thanks for sharing, taking the same basis from part 1 of converting the same based on Microsoft Fabric

It's really supportive even for beginners. Great Work done. Love from Pakistan

Thaankkss!!!

but we can only continue visualization part if we have premium or professional BI account

very informative and helpful video... plz make more videos related to azure data engineer with diff diff activities, pipelines.

capo

How do I access the PowerBI when it's only available for business users?

While creating the table I am getting : review and update the file format settings to allow file schema detection in synapse studio

How to solve this?

good work bro

Hello, Darshil I have finally finished this section as well. I sincerely appreciate your efforts. I have a question for you now: will you offer certification upon completion of your course? I emailed you earlier, but I never heard back. I understand that you are very busy, but I really wanted your combo course.

Has anyone managed to succesfully complete the project and if so in how much time?

Briliant tutorial. If we wanted to post this on our git for portfolio reasons, would it not be possible to keep this all active or would there be charges incurred even though we aren't using them?

Very good project for the understanding. Great work Darshil..

Thank you so much. Great work. Please upload more project videos.

Really nice project to learn, Thanks a lot Darshil

thank you

loved the way of teaching

Nice work❤

`YOU ARE THE ONLY BEST TEACHER IN TEACHING DATA ENGINEERING. OTHER TEACHER'S CONTRIBUTION IS ALWAYS REMAINED CONFUSED PRONUNICATIONS, CONFUSED TEACHING STYLE WHERE THEY HIDES MANY THINGS RESULTED THE BEGINNERS GOT FRUSTRATIONS. I AM VERY HAPPY AND CAN SHOW THAT I HAVE MORE THAN FIVE YEARS EXPERIENCE IN MY RESUME. Muhammad Khan, North America.

Hello,I am Facing Issue in Synapse workspace deployment . How to resolve it ?

Can you give what answe should i gave in interview if they why azure made other services if analylatic can work alon can someone give brief andwer with real life snerio