How to work with external table in Snowflake | Chapter-11 | Snowflake Hands-on Tutorial

Thanks for the session. Could you please provide the files used in the session along with the code. that would be really helpful

Hi Bro,

Thanks for knowledge sharing. Please explain about snowflake latest features like Dynamic tables etc. with examples.

Very nice stuffs, one doubt when using list @extenalstage it is giving results of file kept in s3 bucket but when when using select $ notation as shown in video tutorial it is giving "Failed to access remote file: access denied. Please check your credentials"
any advise where should i look for? Thanks

I would like to download Tree that you are showing and dont have access to SQL queries which you have used

Could you please enhance it to use storage integration instead of making bucket as public? That will become more real world example

Total appreciated!! Its a great content. Please can you share the SQL scripts and data used in this chapter, without hands-on its hard to learn. Not planning continue with the next videos as I dont have something to practice.

Please can you share the data files

very nice explaination , could you please share the data file i want to practice it , i am new to snowflake

I noticed that you have used varchar datatypes for all the columns in external table. when I tried to use number, timestamp_ntz datatypes while creating the external tables, it gives me an error "Failed to cast variant value to FIXED" when I try to do select on the external table. please let me know if I'm doing any thing wrong

can we use COPY INTO command for loading data from the external stage to the external table?
when do we need to create integration?
if we delete data in the stage after we insert it into the external table, will it affect the data in the external table?

Why do we need to make the bucket public,even if it not public also am able to load the files and have created event notification as well which works fine

There is no link to get SQL statement

Can we get a AWS account trial version like Snowflake for 30 days ?

This is so good, thanks buddy.

Hi sir, I have followed this video and created a folder and subfolder in s3 and the bucket policy accordingly. I have created the external stage also. However, the moment I do list @<stagname> in snowflake UI , I am getting this error "Failure using stage area. Cause: [Access Denied (Status Code: 403; Error Code: AccessDenied)]". I have tried searching the root cause of this issue in snowflake community but the solution they have provided is not working it seems. Please guide me on this. Thanks,
Shahid

Where can I download all SQL scripts to practice

Please make a separate video of transformations used in snowflake also explain which is better for snowflake either ETL or ELT

Hi, I an interview question they ask me why you external stage for loading aws to snowflake via snowpipe, Why can't we use internal stage or internal tables? May i know any limitations on it

I have created an internal table called Customer_CSV_IT, how we can copy the data from Customer_CSV_ET to Customer_CSV_IT?

Also please provide url for scripts used in these tutorials.

Please share url for site to get sample csv data you used in these tutorials.

This is the best training I have seen so far on Snowflake. Is you code repo available anywhere for reference?

Your videos are really amazing. Where can I get the data files?

i got a pop-up that query produced no result while im trying to see how many rows are there in table?
could you please help me why im getting this error. thank you

The bucket you created is named "snowflake-s3-ch-11-ext-stage" but in the external stage creation command you gave a different name
in URL parameter (url='s3://my-s3-data-lake/customer/csv/'). Should it not be the same name as the bucket you created? A little bit confusing. I will appreciate
if you can clarify.

Need some project explanation
Roles & responsibilities
Day to day activities for 4yrs exp candidate..?

Need some help ✋

well explained bro

Nice Explanation!

I have some questions:

1) External Tables are not charging us any storage costs but compute costs, right?

2) When we should use external tables can you give some example scenarios?

3) Can we use External Tables for auto ingestion of other data sources and snowpipe for internal tables data ingestion simultaneously?

Hi, why external table is required when we can query the data directly using the named stage from s3/any others

Can you please attach all the sqls used in the video or provide a link

Love your video series. I have pointed a few people to your series. I have a question regarding observations regarding MVs on external tables. In theory, "materialized views over external tables can provide performance that is faster than equivalent queries over the underlying external table" but what if you observe that more than 50% of the cost is attributed to MV maintenance? I am talking about really huge external tables. I have tried to research this a lot and don't have good answers. Do you have any suggestions or opinions?

Failure using stage area. Cause: [Access Denied (Status Code: 403; Error Code: AccessDenied)] getting this error while performing list operation,Please help me out to solve this issue ASAP,Do i need to make any changes in aws console?

Hi Sir, I have doubt that, in the video you mentioned snowflake account which is running on Azure can get data from AWS , is that mean , your snowflake account is now on azure and your accessed the data from aws in this video?

Very useful Information. and eplanation is nice.

Very good session. Explaining multiple file formats with external table is really great. Thanks you again!

Would like to understand how we can setup with Azure BLOB. In one of the comments you mentioned you are going to show the same. I will also try that and post it in comments.

Hello sir, my practice snowflake account is hosted on Azure hence ARN no for external table I am not getting as you also mentioned that for AWS hosted only we'll get it, in such cases how to auto refresh the external table ?

hi , even i open by s3 bucket to access publicly as you shown in video , still it throws error while listing the stage , for that i have create policy and give access to snowflake user , then it works , then again while sqs notification i followed you step by step but still my notification field shows null in result pane , for that i searched snowflake documentation and didn't found anything you explained in the video , instead they ask to create pipe and put copy command inside it and put the notification field of the pipe in s3 notification window, i followed the documentation but still my show pipe query show notification as null...not getting what i am missing...

Could you please help from where I can get all SQL written in videos

Please make a video loading json data into snowflake from azure cloud

I have doubt. We have not created any pipe for stage and table then how does data gets inserted in table ? If it’s getting auto created how does it configured ?

Hi,Thanks for the video. I am getting error while doing list @stage_name .Error is Failure using stage area. Cause: [Access Denied (Status Code: 403; Error Code: AccessDenied)]. I have bucket policy created like mentioned in video and it is a public bucket.

good job - always !!

Can you share scripts used in these video's ?

Hello, Thanks for the clear explanation, Love your content btw. I have a doubt, If we can simply use external tables for continuous data ingestion, then what is the purpose of pipes ? or does both pipes and external tables support continuous data ingestion. Thanks in advance.

I have two doubts: 1.Whether we can use internal stage to load data into external table,2. Whether we can use partion and auto-ingest both at a time while creating external table and whether we can use snowpipe if we use auto-ingest in external table creation

Thanks a lot for this useful video. It is really helped me a lot. One place I stuck that notification_channel is null after creating the external table(given auto_refresh = true aslo). If possible could you please help me on this what I am missing here.

Love your tuts Thanks for creating this amazing tuts.

Thank you for a very well built and extremely coherent video

Hi, could u please provide the code ,even I was searched in the website u refered to a person in the comment section.

Hi Sir ,
where can I find the code which is used in this video ?