AWS S3 File Upload + Lambda Trigger (Tutorial In Python) | Step by Step Guide

How can i get the codes and materials you use such as: the transaction.json etc

How we generate this log in s3 bucket not in cloudwatch

clear, to the point, and useful. Thank you !!

Hello sir we have need S3 download request count my website

Great tutorial

i am trying to write an xml file into s3 bucket using lambda but it is timing
out. Do you know what could be the reason?

Saved my job 💕

So I was able to trigger lambda based on S3:ObjectCreated by uploading a file. But what happens when the whole S3 bucket region is down? In this case, the file won't be uploaded to the bucket and won't trigger the lambda. In this case, what do we do to still process the file when the bucket region is down?

Lacks intuition so hard, kills brain cells trying to figure out.

Beware : reading and writing to the same S3 bucket can get your bill skyrocket . So just follow each step correctly or try not to upload the file again to s3.

extremely complicated compared to GCS

I enjoyed your video. Can anyone help? I understood everything but I didn’t get where he edited the codes. Is that a lambda app? I mean the black screen on which he edited the codes. Is that a third party app ? Can anyone help?

Can I get the complete code?
I have tried the same python code in the lambda function, that just is giving errors at cloudwatch.

Hey! I am facing an issue. My lambda function and S3 bucket both are in us-west-2 region but while creating event notification, I am not able to see my lambda function in the drop down list. What could be the potential issue?

How to configure email alert if daily routine based object is not uploaded in s3 object, can you help.

thanks, good content

[ERROR] KeyError: 'Records'

The python code with some which worked for me.
import json
import urllib
import boto3
def lambda_handler(event, context):
# TODO implement
bucket = event['Records'][0]['s3']['bucket']['name']

key = urllib.parse.unquote_plus(event['Records'][0]['s3']['object']['key'], encoding='utf-8')

try:
s3 = boto3.client('s3')

response = s3.get_object(Bucket=bucket,Key=key)

text = response["Body"].read().decode()
data = json.loads(text)

print(data)

transactions = data['transactions']

for record in transactions:
print(record['transType'])
return 'Success!'

except Exception as e:
print(e)
raise e

This video was helpful in understanding how Events work. I had a doubt- Is it possible to retrieve the file path of the object? How do we write a lambda function for storing the file path to a database that is triggered every time a put event happens in a bucket?

if i wanted to call that data variable outside the function to look at the data locally, how would that look like?

Nice, however it's missing a fundamental part, get response from lambda into your app. I can't find the way...

Thanks for the step by step guide. I have a question. If we follow this approach, the lambda will trigger every time a new file is created in s3. So, if we get 10 files simultaneously, it's going to invoke lambda 10 times. Is it possible to invoke lambda only once in such cases?

This video really helps. Explanation and demo are so precise. Please keep doing this great work.

Thanks for precise video.

name 's3' is not defined at line 10 in lambda function
Anyone else got the same error?

How to handle if there are multiple files dropped in S3 at the same time where we need trigger one glue job? How should we handle Lambda here? Any help is appreciated.

I am not sure why you made a video if we are supposed to guess what write or click on!! What is that? Lowest quality video setting on your computer?!😅

Thank you, this is very helpful. Quick question: if I am about to use Step Functions to run a few lambda functions in a batch style starting by a CloudWatch schedule event, but I also need these lambda functions to wait until particular S3 objects are uploaded to run. How does the S3 trigger work, will the lambda functions wait until they get S3 events?

can you please include ur source code in future videos so I dont have to type too much. pls and thx

That clicking sound you make with your mouth is fucked to listen to every 5 seconds.

Thanks for this! I quickly fought through a couple of issues with imports and such, but woot this hit the spot! As soon as I got your demo running it was only another two hours for me to get the same running in sam. Now I just gotta figure out how to cloud formation that s3 event trigger into a sam CF template, and viola!

I want to trigger a lambda for a file that’s two layers down in the s3 bucket (I.e s3/folder1/folder2/my-file.txt). How do I configure the lambda to ingest only files put in folder2?

where is the code ? where can we download it

Exactly for what I was looking for.

Hi sir, thanks for the tutorial. i finished this tutorial.
but i have one scenario of json validation, while uploading a json file in the bucket using lambda it must be validate. i dont know how to do that

@Be A Better Dev
Hi, Thanks for the video. I have a question, let's say we have a application that let user upload a file which goes to S3 and the file is processed by lambda. So in the event when user A & user B uploads a file to S3 with a negligible time difference, which file is processed first file from user A or user B? so basically, does S3 maintains the order of file to pass it to lambda to work on? Please guide. Thanks.

Do you prefer windows or mac?

Thanks for the video, I follow your videos as they are very nicely explained. Request you to please upload a video on how AWS sagemaker works?

I still reference old content and WOW, the explanations and video quality have come a long way in just two years.

Where is the Code, you could have put in the github.

Can i take "screenshot" when the snapshots are created ?

I want to add cloud watch content to my rds table after Lambda is triggered. Is it possible and if yes How

where is the script? also you edited it, how do you expect a newbie to know what to do? thank U

Unable to find the phyton code in description, if you don't mind kindly share the code....

Very well explained.

Duno why people would dislike such a nice video

My lambda is triggering but i am getting error in getting the bucket name. Key error. What I have to do?