How to import a 7M+ rows data set into PostgreSQL? (SQL for beginners)

THANK YOU

postgres=# COPY PUBLIC.flight_delays_all FROM '/users/SPM/desktop/2007.csv' DELIMITER ',' CSV HEADER;
ERROR: could not open file "/users/SPM/desktop/2007.csv" for reading: Permission denied
HINT: COPY FROM instructs the PostgreSQL server process to read a file. You may want a client-side facility such as psql's \copy.

I have 5 million records in a CSV file which I tried to load into a PostgreSQL table using a copy command just like the one you used. However for reasons unknown only 375,000 records were copied in the target table. Please help me out with this. Thanks in advance

How much that in bytes

Good video, do you have any video how to import huge amount of data from folder - with subfolders? And data type is in my example .dif files?

¿Es necesario hacer todos los pasos del servicio remoto para obtener la data flight_delays?. Ayuda por favor. Necesito el archivo csv.

Hi, could you please Explain how to read file from S3 and deploy this in AWS EC2 instance ? Would be happy to understand how to use pg_bulkload instead of copy

Is there a way to use that copy command and eliminate duplicates ? I think mysql supports that with their import tool

Thanks for your viedo！

Hello ... could you help me with the procedure for uploading a .csv file with postgresql on UBUNTU?

Hi, how would you do this, if in your table have FOREIGN KEY and subquerys?
Please, I'll be grateful if you answer.

Moreover SELECT * FROM fligh_delays LIMIT 10 ; it goes through but return nothing

I followed ur instructions , however i got this >> ERROR: missing data for column "flightnum"
CONTEXT: COPY flight_delays, line 6933096: "2007,12,21,5,804,"

if you are working with bigdata it is not funny to create table by writing columns, it should be create from header of csv file automatically but anyway thanks for good video!

Thanks for share Tomi.I have a similar task for this week.

Great vid! You really should be using SSH with authentication key instead of password.