Source MySQL table data to Kafka | Build JDBC Source Connector | Confluent Connector | Kafka Connect

Source MySQL table data to Kafka | Build JDBC Source Connector | Confluent Connector | Kafka Connect

The Java Tech Learning

3 года назад

28,941 Просмотров

Ссылки и html тэги не поддерживаются


Комментарии:

@mirzauzair6854
@mirzauzair6854 - 17.12.2021 12:39

Great video! Can you help with connecting to snowflake as source?

Ответить
@shuchikumari8031
@shuchikumari8031 - 20.12.2021 18:29

Sir nice video, but atleast you can upload the code link.

Ответить
@oyeyemirafiuowolabi2347
@oyeyemirafiuowolabi2347 - 01.01.2022 17:48

Dear Vishal,
Thank you for your effort & time to produce & upload these tutorials.

Ответить
@oyeyemirafiuowolabi2347
@oyeyemirafiuowolabi2347 - 01.01.2022 17:51

Please, what is the best method or connector available to pull or ingest data that normally get updated or changed. For example bank accounts statement.
Thanks.

Ответить
@earnestmorrison8004
@earnestmorrison8004 - 10.01.2022 22:53

Very funny :-))) Love it!!! Do not waste your time > P-R-O-M-O-S-M !!

Ответить
@kjvinodkumar
@kjvinodkumar - 20.01.2022 08:54

how to download kafka connect JDBC COnnector

Ответить
@kjvinodkumar
@kjvinodkumar - 20.01.2022 08:55

Could you please provide me the link

Ответить
@akshatkhandelwal6384
@akshatkhandelwal6384 - 31.01.2022 14:55

Can you please guide me how we do this in local instead of confluent cloud?
What I want to do is like to connect database with kafka connect and the data gets inserted into kafka cluster

Ответить
@vishnutiwari9640
@vishnutiwari9640 - 11.02.2022 08:21

from oracle, it is unable to fetch data. Any license issue?

Ответить
@sandeepravitej4583
@sandeepravitej4583 - 13.02.2022 09:57

My Confluent installation dont have JDBC source connector by default , Please help me how to install ?

Ответить
@ankanchanda8272
@ankanchanda8272 - 24.03.2022 15:14

Thanks for the video , Vishal. I wanted to know that , we can also source Oracle DB using JDBC Source Connector too, isn't it? And where did you deploy the connector config file? In the Confluent cloud?

Ответить
@krushnapardeshi3694
@krushnapardeshi3694 - 05.04.2022 23:27

I'm beginner on kafka and DB concepts. What is dialect exactly in this case ?

Ответить
@Devendrakr63
@Devendrakr63 - 02.05.2022 15:41

Can anyone would paste the config properties in comment.

Ответить
@sahilmakandar9623
@sahilmakandar9623 - 30.05.2022 21:26

Sir Can you provide the jdbc driver link

Ответить
@Владимир-в1в5ш
@Владимир-в1в5ш - 14.06.2022 21:12

wtf , you are good

Ответить
@Rajeshkumar-hs5hi
@Rajeshkumar-hs5hi - 01.07.2022 11:09

Hi Vishal,
I am facing issue Invalid connector configuration: There are 2 fields that require your attention
while connecting to mysql db ..is this required mysql jdbc configuration as well ? if yes how we can do that ?

Ответить
@carlaguelpa4574
@carlaguelpa4574 - 15.07.2022 15:03

Hi Vishal, thank you very much for this! :)
I have 1 question, how do you installed the connector plugin for sink ?

Ответить
@jinraven77
@jinraven77 - 01.09.2022 21:06

Could you please do a Video loading tables into their respective topics for each tables , using SQL SERVER as a source??.... so everytime each table suffers a DML action the new event s sent to the Confluent plataform..

Ответить
@muralidharan3756
@muralidharan3756 - 21.10.2022 14:52

hi
by using your code connector is got connected but status is got failed and no data is fetched from db can i know what was the reason

Ответить
@ravirty8962
@ravirty8962 - 07.12.2022 09:46

Hi Vishal,
Could you please help me with Snowflake Source connector via (JDBC) to unload the data to Confluent Kafka.
If there's any sample code please share me the github details.

Ответить
@mdicopriatama6380
@mdicopriatama6380 - 26.01.2023 10:29

hi Vishal, when i want to upload the connector i faced the issue "invalid connector class" i need advice. thanks

Ответить
@MohdMahebub
@MohdMahebub - 14.02.2023 17:02

Hi, Vishal , Could you please help me in pushing confluent topic data into scylladb table...

Ответить
@manindersingh6371
@manindersingh6371 - 26.02.2023 01:24

Nice video bro. It worked for me. One quick question for you:
How to run query like this:
select id,CUST_LN_NBR FROM flex_activity limit 1;

In this query I am using limit option in due to that it is getting failed. If I use simple query without limit then it works fine:

Error I am getting:

org.apache.kafka.connect.errors.ConnectException: java.sql.SQLSyntaxErrorException: You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near 'WHERE `ID` > -1 ORDER BY `ID` ASC' at line 1

This is not only with limit option, this is for all whenever you have to apply any filter.

Ответить
@ttc744
@ttc744 - 19.03.2023 12:53

Very helpful video. I see the 'timestamp.column.name' should have been TXN_DATE (as flashed up on video) otherwise update wont work. It would have been nice to see this working at the end in addition to adding new records

Ответить
@pavankumarmantha
@pavankumarmantha - 04.05.2023 16:49

Hey, i tried to connect to postgreSQL and was finally landing with below error in logs
Caused by: org.apache.kafka.common.errors.SerializationException: Error serializing Avro message
Caused by: org.apache.kafka.connect.errors.DataException: Failed to serialize Avro data from topic <topic_name>
any help ?

Ответить
@nareshkyv
@nareshkyv - 11.05.2023 14:03

Hi Vishal thanks for sharing videos. Please let me know where can i check the errors/logs when connectors failed? also logs/errors if any issues in processing data. Please share me paths

Ответить
@omerimam8256
@omerimam8256 - 07.07.2023 20:24

thanks i need your email please

Ответить
@hamzaaitoumghar9359
@hamzaaitoumghar9359 - 26.07.2023 19:10

can you give us the link for the config file ?

Ответить
@amankumar-f4n5r
@amankumar-f4n5r - 27.07.2023 21:47

AWESOME !!.Can you also upload video on sink connector to oracle database or any rdbms

Ответить
@ibnu0muhammad
@ibnu0muhammad - 07.08.2023 19:55

Really cool bro!

Ответить
@resam32
@resam32 - 13.10.2023 19:32

Thank for the great tutorial. Did you have to create the avro schema or it gets generated?

Ответить
@rahulgupta373
@rahulgupta373 - 30.10.2024 09:10

Most sensible video on Kafka topic, thank you very much.

Ответить