How Discord Stores TRILLIONS of Messages

Thanks for watching this video :) What company would you like me to cover next?

Excellent video!

"what any programmer would want to do when they see something new: changing architectures"
I'm guilty.

I'm sorry, but if you write a critical infrastructure-level service like a database in Java, what the actual f**k were you thinking?

480 terrabytes per trillion messages, not including images ofcoarse otherwise it'd way bigger of a number thats just insane

This is better than ASMR. Fell asleep in 8 minutes!

It would probably still be 'only' billions of messages if Discord users didn't type like kids with ADHD and press the enter key after every three words mid-sentence, lol

love the animations on these videos

tbh, discord is masterpiece of this century

I did build multiple grpc channels/servers in my org.It's neither straight forward nor fit for all use cases, GRPC is primarily used for streaming like a stub but load balancing such endpoints is a nightmare. Not sure why they were using GRPC in such system though.

Whenever you create a GRPC connection it will block a thread until the connection is closed. If you create a one connection per channel you wont have enough threads in the VM of the instance running the GRPC client service. I think it is not a good idea to always have a open connection with database.

Wait a minute, are you one of the Rust Founder?
why promote so much? I have memorized now. Stop it.

Discord is destined to fail unless someone rich acquire them like microsoft or elon...much wiser choice than buying twitter

For some reason when discord stores trillions of messages, but still lags as hell and is barely usable everyone is impressed. But when Telegram does the same thing, but also WITHOUT file size limit nobody is speaking about that at all lmao

Love this channel

Can someone explain the data service and grpc endpoint in a dumb down version ?

To be honest, Im glad they store them, I kinda use dc as a pseudo gdrive.

I don't move to the "shiny new object" unless there's a very good reason to do so. I firmly believe "If it ain't broke...don't fix it until it is.".

Then again I'm all alone in my little corner so experimenting just isn't something I have time for either.

If messages are naturally partitioned by channel, what is the need in the one big database? Maybe I just don't know all the features

Why scyllaDB over dynamoDB?

So basically they put a cache in front of Cassandra?

i love crabs

But... MongoDB is Web Scale!

That was cool… awesome breakdown…🔥🔥

every time I think about discord I get a horrendously awkward flashback to my first situationship :/ when he asked “do u have discord” I replied “about you staying or about you leaving?” 💀

Got urself a sub sir

All you said is they moved to scyllabd and wrote migration themselves in rust. You could have done a YT short for it

I have a chat with a three-year history and the search for this chat does not work

can you make video about How Telegram Stores {sum of messages} of Messages ?

That one message of me.

I thought that Discord is written in Elixir with only some of the NIFs written in Rust as something called Rustler.

Hell nah this sh is gonna break down. I need to back up my “cloud” discord server😂

now do the developers have access to my discord group?

Great video. Great content. Thank you.

So that's why searching through Discord sucks? And that's why they have that damn infinite scrolling BS?

This was an incredibly well made video!

They store their text messages on txt files 😂😂😂

why discord, there is also messenger

so those days I thought my messages and discord wouldn't open up, they were going through a giant migration
?
wow. that's wild! for what is worth, I went on a no-discord fast for almost a month.

MongoDB and Cassandra AND JAVA? I doubt they are engineers or even coders.

Imagine AI company make an investment to use their dataset

Great video, and I'm left with one question how to find and use the right tools at the right place and at the right time 😅
That something comes with experience or any beginning can also master that?

I have always wondered and been interested about Discord myself.

As someone who uses it daily, and runs a sever (that in hoping to monetize as it has exclusive ckntern ghst tskes forever to curate)

Inspiring!

i was thinking what do happen to the people that were working there ( for example on cassandra db) after migration? all went home and new people came in ?