Microsoft's New AI Orca-2 Just Changed EVERYTHING! (Synthetic Data Breakthrough)

That's fundamentally wrong, GPT-4 was trained on 7800 Gigabytes of data, good luck fitting that on a USB drive. 😉

Why did Alphago plateau in learning improvement? If it had synthetic data, why couldn't it improve exponentially? If I had to guess, it didn't improve anymore because it hit a brick wall with its current knowledge and lacked the capabilities needed for exponential improvement. I'm not 100% sure but can anybody explain it. why it plateau

ok?

All the world’s data on a flash drive? How is that possible?

Lots of water, very diluted. Why don’t you provide some concrete examples or scenarios of how this synthetic data is generated? Did I get it right that it’s gonna demonetize you if you do?? Why??

1. Man creates AGI
2. AI is doing reasoning instead of man
3. Man loses reasoning ability
4. Man runs out of natural resources
5. AI can't help
6. Man extincts

bro u need a proper mic and not peak out the levels

Bro your mic is cancer

Every one of your AI videos JUST CHANGED *EVERYTHING* !! according to your titles but in fact, few if any actually do. Please stop.

Will their be jobs for most humans in 10 years from now? I can already tell you that robots and language models are much better than me at every tasks.

Hey, good video. One thing though, try sitting a bit further from the microphone. The sound gets better if you don't talk directly into the microphone.

can you fix your ridiculous microphone? lol

I am using AI for all my reasoning now!!!

I have a ball, a cup and a plate. I would like to stack them so they do not fall over. How should I stack them?

Orca-2
That sounds like a fun challenge. To stack the items securely, you need to consider their shape, size, weight, and stability. Here are some steps you can follow:

Place the cup on a flat surface, such as a table or a countertop. Make sure it is centered and stable.
Next, place the ball on top of the cup, aligning its center with the center of the cup. Press down gently to ensure a snug fit.
Finally, place the plate on top of the ball, also aligning its center with the center of the ball. Apply enough pressure to make sure the plate is firmly attached to the ball, but not too much that it cracks the cup or deforms the ball.
Congratulations! You have successfully stacked the items without letting them fall over. Enjoy your creation!

Good. But I feel you have repeatedly stated the same thongs 5 times. I would appreciate shorter videos up to the point. Thanks.

amazing how the human brain reading maybe 100 million tokens using a 100Kilowats of energy training, constructed from a 10,000 gene program which is an evolutionary kludge, gets to general intelligence versus these zillion token multi gigawatt digital monstrosities lol

Excellent video !!

According to Geordie rose founder of dwave quantum computing , q bits are almost like parallel universes for information and he compared them to lovecraftian entities so I’m sure quantum computing will be used in synthetic generation

I remember orca. It stunned the whole industry

°∆ I believe we are meant to be like Jesus in our hearts and not in our flesh. But be careful of AI, for it is just our flesh and that is it. It knows only things of the flesh (our fleshly desires) and cannot comprehend things of the spirit such as peace of heart (which comes from obeying God's Word). Whereas we are a spirit and we have a soul but live in the body (in the flesh). When you go to bed it is your flesh that sleeps but your spirit never sleeps (otherwise you have died physically) that is why you have dreams. More so, true love that endures and last is a thing of the heart (when I say 'heart', I mean 'spirit'). But fake love, pretentious love, love with expectations, love for classic reasons, love for material reasons and love for selfish reasons that is a thing of our flesh. In the beginning God said let us make man in our own image, according to our likeness. Take note, God is Spirit and God is Love. As Love He is the source of it. We also know that God is Omnipotent, for He creates out of nothing and He has no beginning and has no end. That means, our love is but a shadow of God's Love. True love looks around to see who is in need of your help, your smile, your possessions, your money, your strength, your quality time. Love forgives and forgets. Love wants for others what it wants for itself. Take note, true love works in conjunction with other spiritual forces such as patience and faith (in the finished work of our Lord and Savior, Jesus Christ, rather than in what man has done such as science, technology and organizations which won't last forever). To avoid sin and error which leads to the death of our body and also our spirit in hell fire, we should let the Word of God be the standard of our lives not AI. If not, God will let us face AI on our own and it will cast the truth down to the ground, it will be the cause of so much destruction like never seen before, it will deceive many and take many captive in order to enslave them into worshipping it and abiding in lawlessness. We can only destroy ourselves but with God all things are possible. God knows us better because He is our Creater and He knows our beginning and our end. Our prove text is taken from the book of John 5:31-44, 2 Thessalonians 2:1-12, Daniel 7-9, Revelation 13-15, Matthew 24-25 and Luke 21. Let us watch and pray... God bless you as you share this message to others.

Still waiting for the real Artificial Super Intelligent

What I like the most about your channel is that this is a person narrating. That voice isn't an AI voice. Don't ever change.

At the beginning of presentation substitute teaching, I'd ask a few questions, looking for some additional details of the notes and the plan left to me for the class assignment. This was behavior observation, also important. If anything caused disruption that would require me to leave that room, I had noted leading student personalities who speak up first and seem to have the different of all their peers in the room. That is the one I designate as Student Monitor until I can get back from dealing with the emergency either in the hall outside the room or other location of a necessary task. I think of this because Orca-2 as a new neophyte AI learning model functioning system using self-improvement synthetic data, might be a useful information theory subset algorithm as a "classroom monitor" while we humans work on management of the emergence of an AGI or other larger AI system? In terms of just the information theory part, this is a thought I have after listening to this presentation.

The end is nigh

Please tell me the usage of a llm without human data. What kind of data would it learn then, and to what usage of an human. You may give it feedback from another advanced LLM but let's hope it doesn't hallucinate often

Musk's statement, "Yeah, It's a little sad that you can fit the text of every book ever written by humans on one hard drive," is one of the stupidest things I've ever heard anyone say. What's "sad" about that? It's just digits stored in a volume. And so what if "Synthetic data will exceed that by a zillion?" Is that supposed to mean something?? Is that supposed to be some kind of commentary on the literary out-put of humans? The meaning that text has for humans outstrips all the synthetic data that will ever be generated by systems who have no capacity to understand what meaning even is.

The first limitation that must be crossed is using more data from other languages. 94% of the data used to train GPT 4 is English. there are 7000 languages in the world. not only English. gpt 4 can't even do Malay poetry

I must say, orca's are straight up killers

GPT-4 was trained on WAY more than 45 GB of training data. I believe the figure is more like 45 TB.

Moving fast .. we won't know what hit us, until we are facing a meltdown, of our reality. AMAZING THOUGH !!

Microsoft is just this hungry AI monster! It has OpenAI in it's pocket, and it still makes it's "own" AI based on Google's AI model. Nadella seems so collected and jovial in public, but it feels like in front of the mirror he yells "I will have it allllll!!!!" and then laughs manically.

Your video was very informative and enlightening. Thank you so much 🙌🏻

everything changes everything, everytime

They're basically diverging to work towards personal AI at this point by keeping it small.

GPT4 was trained only on 45 gbs of data? I know it's plain text, but I would have thought if you scrapped the entire Internet there'd be more than 45 GB of plain text.

FIIIIIIIIIIIIIIIIIRST...Ok after the 4 others comments...ok I don't care....Watching the video now x)

I love the idea of teaching language models like Orca-2 to employ different solution strategies for various tasks. This may be a great method to create leading Small Language Models (SLMs)!

Imagine One Years laters 😂😂😂

The game is too high. The audio is not that great. It’s peeking on my end. New iPhone 15 Pro Max.