GPU Pass-Through - VFIO - Let's run all the GPUs together!

Building my system with kind of same specs as yours, Asus x670Creator + 7950x + 64GB DDR5 6kMTs + Two AMD rx5700xt for the vms, will upgrade vga in the future, proxmox route 🤞🏻🤞🏻

Hi you should make a video on vgpu_unlock, I think it's potential is undersold, Also there is now an experimental virgl driver for windows

I done this on my old computer, all of my games worked even though all of my games had an anticheat it still worked well, ive abandoned this since most of the games that i play now dont support linux at all or killed the ability to play the game on the virtual machine

We're having difficulty finding qualified candidates for a systems engineering position for NASA-funded projects at Caltech.... is there a section on your website for job ads?

I've been trying to use this on laptops, it is soo much of a struggle, i tred asking on L1Forum ut nothing nothing usefull came ut of it. It has become a little better with most new high en laptops using a Mux switch but its still not as user fiendly also not having SR-IOV/Nvidia Grid for consumer grade is an anoyance

Sorry to bother you: I think i should upgrade my external storage 4small + atleast 5large, I'v considered buyin a type of suitcase where i can attache them all inn there and connect them to usb and power in the middle while i hang dem on the wall of the suitcase,and running them all throuh a powered usb hub that only sends me the one usb++ cable. How f'ed of an idea is this ? i assume cooling would be an issue but winter is around the corner AFAIK.
I would consider schuking them and put them into a case but looking at that it seems it would become expensive. I want them together configured in a automatic system for depuplication and backup with a SSD as the brains storage isthis pheazable.. i just want a system i can move around intakt
PS : not rich, should I buy a solution? Or even a barebones amd5 system with rdna onboard, and md5.

Ps2: has it become viable to run stuff like this over raspberry pi ie. have it serve 8 hdd with ~~ 60tb on 10 disks.. yeah ramblin but i hop you de de

I run a 6900xt and a 6400, the 6400 is enough for me to do all the necessary 3D stuff in my Windows VM while the 6900xt does the heavy lifting under linux, if needed i still boot into windows with the 6900xt for gaming.

Wow, the media industry will so target this tech as soon as they realize that you can circumvent HDCP by using that "monitor" driver.

we really just need vfio and memballoon to work together - that's the only thing stopping us from reaching that holy grail

I would love to build a gaming PC that I could run two SteamOS/ChimeraOS/Nobara/Bazzite OSes for me and my wife to game on.

My current gaming PC is an i7 4790 and AMD RX 580. I haven't had much luck with PCI pass through testing with that machine.

yes. Commented in your other post, but due to inspiration from you been running a 3955WX with a 6600XT, 2x P4000, and a P40. For multiple desktops and ML testing. My daily driver. Its been working great. Took me a while to find video cards that worked out of the box, but once I got it dialed in its been rock solid.

I would love to be able to host windows in my linux box and be able to use Unreal Engine from there!

Hell yeah!

I have been using VM's for well over a decade now, I use them to run older versions of Windows with software that I either wanted to sandbox or that only ran on that older OS. I also use VM's to keep my main Windows OS drive clean, instead of installing dozens of apps onto the OS drive, I will run a lot of my software in VM's. System upgrades and new OS's means that I simply have to copy the VM to the new computer. I haven't gotten into VFIO though, but it does sound useful.

"Wendell calls for aid!"
"And the community will answer!"

Let's do this. 😎

Hope we gettkng better vgpu /sr-iov suppoet on desktop gpus in future,the experience of using vgpu unlocker/patcher for the 2080ti on nixos was atleast really painless and fun to use, love the concept very much, would use a lot more if i could upgrade my gpu to a top spec amd /nvidia and have these features ...

Can't wait for bhyve to mature and have hardware accelerated GPU passthrough on FreeBSD.

I have been trying to setup windows vm's in TrueNAS. I have set all VFIO drivers. But there is a problem where I have them all share the same 10g NIC on a bridge, but when I iperf with the vm's it will destroy my Epyc 7F32 and speeds are only 5Gb/s. iperf'ing truenas from another 10g computer works fine. its only when im tring to iperf a VM.

I mean... the most obvious thing is that you will be able to have "fresh" tuned and dedicated virtual machine OS's for each and every game, in theory. So if you have a game that runs best on driver X and another that works well on driver Y, then you can just do that :)

been using unraid for this for about 2 years now. main vm is linux, games that dont work on linux i just boot windows but thankfully more and more games just work on linux now. would be nice to run windows and linux at the same time with both using the same gpu though.

Also, your call that GPU virtualization is the future of computing is bogus. It's the present of computing with AI workloads. AWS, Azure, GCP all handle this just fine.Also with containers/cgroups2 your "holy grail" system is very real right now.

Yeah, I would love VFIO, I want to leave windows for years but there are some apps that just dont work, and dont have an alternative that is at the same level

Can we do the same on windows ?

Looking glass sounds fantastic!

Ooh, hearing the Looking Glass thing out loud, that actually does sound really cool

I love vfio! I use it for gaming and research where I need to isolate the guest.

I still love my VFIO gaming setup. I only upgraded the Windows Guest GPU from a 1080Ti to a 6800XT recently and kept the 5700XT for the Manjaro host.
IT would be awesome if guest and host could share a GPU in the same way they share the CPU. I wonder if stuff like resizable BAR would work as well then.

I love the idea of VFIO but honestly has seemed like too much work for me. But if there’s a clear path, I would definitely implement it.

once upon a time i went down the windows GPU pass thru rabbit hole and spent weeks and weeks lost, trying everything i could find and nothing f@%#!$ worked. I thought this was impossible, I now know its because Nvidia hates me and I didnt know L1 was pushing this tech. this makes me happy!

how did you know i was thinking about this recently?

been running vfio on x99 for a while and it still works great to this day

I use it each and every day i have an rx 570 for guest and gt 710 to host

I hope to take a dual xeon 48c/96t machine w 6 1050tis and have users at home connect w pi devices via ssh and run their vm from wherever the plug in. I think this is a big help.

I'm personally using VFIO! Running Arch Linux as a host with an Intel A380 GPU and an RTX 4070 for my Windows guest to play games via Looking Glass. I've been using this setup (apart from some GPU upgrades) since about 2 and a half years now. Thoroughly enjoying it!

I am running a dual CPU EPYC setup with a total of 48 cores and 5 GPUs, under ESXi 8.0, with the intent of passing through individual GPUs to their own VM. I am hoping to run multiple instances of a specific game, so I don't have to make friends to be able to have a team in the game. My setup sort of sounds like what is being talked about here but not? How is VFIO different from running ESXi and using its GPU passthrough?

I think the future will be programs like web browsers,etc that run in mini-VMs that are isolated from the rest of the OS, but looks like they are running natively on the host for most consumers automatically.

Used VFIO for a decade, but Looking Glass didn't work well when I tried it last time I tried it for 4k resolution

I have a server with EPYC 7551, Instinct Mi25 and Radeon Pro Duo Polaris, so not sure that'll be of any help,
I was able to use HoloISO (SteamOS 3) to play games, though performance was quite bad, probably due to VM CPU settings

I read that nvidia 30 series do have SRIOV support on chip but disabled on driver. So it's possible to enable this on that too.

make vfio great again

"Have you been using VFIO?" Yes. "Do you use VFIO (now)?" No, Proton has gotten so good that it's not worth the hassle of starting Windows and then waiting for an hour while it freaks out and downloads all the updates grinding the system to a halt.

Honestly, I had an interest in VFIO and looking glass, but I've since started running a home server. All I really want is sharing ONE GPU with ALL VMs. VFIO would be great (however my understanding is that 1 GPU would only work with 1 VM), but I'm not giving any company my money for hacks and workarounds.
I'm tired of the half promise and then act like it wasn't said, proprietary SRIOV alternatives, or secret hyper-scalar only driver BS.

yes PLEASE WENDEL !

I've been holding onto hope from afar when it comes to things in the Open Source community for stuff like LibVFIO, VirGL and with GPU multiplexing or paravirtualisation. Right now the costs are prohibitive in the VFIO space even for things like wanting to have a segregated OS environment where you can have the rights to your 'own' PC that isn't controlled or tracked in some way.

So far I think the future will be in the single GPU space where all the requirements can be para-virtualised into segregated VMs. Just buying 2 brand new GPU's with all their constraints in vBIOS or how they've been licensed and controlled is too prohibitive and too many obstacles for really democratising the use of them.

If GPUs were truly free and open we'd be gaming on our preferred environments, but the walled gardens haven't opened up to the masses let alone the enthusiasts who have their own preferences.

Thanks

QubesOS is an interesting idea, but in practice hasn't been built to be maintainable, and the community is super toxic. You try to go tell them an issue you ran into, caused by their flawed design and lack of clear information, and the forum moderators start screaming at you for "probably never having used Linux before" etc. garbage.

Wow , classic Vid love this kinda content