DeepFaceLab 2.0 Xseg Tutorial

After running the generic mask files and go to train it acts like there's no mask there at all and all my images are completely green. I can see the mask in xseg editor but it's like the trainer is completely ignoring it.

subscribed, high level tutorial dude, thanks for taking time out to share your knowledge.

Hey brother, how are u ? I dont know if you have some tutorial of MVE but, bring some tutorials about MVE MACHINE VIDEO EDITOR

Whenever I try to train the Xseg it stops after getting samples and says "ImportError: numpy.core.multiarray failed to import"
I tried with lower and higher batch sizes.
I have an RTX 3080 graphics card so hopefully that is enough to use the software.

So this Xseg is avoid disturbing masking on face ?? Can i send you SRC and DST video privately for example to my learn

Thanks for this tutorial. So this a mask trainer but is it correct that I must used SAEHD trainer after this for the actual face training? Wasn't clear on how they interplay. And do I transition the /aligned_xseg files to the /aligned prior to SAEHD or has the masks already been applied to the /aligned output?

when i start 5.XSeg) train it always takes the files from _internal\pretrain_faces instead of the faces i want to train. do i miss a step after i fetched the Lables?

everytime i start xSeg train it says Press enter in 2 seconds to override model settings. but i cant do anything

when do i do this step? instead of quick training? or before face extraction?

Is it possible to apply same polygon to multiple photos?

what folder does it apply it to?

Hi,is there a location for the Xseg labels(poligons) that I can backup and work on a different project,then go back to the previous one and restoring them without restarting the labeling?

please i need an assistance when ever i start training XSEG i got an error when i started pretraining please what could have caused it ?

Thanks again :)

Thanks

Hi Again, In my final merge and result.mp4 I picked up flashing faces showing the original dst face so I went back and did a MANUAL RE-EXTRACT DELETED ALIGNED_DEBUG and also did more labelling. I then did a 5.Xseg train for awhile to get these new fixed masks trained and then ran XSeg Generic apply (dst only).
Q1. How long do you think they will be correctly applied back into my already completed SAEHD training process or will the fixed mask be merged without me having to SAEHD train again or do I continue SAEHD from where I left off? I don't want to lose 100,000+ iterations of final SAEHD training so I hopefully I don't need to start traning from scratch again?

Anyway, I actually did try this and continued SAEHD training +50k iter), but it looked like my new masks were still broken although they look fine in the data_dst/aligned_debug folder? I'm thinking I may have have missed a step or did not apply the masks as I thought I did before going back to SAEHD training?
Q2. What is the best process to go back, fix and re-apply Xseg masks when you have finished SAEHD training?
Q3. Originally I was thinking since the debug aligned dst images are only used during merge so I should just be abled to fix the masks, train and re-apply and skip straignt back to the merge without the need to continue SAEHD train? IS this correct or I need to do what I Originally described in Q1?

Apologies for the loooong questions so I sent little donation :)
And may I say YOU ROCK! :)

Hi I have a quick question. I have over 1 million iterations of my subject..I just bought a new computer and I would love to use the same training and face in my new computer without starting all over again...is it possible to do that? How can I use the same trained model in my new computer without having start the process from the beginning?

Im working on dst video with multiple faces, how can I just pick one face to apply face mask from the source vid to it please?

Nice tutorial! Quick question, how many iteration is sufficient enough to move to the next step? 100K?

Xseg labelling - When I see you setting each polygon point so fast, I wonder if you have sped up the video in that section? In reality, I find I can't just freely outline the face that fast as you have to literally click the left mouse button for every x on the face you select as the next point. Or is there a trick to automatically trace the face and set each point evenly by holding down another key as you trace?

Could you please tell me if i have to get rid of obstructions from the destination data or just do it with the source data ?

Brand new to this, should I be editing with xseg before or after training? I'm under the impression I do this and then train, and this makes the training more accurate. Is that right?

so oncetraining is done what do i need to do next using a 4090

how many labels do you recommend we use per faceset?

Your video is awesome! is it possible to use generated face images as a modeling data set? or is it only videos that can be used for the learning process on deepfacelab?

Hello, thanks for putting in so much effort into making this video! I really hope you see this comment because I have a question..
I have 8k frames I need to make but the xseg generic doesn’t do a great job on all of them.. is there anyway to go in there an modify the xseg generic masks manually to certain frames without having to do all 8k manually?

Do I have to remove the mask before I continue training in order to put on the "improved"(further trained) mask later?

sir I'm facing This problem 👉 'no training data provided' how to solve this

hey man, how does one get this working on AWS? there's nvidia v100, k80 and tesla available. Not sure which builds to choose. Can you make a video please?

Amazing tutorial

Do you start with Generic Xseg? Then after how much thousands of iterations do you start labeling the polygons?

how to re-extract in src face set

Could someone please tell me which VERSION of the software to download for an RTX4090 card?

They don't even mention the 4000 series on their tutorial page.

which home user (consumer) hardware is required for deepfacelab? i used my 9900k about 2 years back for deep learning and it would usually take about a day for satisfactory results. i don't own a GPU. would you say a 4080 (non-Ti) would work?

Can you install this on any computer?

Please how can I get the full tutorial as a newbie?

Hi, great tutorial, thanks for doing it. I have a question that I can't find answered in the deeplabs guide: After training and applying the Xseg masks, how do I merge it with the data_dst video? I already have a SAEHD trained model, should i use merge_SAEHD? because when i do that, the masks I trained and applied in XSeg are not there.

I've been trying to download the file from GitHub for a couple of days, after 79% downloading it, Mega says to free space etc etc, and then it says to pay premium . And also Chrome and Microsoft blocks my downloads wtf. Any ideas...

So you go frame by frame including and excluding every step of the way 😵

Hey do you do requests?
And if so, can you please do Katy Perry's face on Ryan Keely?

What if it has the image upside down in the editor

Nice video m8!

Why is it that whenever I export my file, it is only 480px... how can I export it in HD?

How many itterations do you usually do ?

Does this work on CPU?

Great video!

1st