Throwing data to your face (models)!

Hi,

@Latent Vision How do you use multiple attention mask when you have multiple reference photos ?

Hi Mateo 👋
About changing the Hair.
Using Unsampler with Controlnet would change the colour with keeping the same hair exactly , when writing in a prompt another colour. Right?
instead of masking or inpainting

Im trying to follow along with the new pul ID demo but am unable to see the DLib Model for Face Analysis Module. Only the insigt face model shows up. Where do we place the Dlib Models as I have downloaded them but they are not showing up in the load model. Thanks

Did you try the pony model or any pony modles for face recognition in your tests.? If not I'd like to see you do that next time around to compare how that model fares in face recognition.

Loved the video! Given your experience in this space, are you aware of any tech that will improve upon inswapper/insightface etc to enable swapping of faces or generation of custom faces at side or angles other than front-on or nearly front-on? this seems to be largest constrain of the current tech. Thx!

I'd also like to give voice to the many people saying your content is amazing. It truly is. The rocket ship from learner to intermediate and beyond. You explain the "why", not just show an example of "how" with a click-bait title and an enticing misleading thumbnail. Thank you. Please don't stop making this content, whatever the platform you choose to publish it on. It is fantastic.

I've been able to make some amazing progress by following along with your videos. Thank you very much!

Hey, your tutorials are awesome. How can I use the FaceID Portrait workflow into an existing image? e.g. just a simple faceswap of an existing image, maybe using Inpainting or something? What do you recommend, is there an existing workflow where I can set the face images, and the image to be swapped?

So for commercial use only Plus Face and Full Face are allowed?

Did anyone figure out how to run insightface with cuda instead of cpu?

Hi and thank you for your splendid video.
Does anyone know why i have this error please?
---
Error occurred when executing InsightFaceLoader:
No module named 'insightface.app'
---
I've proceeded with the install inside ComfyUI via Git Url and everything was correct but i cannot test InsightFace.
Thank you in advance.
Olivier

Awesome!!! So helpful. Thanks!

Amazing video, one question , what is the difference between weight and weight_v2? @5.43 , he mentioned these weights, but I am unable to understand, can someone help?

treasure

How do I calculate the embedding differences of my workflows? I want to see if I recreate the same individual at the end. Thanks!

Best tutorial and best explaination ever, very great video, also very inspiring.

Is it possible to apply makeup on an input image without using a checkpoint? I've been working on this for a long time but I'm not sure if my efforts are in vain.

wow, what a great scientific approach. Love your style and obsession with this. i respect you

Matteo, can you confirm that this only works when the positive conditioning is plugged directly to the sampler, i.e.: it breaks when using concat/combine with another positive prompt?

위와같이 모델 헤어도 일률적으로 비슷해질까요?

Another amazing video Matteo, direct, to the point and with great didactics, God bless you!

Im new to all this, its there any way to make the head tilt or show a different facial expression?

Your are new member of GOAT ComfyUi workflow Creator

for unrealistic character (anime) ,🥲 its bad

I love how the name of the models overlap the interface and become completely unintelligible. Good stuff. Remarkable UI design.

such good information here , thanks for the research ! one thing that might be nice is establishing a baseline , using actual photos of the same person in different scenarios to see how low the difference tends to be with realife variation

Crazy good inspiration

Brilliant stuff. Thanks so much for taking the time to produce these tutorials Matt3o 🙂

From what I saw SD15 FaceIDv2 + 2x upscale works incredibly well (upscale as simple resample with 0.4 denoise). Adding any other face model makes face blurry. With FaceIDv2 its incredibly sharp and keeps level of "likeness" comparable to best lora.

I am at the start of your video, it feels like a sportevent :'). ComfyUI can be quite daunting sometimes, but this... this is entertainment. Great content and many thanks.

Don't get me wrong but... can I get your aunties number? I'll help her carry the groceries!

Thanks!

Is PhotoMaker is different separate model?

that workflow looks crazy!

Matteo - one thing I'd love to know, is how the base checkpoints determine the faces (without ipadapter). What I mean, is almost every checkpoint I have tried has a "base" female or male face. Even when changing the nationality or race, the face characteristics stay similar to that base face. It's only when you start adding names or other positive prompts can you change the face into something more unique. I understand the models were trained on common sets of portraits, but surely there were many thousands of faces, if not millions. Ideally in my workflow I want to create a never before seen face, then use a workflow such as this to put the character into different scenes, poses. However I just can't seem to to randomise the face enough without putting in lots of ugly looking prompts.

"While i was filming tensorlabs released 2 more models"... yup - it moves so fast it's fair to say it's arguably changing on a daily basis now. Brilliant video Matteo by the way, thank you!!!🙏

Thanks for taking the time to make theses tutorials. Very hard stuff to understand but I'll keep trying :)

thanks man this helped

Your videos always give me some information I don't think I need to know before. Thank you for your hard work. 😊

Great benchmark, thanks a lot. You said that Instant ID and Face ID portrait rely on insightface, thus you need to buy a license for commercial use. Does this also apply to using Apply ip adapter face ID then as it is also using insightface? Thanks again.

Matteo, thank you so damn much for your outstanding work. I have been on a deep dive on all your work, clip models, and diffusers

Amazing video Thank you.
For me the best result is FaceID v2 SDXL+Upscale but sadly that truns my comfyui into a lowvram mode, i guess there was a deleted FaceID sdxl, it ran fine and results were really good.

Thank you🙏, very useful analytics and a tremendous amount of work done👷.

Great work!

Thank you for always providing great lectures! I am learning a lot from the detailed and friendly explanations. Thank you again.

Can't run "portrait" mode.
On GitHub you mentioned - portrait not used CLIP vision encoder. But here in video you used fae-ID with some clip vision encoder moder. Is it some special clip vision?

Something I’ve done for upscaling with 1.5 models is to go back to the original model and separately add the IPAdapter(s) and Lora with full 100% weights for the upscaler—so lower weights on the model going into the first ksampler so it’s not too rigid, but high weights on the upscale to pull it closer to the sample image.

Community MVP! 🙏🏻

thank you very much Mateo

amazing! thank you 🙏🙏🙏

That is some high quality spaghetti right there. Compliments to the chef!