How to Fine-tune GPT-3 to Get Better Results and Save Cost | NLP | Python | #gpt3 #openai

Thanks for this video. I keep getting the error "Stream interrupted (client disconnected).To resume the stream, run". How can I fix this?

Thank You Pradip.. i looked for a couple of videos of fine tuning models, but nobody could give the clarity you gave in this video. All the best

Hi Sir,
thanks for video.
Q1- How can we add parameters in fine tuning like we want to fine tune data with specific number of tokens, temperature how can we add that.
Q2- For example we want content Generation from GPT-3 Model do we need to use different prompt's for reference because we want to generate unique content every time in same domain
Q3- If we fine tune Model without max token's how can we decide max token's while using that Model because if we select less max token's then we don't get complete results with fine tuned Model.
(I am working on content generation in sport's domain like (write a unique article on how to play t20 match?))

Bhai tumse bat kese ho skti he?

Thank you for your tutorial, just the problem in real life we ​​can't share private data like that in the open model for everyone. So is there a possibility to create a private model for my own usé.
Thanks

any way to finetune SVGs

Thanks Pardip, very good detail explanation. One thing I would like to ask here, I was experimenting the fine tuning with similar data and then also I was passing generic prompt to check if chatgpt is also showing its generic knowledge. But the generic answers were not correct sometimes quite random meaningless. Also I wanted to combine the prompt to get response from my data as well as generic knowledge of chatgpt. Again it was not able to answer. Any thought around this?

thank you for your video ,
1)if i fine tune my dataset will i get the exact out put from completion, if i set temperature to zero,
2)while giving prompt ,do i have to give the exact prompt that i have set in dataset?

Very nicely explained. I need some help how can I contact you?

Great Video Pradip!
Clear explanation and clean code. Thanks!

This is really great. I have recently done some fine-tuning and understand everything you did here except for including "\n\nIntent:\n\n" in the prompt. Why did you do that?

Am I able to hire you?

Great video Pradip. Is there a possibility that a single or same prompt can provide 2 different completions? say prompt is about monthly sales figure Jan sales 10k, Feb sales 15k, Mar sales 20k and so on then the completion can be "Q1 Sales 45k" or "Yearly Sales 100k". How to manage such scenarios?

Can I fine tune with a excel file with almost 1000+ rows ?

Hi, i followed all th steps and successfully created a fine tuned model. However, after I used it, it answered all questions like an error (e.g., enter multiple symbols to the response), do you know why it happends?

Would you please refer more study material on fine-tuning mechanisms behind the scene, Thanks!

@Pradip, quick question: what's the mechanism behind the fine-tuning? Is that telling the GPT3 if I input this prompt, please response this.If I input that prompt, please response that. Just build the links between promt and response?

I'm somehow unable to proceed further, I'm stuck at this cmd:

openai api fine_tunes.create -t "intent_sample.jsonl" -m 'davinci'

I'm getting this error:

Stream interrupted (client disconnected).
To resume the stream, run:

openai api fine_tunes.follow -i ft-BAyMSys9M25GnL2IPkvzG2W6

Any idea how can I get it working?

hey bro do you know what bittensor is?

hi, watched your video and everything is clear, but i need your help with something. I'm running the codes on jupyter notebook "!openai tools fine_tunes.prepare_data -f intent_sample.jsonl". When i try running this, my whole notebook just crashes. Do you know what i can do to solve this?

Hi nice video I am working on a project related to Q and A thing where I will ask a question related to a particular specific domain along with that I will finetune the openAi api in that domain can it answer questions in an much more descriptive way, like can it type a whole paragraph of answer by itself after fine tuning.

Butt sir the cost $0.40 how this payment pay ?? It pay by us or only its show not pay anything

Great Video. But I dont think showing API key in the Video is a good thing to do.

Are you on Fiverr by any chance?

Thanks pradip. Really helpful and straight to the point videos.
I wish all the luck and blessings for your channel. Full power! 🥳

such a nice video..... sir please make a video on how to create your own ai article writing tool using python and gpt3 (with finetuned).....

Can we download this model locally? and is there any way we can train this GPT model without using the opanAI platform?

Thanks for the video and great explanation. It is better to discuss handling unstructured and unbalanced dataset(real time experiments most of the time) in nlp tasks. Can you make such video?

Very Helpful content