Is Open Webui The Ultimate Ollama Frontend Choice?

WEBUI_AUTH=false

Look into openwebui page models... Those things can help to cutomize more the llm`s --- creating more accurate answers ... while using...

I am getting- WebUI could not connect to OllamaTried - almost everything , deleted docker image container, reinstalled but till same error even tried on VM on different distro still same error.

no code interpreter?

Great content. I wish updating the Open webUI was easy for update directly on the web interface

How can I add Speech to text capability to my model while using React? Can I copy web gui?

Can it do LoRA?

I watched your video about Msty. I installed it and never looked back.

Msty is better i think 🤔

MY EYES!!!!!!! Dear god, dark mode please! .....ouch
┻━┻ ︵ ＼( °□° )／ ︵ ┻━┻

I can appreciate your sense of humor. i just wish i was smart enough to get your goat. this is a case that it doesn't matter how early i get up in the morning. Your dedication and and willingness to teach is above board. the fact that you have a intuitive ability to do it as well as you is beyond irritating. you've made me require a different excuse for why i'm so damn slow at grasping this stuff. it's not like i wasn't there when my buddy up graded to the apple II then the mac. there were no apps or software. if you wanted your machine to do somthing you had to tell it. wow i'm not quitting . ah i got it. even though im genx im on the cusp of being a boomer.

Can Llama AI tell me how to cheat in video games ? Cuh google ai wont.
Also, can llama AI draw photos ?

As of now there are no ways to use your own vector DB or define the own embedding process to create a document
How to work with AzureChatOpenAI?
I have my own functions which uses a custom Vector DB and generates answers. How to use that in OpenWebUI?
Can I use Azure AD instead of RBAC?

I tried to install it but it's so much of a hassle. There on it's github page it says "Effortless setup" but I don't see how having to install kubernetes or docker just to install this UI is effortless. I just want a windows installer and that I'd call effortless. But because I use the AI for text prompts only I prefer a thing called cmder which is a better version of a cmd and then I export all the output into a txt or any document I want.

s there a way I can add parsing in open web ui, I want to parse the documents locally before sending it to local ollama models

Excellent review.
Your voice and mannerisms were made for this.

Good day,

Matt, hopefully, this is my last question about the Private GPT installation. My laptop has arrived.

I have installed an M.2 2T primary drive and a secondary 2T SSD.

Q: After installing Ollama, Docker, and WebUI, can the models be stored (directed) to the secondary SSD to preserve space on the primary M.2 system SSD?

If so, when do I pick where to store the models during their installation?

would love to see a follow up detailed update review. love the level of detail in this one

Thank you very much, this is super helpful

Hi : ) Thanks for nice review. Like your voice : ) Btw. there is no need to create account. During container creation it is possible to add environment variable -e WEBUI_AUTH=False (it is in doc)

I can connect my downloaded Models from ollama. They don’t show up on the WebUI.

Very clear presentation; thank you!

Matt, I just installed Ollama and started using llama3.1 via the Windows cmd prompt. Now I need to install Webui and I followed you until you mentioned docker. You lost me after that. I need the procedure for installing Webui, and I assume I need docker. However you go through lots of details that seem important, but you don’t follow through for me. But what I’m saying is I need just more direct instructions for getting Winui to work without using the cmd prompt window. Thanks for your informative series. Howard from Detroit.

Hi Matt, as always, your demos just make things so clear : would you plan a demo about "custom tools" integrations ?... and add a cutom one ?

Have you looked at anythingLLM yet? That's another UI tool that has a lot more functionality then open-webui. I'm still using open-webui but a lot less.

@technovangelist thank you for your video. You mentioned a chart, do you mind sharing it?

The new GPT4ALL seems promising, but I don't like the fact it does not have a way to create models or customizing more, in addition. It has some issues while referencing, there is also one more tool which is LM-STUDIO.

I love Open WebUI. I can download a GGUF model in hugging face and convert directly into Ollama format in minutes using the GUI. And TTS is fantastic, hands free, I can talk and listen. I even installed new voices. And I can web search, RAG, many features indeed ! ❤❤❤

open webui came a long way in the last 2 months

A very good explanation 🙂 but how will you integrate this tool with your code by integrating ollama api to the web api? if so then how?

What is the best way to Integrate with Comfyui and Stable Diffusion?

Hi Matt,

how much ram do you have in your machine?
I have 16 gb ram, I could only download a 3GB Size of model with docker

If you don't want to use docker just use podman.. its the same command just podman instead of docker

what pain to get working with docker desktop and GPU support

I installed it and it seems useful. There's a call feature now, but I haven't gotten it to work yet. MIght be a killer feature when I'm using my own llm from a mobile device. I use wireguard to connect to my home instance when I'm away.

I can't use light mode anymore. I got a terrible illness on my eyes, on the retinas, which I can't read almost anything on a white bg. It simply hurts my eyes. I still can see white over dark, but I need lots of contrast. 😮

I Liked and Subscribed.

Hello Mat, I was one of the first group of STS Space Shuttle programmers 40 years ago while still in my early days of college. It's great to see how programmers of far ago and today's brains use the same synapse pathways.

I have been with my hidratespark pro 32oz for three weeks now - love it. I plan to buy a small one (16oz?) to fit into my vehicle.

2. Which do you recommend, anaconda or Docker?

3. And what are we to do with the Modelfiles section?

4. What controls compare to Openai’s Custom Instructions in open web UI?

5. The ‘/’ features appear pretty helpful - I have to rewatch your explanation.

6. where to find user manual instructions for all of the open web UI features and how-tos.

Thank you for the video.
Happy Hidration.

Great video thanks!

First meet today. Subsribe now.

your content is very hight quality... thanks Matt

How do I connect azure OpenAI embedding ?

I like OOGABOOGA for chat, AnythingLLM+OLLAMA for RAG. But thank you. It was interesting and you present very well.

Thx for video. A question about the combo ollama/openwebui/docker. I’ve this configuration and all is ok. I’ve a goal to raise. I want to specialize a LLM pre-trained. Training it with a large base of data about coding in a proprietary language not popular. Only 2 hundreds programmers use it.
My question is:
- which generic and light LLM can i use?
- i use some Python script to train a LLM (in my case test with Phi3:Mini). I found a problem to solve. When i try to load the model something wrong. Infact Python says that not find the path of the model, usually ~./ollama/models/…
- I note LLM are encrypted SHA256! Peraphs is a problem!

Can you help me to do this training?

Can you give some documentation or tutorials?

Thx in advance. Have a good day.

Sorry for my bad english. I’m an italian developer.

Looks excellent for self hosting a LLM for friends and family to use. Instead of continuing to feed user prompts to the beast (openai).

dark mode should die? oh nooo, a terrible thing to say

I got addicted to ollama last year and got to play around with openwebui when it was still called ollama webui
The name change messed up my docker installs, not gonna lie
But then, we decided to try it as a corporate AI companion, but as it was a testing phase, we didn't scale our cloud very high, so it was pretty slow
On my machine though, I wanted to try and use every bit of feature, which led me to install and learn ComfyUI, and while the image generations options from openwebui is limited whatever the backend you use, it's still useable

I'm in agreement with Matt about dark mode. Hard to read. That's why I use discord as little as possible.

keep getting this after signup : Account Activation Pending
Contact Admin for WebUI Access
Your account status is currently pending activation. To access the WebUI, please reach out to the administrator. Admins can manage user statuses from the Admin Panel...