Posted in ai
425
6:23 am, April 2, 2026
 

install qwen coder on ollama getting it working in open web ui

Notes from AI - Research

you can download a Claude 4b model via the Ollama CLI, provided a specific variant named claude-4b (or similar, e.g., claude-3.5-sonnet:4b or claude-3-haiku:4b)

ollama search claude

Recommendation #1 (The Powerhouse)
ollama pull qwen2.5-coder:3b

Recommendation #2 (The 2026 New Arrival)
ollama pull qwen3-coder:4b - not working

ollama pull qwen3.5:4b

^^^ working

for coding use this one as its trained more on code

ollama pull qwen2.5-coder

To use it in Open WebUI:

  1. Once the download finishes in your terminal, go to your Open WebUI browser tab.

  2. Refresh the page.

  3. Click the model selector at the top (where it says Llama 3.2).

  4. Select Qwen2.5-Coder:3b from the list.


⚠️ Pro-Tip for 4GB Coding

When using a coding model, the "Context Window" (how much code the AI can "read" at once) is what eats up your remaining VRAM.

If you paste a 500-line script and the model crashes, it's because the "KV Cache" filled up your last 1GB of VRAM. To fix this in Open WebUI:

  1. Go to Settings -> Advanced Parameters.

  2. Find Context Length.

  3. Set it to 4096 instead of the default 8192 or 32k. This limits how much "history" the AI remembers but guarantees it won't crash your 1650 Super during a long coding session.

 

 

View Statistics
This Week
9
This Month
110
This Year
323

No Items Found.

Add Comment
Type in a Nick Name here
 
Search Code
Search Code by entering your search text above.
Welcome

This is my test area for webdev. I keep a collection of code here, mostly for my reference. Also if i find a good link, i usually add it here and then forget about it. more...

You could also follow me on twitter. I have a couple of youtube channels if you want to see some video related content. RuneScape 3, Minecraft and also a coding channel here Web Dev.

If you found something useful or like my work, you can buy me a coffee here. Mmm Coffee. ☕

❤️👩‍💻🎮

🪦 2000 - 16 Oct 2022 - Boots
Random Quote
therock Somewhere along this crazy road I learned (often times the hard way) the most important things I can do is be authentic, trust my gut, be the hardest worker in the room, celebrate the mistakes, be a grateful man and always remember that it's nice to be important, but it's more important to be nice.
The Rock
Latest News
## 🚀 AI Giants Hit Bullseye: Anthropic & OpenAI Achieve Product-Market Fit Anthropic and OpenAI have reached a significant milestone, finding product-market fit with their AI technologies, which means their products effectively meet the needs of their customers, driving growth and adoption. This achievement showcases the practical value of their innovations, enabling businesses and individuals to leverage AI for enhanced productivity and efficiency. With this alignment of product and market needs, these companies are poised to transform industries and shape the future of technology.