$1000 32GB VRAM Triple 3060 GPU Optiplex Local Ai Server

I had an unused older optiplex mid tower (MT) sitting in a corner doing nothing and I though maybe I can turn that into some sort of local ai rig on the cheap. I had already been exploring down budget my 32 GB VRAM 3060 trio performance on AM4/AM5 and my Z440 platforms so this seemed like a very cheap option to eval.

The Z440 and AM4 both have higher idle watts consumed then I had hoped for as I know the budget class buyers of AI are more price sensitive to higher electrical rates and the impact that has on anything that would run 24/7/365 like a local AI rig should. I wanted to see what the performance delta between an AM4 and a older i7 7700 class of models like  Gemma 4 35B A4B MoE. I am glad I did.

Optiplex 7050 MT Overview

The older Optiplex lineup among the most popular starting points for homelabbers and has been for many years. There are a few reasons why that make a lot of sense. Dell Optiplex 7050 MT was a mass produced as the higher tier Optiplex in the 2017 timeframe. These often ship with what for their time was a upper end i7 7700 CPU.

Lot’s of people have them already so this seems like a valid target for me to turn it into a local ai server. After spending some time browsing the /r/sleepingoptiplex threads of ppl hacking up optiplexes and bending them to their will I had a spark of inspiration that may solve most of the common case, power and mobo-not-standard-atx issues. I would transplant this onto the hanging GPU mining rig frame and by doing so address all of those complaints. It also is nearly silent at idle and not really loud at load, always a welcome surprise. The open air frames have superior cooling profiles over enclosed cases without heavy duty fans.

Intel CPUs have rather low idle vs their AMD counterparts prior to the 9000 series AM5 lineup. With the 3x 3060 GPUs I recorded 55W idle with the Optiplex vs 85W on the AM4 with the exact same OS, literally I pull and swap NVMe like its nothing also to avoid as many software issues as I can. My Optiplex came with an i7 7700 and 16GB ddr4 2400 in a 2x8GB configuration. It has a 256 NVMe Samsung P961 and that is pretty much it. Let’s take a look at all the parts that are on this build.

32GB $1000 Triple 3060 Ai Server Build Parts

There is some good points to make note about here. First off I am not suggesting you ever go out and buy a 3060ti 8GB GPU to use for local ai tasks. 8GB VRAM is just not a size to spend money on really. However this was for a long time the #1 GPU in the world for availability so without a doubt many readers and viewers already have one. Second, this is not even a strong recommendation to go the 3060 12GB route. Their performance for specific tasks like text chat and even light agentic workflows is surprisingly decent as we will see in the benchmark section so they should be considered in the “low budget” range. Parts to build an OptiPlex while it does work out cheaper, does not get you the parts to plug into the motherboard that you may need to have a uninterrupted reboot cycle (bios warning halts) I would factor that in.

Additionally you will need to make a decision on risers. You have options but as I showed that was 1 full x16 and 2 powered usb based risers for my 3 GPUs but that could be fewer depending on how you setup your rig frame.

Additional Optiplex Features

Intel has an pretty good iGPU offering on the i7 7700 the UHD 630 that is so far working great for desktop tasks for me. If you virtualize your desktop in Proxmox this is also a pretty good utilization for an onboard iGPU. That allows for it to pass-through on a AI server to a dedicated VM like my desktop CachyOS instance in this case without needing to use a VRAM-valuable NVIDIA GPU, WIN! It also provides a potential to be utilized for other “lesser” GPU tasks like video processing in frigate, transcoding in handbrake, transcription with whisper and even light retro gaming and probably emulation. It does not support SR-IOV but does support Intel’s Graphics Virtualization Technology (GVT-g) which I am hopeful can allow me to have 2 desktops virtualized with 1 using an HDMI and the other using a Display Port. To get the more polished SR-IOV you need to opt for a 12th gen Intel CPU or

The Optiplex does need to have a new CPU cooler and backplate once you remove it from the case, as the case has a built in non-removable backplate. Any 1151 socket cooler should work well here, just make sure you get a backplate with it. I used a old cheap one I have had since probably 2015 and it worked fine, the i7 7700 is a 65w part so it is not hard to keep cool. For sure change the paste also, it is sure to be nearly cement by now if it is the original.

This is not your standard mobo, so you must use some specialized standoffs to ensure that it is properly supported and does not short out. They come in a double-sided female and a standard setup and usually with several heights. The double sided ones I am using for this I am going to end up taping out new holes for and threading those in also from the reverse. That makes it at least not be a task that requires me to re-thread the hole, trust me that saves a lot of pita and metal shards.

Local Ai Performance and Benchmarks

Gemma4 26B A4B in Q4 from Unsloth is highly likely to be a target you are interested in running on a 24GB footprint of VRAM as it fits well, has good context length capabilities and also is multimodal. This makes for very good end user experience and can even be configured to leave the 8GB GPU to possibly run other tasks on your system. I am thinking an LXC that hosts all my GPU optimal spillover homelab apps will be very nice. Frigate, OCR, TTS, and Jellyfin stuff like that and embedding model. This is the Optiplex 2400MT i7 7xxx gen rig BEATING the AM4 5950x 3200MT ever so slightly, but rather consistently, in Prompt Processing. This is surprising in a great way! I do not have an explanation for you on this but I will take it as a win.

However that win only extends to prompt processing. For Text Generation we are spot on the same and that is likely just the performance the GPUs can deliver being fully tapped out. Mind you that is the 3060ti 8GB on a full x16 wide/elec slot and both of the EVGA 3060 12GB dual fan GPUs are on powered risers connected to the x1 slot and x16 physical/x4 electrical lanes powered from the Intel Q270 chipset. I think this is simply a very accurate representation of what the GPUs offer maxed out.

Now onto the smarter but much slower dense model that is still all the rage and for all the right reasons, Qwen 3.6 27B Q4 and this one I think is an important counterbalance to showcase as it hits some performance numbers that for agentic work, would not be good enough to wait for it. However that does not change based off the platform you are running the 3060s off. It is rather more a function of you want that 932GB/s a 3090 hits to really process as fast as is possible over something like the 360GB/s you get on the 12GB 3060 or 446GB/s you get with a 3060ti GB. Running this on either the AM4 or Optiplex does not really alter that takeaway. Now if you are looking into just a chat use case, it may be much more palatable. This is merely a 1-ish TPS difference however it is yet again consistent on the text generation side.

Indeed it is also slightly faster on the Optiplex yet again. Yes I like triple checked however hitting around 1000 TPS peak for PP and 18 TPS peak for TG is not going to make a happy, snappy agentic setup.

The prompt processing yet again landed it’s 3rd edge out win for the OptiPlex which I think this helps to illustrate that there may be an over indexing on importance around getting all the PCIe lanes at the GPUs max capable speed if you are strictly looking at doing llama.cpp based inference. That surprised me a bit and this was not something we had prior tested for. It does however make sense in a specific regard, we already knew that for llama.cpp based inference we do not see heavy PCIe bus bandwidth utilization after the model loads even on slower Gen3 x1 speeds that the USB risers negotiate at so cutting a gen, a 50% reduction in bandwidth, making similarly no measurable impact does at least pass the early sniff test. Filed under things I learned along the way. There are of course *’s galore on all this like if you use vllm, the PCIe bandwidth demand will be much higher (although how much real world performance does it boost is now also a good question in my mind to explore as well.

Accompanying Video on YouTube (BIG Thanks Members and Subscribers!)