AI Goes Local: Run Powerful Models Right on Your Computer

Ollama and DiffusionBee

The AI revolution just got more personal. While most of us have grown accustomed to typing prompts into ChatGPT or Claude through our browsers, a new wave of tools is bringing that same AI power directly to your desktop—no internet required, no monthly subscriptions, and complete privacy.

Two standout applications are making local AI accessible to regular users: Ollama for text generation and DiffusionBee for creating images. Both represent a significant shift toward democratizing AI technology.

Ollama: Your Personal ChatGPT

Ollama recently launched a partnership with OpenAI and released a new GUI application for macOS and Windows, transforming what was once a command-line tool into something anyone can use. The app lets you download and chat with various AI models, including OpenAI’s new open-source gpt-oss models available in 20B and 120B parameter sizes.

This is significantly more user friendly than it used to be. The new interface supports file drag-and-drop, letting you upload PDFs or documents and have conversations about their contents. It even includes built-in web search capabilities, though you’ll need to enable that feature.

The performance trade-off is real but workable. The smaller 20B model can run on systems with just 16GB of memory, though more RAM certainly helps. On my M4 Mac with 32GB, responses often have a delay of a minute or so, but then come faster than I can read them. This is noticeably slower than the cloud-based services we’re used to. The key difference is that everything happens on your machine, with complete privacy.

DiffusionBee: AI Art Without the Cloud

For image generation, DiffusionBee brings Stable Diffusion to your desktop with remarkable ease. This completely free application runs locally on your computer with a one-click installer and no technical knowledge required.

The app includes text-to-image generation, image-to-image transformation, inpainting, and upscaling features—essentially everything you’d find in premium online services. Your prompts, models, and generated images never leave your device, addressing privacy concerns that many professionals in the DC area have about cloud-based AI tools.

The quality won’t match the latest offerings from Midjourney or DALL-E, but for many use cases—creating presentation graphics, brainstorming visual concepts, or just experimenting with AI art—it’s more than sufficient.

Why This Matters Now

This shift toward local AI addresses several concerns that have limited adoption in professional settings. Government contractors, lawyers, and consultants who handle sensitive information can now experiment with AI without worrying about data leaving their systems. Small businesses can access powerful AI capabilities without ongoing subscription costs.

The models available today are roughly equivalent to GPT-3.5 or early GPT-4 performance levels—a step behind the cutting edge, but still remarkably capable for most tasks. And unlike cloud services, there are no usage limits, rate limits, or monthly bills.

Both applications install in minutes and start working immediately. Ollama downloads models as needed (expect several gigabytes per model), while DiffusionBee includes everything required to start generating images.

The local AI movement represents more than just an alternative to cloud services—it’s about putting powerful technology directly into users’ hands. For the DC community, where data privacy and independence matter, these tools offer a compelling glimpse of AI’s more distributed future.

Download Ollama at ollama.com and DiffusionBee at diffusionbee.com. Both are free and work best on modern computers with at least 16GB of RAM.

Ordering New iPhones

For the crazy folks who order iPhones for Day 1 arrival, this most recent ordering process was a bit of a mess. Typically, you can pre-enter your order details in the Apple Store app and then submit it order time. This time, that system failed for 15-20 minutes for many folks, pushing back many people’s ordered by a couple of weeks. This might have been compounded by supply constraints.

So if you’re ordering at that crunch time at 8am when sales start every year, you should try to order thought the Apple Store app, but also through the Apple website. If you have an iPad, try that too at the same time.

For people who were delayed in ordering or forgot this year, you can try to get the iPhones in the Apple store. This is a site that will show you what nearby stores have availability:

https://iphonechecker.herokuapp.com/q/22201/i15ProMax/unlocked

And of course, for all the normal people, you can just wait untill November, when iPhones should just be available.

Virginians, Install the COVIDWISE App

Built with privacy potection in mind, and using technology developed by Apple and Google, the COVIDWISE app will alert you if you have encountered someone who later reported testing positive for Coronavirus. If lots of people use this or other interoperable apps from other states, it will enable easy contract tracing and allow people to more quickly quarantine, thus slowing the spread.

From the Washington Post:

The app will work outside of Virginia, but only users verified by the Virginia health department will be able to input a Covid-positive status. Per the Virginia Department of Health website, “There have been discussions regarding a federal database for positive diagnosis verification which would greatly simplify interoperability of exposure notification apps between states. It is not currently certain when this will be available.”

UPDATE: If you do every get a positive COVID test result, be sure to ask for the 6 digit pin so that you can enter your positive result into the COVIDWISE app. You need that to alert others of your result. Sadly, this isn’t given to you by default. That fact, and the lack of universal usage of the app, have limited its usefulness thus far.

Baby Tracker App

screen568x568
Have a new baby and need to track feedings, diapers, sleeping, and growth statistics? I initially thought the tried-and-true pen and paper approach would be easiest. But after reviewing most of the baby tracker apps, I found an app that is simple and easier than anything else. Most baby apps are bloated with features and ugly. Baby Tracker by nighp is an iPhone and iPad app that looks like it was designed by Apple.

One of my favorite features is the ability to use it with others. I set Baby Tracker to store its data in dropbox so my wife and I can both enter and review information. So if I do a late night bottle feeding, she can wake up and see when the feeding started and ended.

It’s the perfect app for the nervous new parent.

Magic Plan Floorplan Creator App

The Magic Plan app for iPad and iPhone deserves to have “Magic” in it’s name.

I recently helped an Arlington, VA, customer who had a new iPad and had just moved. They wanted to build a floorplan of their place. Using Magic Plan allowed us to create a floorplan quickly by clicking on the corners of the rooms. You  align the rooms, add in windows, make a few adjustments to the estimated dimensions if needed, and you’re done. Once you get used to it, you can have a house done in under an hour.

Then you can even add in furniture to your floor plans or see what it looks like if you do a construction project and knock down a wall.

The app is free to use and requires a subscription if you want to export PDF files for use by an architect.