Ditch Public AI, Use Private One!

If you’re like me you’ve already tried some LLM services like ChatGPT, Bard, Mistral or some other fancy AI to answer your questions and do boring stuff.

AI is kinda confusing. You read things like the article, and think to yourself, yeah. If ChatGPT uses 17000 times more energy than a household, and you have to have some specialized graphics cards to handle it, AI will lead monopolies to the new level of economical domination.

That’s why I got curious about the LM Studio project:

You can see there’s a version for Mac, Windows and Linux to download. The website promises you’ll be able to run LLMs locally. So how easy it really is? Is it possible to run AI on your laptop?

I have a regular laptop without any fancy stuff, so surely it won’t be possible. Or I’ll stop because I’ll have to configure something and learn about tensors…

The installation process went smooth, and I was welcomed by the LM Studio window:

He’res the first obstacle. There is a list of multiple models I have no idea how to choose from. The first two are Llama and Mistral, so I took the extravagant decision of choosing not the…