Pular para o conteúdo
← Back to Skalablog

Published article

Uncensored Local LLMs for 8GB to 24GB GPUs

Software Engineering

Uncensored local LLMs are standard open-weight models with refuse-to-answer behavior removed by weight editing, and fitting one to your GPU means adding the weights file to the context cache. The arithmetic is unforgiving: a 27-billion-parameter model at 16 bits needs about 54 GB, while a ternary build of the same model ships as a 5.95 GB file.

Turn a walkthrough into an article with Skala Blog

The hardest part of this subject is not finding files. It is keeping the numbers straight: which bits per weight came from which card, which refusal count belongs to which prompt set, and which speed came from a base model rather than the build you downloaded. A 23-minute video can carry all of that detail, and a transcript is where the detail usually dies. Skala Blog turns a YouTube URL into a transcription and then a structured article, keeping the tier picks, the arithmetic and the caveats in written form. If you have recorded an explainer like this one, paste the link and let the tool do first draft.

Teams building their own tooling around these models, including the Brazilian developer community around Dev doido and the Crazystack TypeScript stack at crazystack.com.br, tend to hit the same problem: knowledge lives in video and never reaches the docs.

Run these models on your own machine and on your own prompts. A build with its refusals removed will answer what you ask, so the request is yours to own.

Source video