Article
28336 discoveries · Hand-picked discoveries from the open web, newest first.
-
fluffy rambles: Accidental upgrade
So, a bunch of my services run, or rather, ran , on an old Intel NUC 8 that I bought back in 2020 and have mostly used as a “random stuff goes here” server. A year and a half ago the fan on it died, so I bought a cheap replacement fan on Amazon and all was good. And over time I started hosting more and more stuff on it, such as my owncast and PeerTube instances, and a few things for my home media streaming setup (which are also now accessible while traveling).
busybee · EN
-
Building Aligned Intelligence System. Part I: Creating GPT Assistant
In recent years, the field of natural language processing has witnessed a remarkable breakthrough with the advent of Large Language Models (LLMs). These models have demonstrated unprecedented performance in a wide range of language tasks, from text generation to question answering. However, the mathematical formulation of these models and the techniques used to fine-tune them for specific ta...
AstraBlog · EN
-
Building Aligned Intelligence System. Part II. Improving Large Language Models
In this post we will look at different techniques for steering LLMs behaviour to get desired outcomes, starting with some basic general principles such as writing a good prompt and ending with fine-tuning and augmenting models with external knowledge. Methods discussed in this post are mainly aimed at improving LLMs reliability and ensuring the consistency and factual accuracy of their...
AstraBlog · EN
-
Exploring Parallel Strategies with Jax
Training large language models either like GPT, LlaMa or Mixtral requires immense computational resources. With model sizes ballooning into the billions or sometimes even trillions of parameters, specialized parallelization techniques are essential to make training feasible. In this post, we’ll explore implementing some of these scaling strategies in Jax - a Python framework designed for hig...
AstraBlog · EN
-
Transformers Inference Optimization Toolset
Large Language Models are pushing the boundaries of artificial intelligence, but their immense size poses significant computational challenges. As these models grow, so does the need for smart optimization techniques to keep them running efficiently on modern hardware. In this post, we’ll explore key optimization strategies that are making LLMs faster and more memory-efficient. We’ll star...
AstraBlog · EN
-
Speculative Decoding: The Art of Guessing Well
Large Language Models spend most of their decoding time not computing, but waiting: every new token requires reading all of the model weights from memory, only to multiply them by a single vector. What if the model could check several tokens for the price of one? In this post we’ll derive speculative decoding from first principles, build a general framework that covers every modern drafte...
AstraBlog · EN
-
Running Kubernetes with a GPU Inside WSL2 on My RTX Laptop
Published: 2026-04-22 I wanted a local environment where I could: run Kubernetes schedule GPU workloads experiment with CUDA / inference / device plugins avoid renting cloud GPUs I used a Lenovo Legion laptop with an RTX GPU. The working stack was: Windows 11 + NVIDIA driver (WSL-enabled) WSL2 (Ubuntu 24.04) K3s (containerd) NVIDIA Container Toolkit NVIDIA device plugin The non-obvious part was that the NVIDIA device plugin itself had to use runtimeClassName: nvidia . Prerequisites You need: Windows 11 NVIDIA GPU (RTX in my case) Latest NVIDIA driver with WSL support WSL2 installed Inside WSL:
Andrey Krisanov · EN
-
My Modern C++ Setup on macOS and Apple Silicon
Published: 2026-05-19 I’m starting to learn modern C++, so I wanted a repeatable development setup on Apple Silicon: use a modern LLVM/Clang toolchain build projects with CMake and Ninja get proper language-server support in VS Code and Helix use sanitizers and static analysis from the beginning keep the setup practical This cheatsheet assumes that Homebrew is already installed.
Andrey Krisanov · EN