Technical ramblings

Intel GPUs, kernels, model serving, Rust, and the measurements behind them.

Rahul Nair (unrahul, GitHub rahulunair) writes measured engineering notes on Intel GPUs, XPU kernels, model serving, Rust, and machine learning.

Written by Rahul Nair, usually unrahul online and rahulunair on GitHub.

Browse by topic

Speculative decoding at 512K on Intel Arc Pro: why MTP wins early and DFlash2 wins late

intel
arc
arc-pro
xe2
xpu
sglang
llm-inference
speculative-decoding
agentic-coding

MTP and DFlash2 on four Arc Pro B70s, with XPU graph and cache fixes, native-256K benchmarks, and exact 1M retrieval.

Aug 19, 2026
47 min

Qwen3.8-27B on Intel Arc Pro: 2.82 to 59.5 tok/s

intel
arc
arc-pro
xe2
xpu
sglang
llm-inference
quantization
agentic-coding

How a four-bit Qwen3.8-27B build reached 59.5 tok/s on four Intel Arc Pro B70s and 37.8 tok/s on two B65s using existing oneDNN primitives.

Aug 16, 2026
34 min

Exposing Local Applications: Cloudflare and Gradio Tunnels

Expose local web apps, Gradio demos, TGI servers, and vLLM endpoints with temporary Cloudflare and Gradio tunnels, plus production guidance.

Nov 18, 2024
4 min

Text-to-SQL Generation Using LLMs Fine-Tuned with QLoRA on Intel GPUs

intel
dgpu
pvc1100
arc
pytorch
bigdl-llm

Fine-tune large language models for text-to-SQL with QLoRA on Intel GPUs, then compare base and adapted model inference using reusable LoRA adapters.

Dec 5, 2023
8 min

Stable Diffusion inference on Intel Arc GPUs

intel
dgpu
graphics
arc
pytorch
tensorflow

Run Stable Diffusion on Intel Arc GPUs under Linux with both PyTorch and TensorFlow, including Arc setup, package installation, and sample inference.

Nov 6, 2022
3 min

Configure Intel Arc A370M Xe-HPG discrete GPU on Linux

intel
dgpu
graphics

A step-by-step Ubuntu 22.04 setup for Intel Arc A370M graphics on Linux, including the kernel, Mesa, oneAPI, SYCL discovery, and GPU monitoring.

Oct 12, 2022
16 min

Flashcard Rust: What type is this variable again?!

coding
rust

A tiny Rust flashcard using std::any::type_name to print the concrete type of a value when inference makes it hard to see.

Mar 22, 2021
2 min

Flashcard Rust: Colon colon angle bracket or turbofish!

coding
rust

A Rust flashcard explaining turbofish syntax, why type inference sometimes needs help, and two ways to provide a concrete type.

Jan 17, 2021
2 min

Flashcard Rust: Result Type in Rust and how to handle it

coding
rust

A worked Rust flashcard about Result values, pattern matching, the question-mark operator, unwrap, and propagating recoverable errors.

Jan 14, 2021
3 min

Catastrophic Forgetting in ML

ml

A survey of catastrophic forgetting in neural networks and reinforcement learning, covering regularization, EWC, PathNet, replay, and lifelong learning.

Jul 15, 2020
12 min

Model-Free Reinforcement Learning

prose
ml

An introduction to model-free reinforcement learning through temporal-difference updates, Q-learning, SARSA, and actor-critic algorithms.

Jul 9, 2020
6 min

Reinforcement Learning Basics

prose
ml

A compact introduction to reinforcement learning terms: MDPs, policies, model-free and model-based methods, value functions, and Bellman updates.

Jul 9, 2020
5 min

Python Multiprocessing with Ray

coding

A small side-by-side example of Python multiprocessing and Ray, showing how two functions can run in parallel and scale beyond one machine.

May 23, 2020
3 min

Timing python functions

coding

A tiny Python timing decorator built around perf_counter, with installation and usage examples for measuring mean runtime and standard deviation.

Mar 23, 2020
2 min

Python concurrency lessons

coding

A hands-on comparison of Python threads and processes for downloading and processing Project Gutenberg books, with guidance on when to use each.

Mar 22, 2020
4 min

Flashcard Rust: Variables

coding
rust

A compact Rust flashcard about immutable bindings, mutable variables, and shadowing, with small programs and compiler output.

Mar 16, 2020
3 min

Flashcard Rust: Cargo

coding
rust

A practical Rust Cargo flashcard covering project creation, dependencies, builds, checks, runs, and optimized release binaries.

Mar 9, 2020
2 min

Flashcard Rust: First steps

coding
rust

A first Rust flashcard: install Rust, compile a tiny program with rustc, and run the resulting binary from the command line.

Mar 7, 2020
2 min

Monkeys, Juggling and some Golang

coding

A playful introduction to Go concurrency and goroutines, using concurrent calculations of Euler’s number to make scheduling easier to picture.

Mar 31, 2017
6 min

Borg

coding

A small Python example of the Borg design pattern, where separate class instances share state through a common dictionary.

Mar 28, 2017
2 min

Message Authentication and PRFs

crypto

A story-led introduction to pseudorandom functions and message authentication codes, showing how Alice and Bob can authenticate messages without shared state.

Feb 12, 2017
4 min

An opinionated checklist on crypto

crypto

An opinionated first-pass checklist for reviewing cryptographic implementations, from key sizes and storage to transport, tokens, and common mistakes.

Jan 26, 2017
5 min

Graduated

life

A personal note on finishing a master’s in computer engineering after two years of late nights, cloud projects, and machine learning work.

Jan 3, 2016
1 min
No matching items