Data + ML

Concepts, Notes and Intuitions

GPU Essentials - A Concise Technical Guide

A concise, technical guide to GPU architecture and CUDA, showing how massive parallelism is achieved through threads, blocks, SMs, and memory hierarchies.

26 min read · 2025

Wrapping Up Our ML Foundations Journey

A reflection on our exploration of machine learning fundamentals, from mathematical prerequisites to gradient boosting.

3 min read · 2025

CuTe DSL - Notes

My notes on CuTe DSL and FA3 Dissection

66 min read · April 18, 2026

2026 · GPU · GPU-NYU
CUTLASS WGMMA on Hopper - Notes

My notes on WGMMA internals from the Colfax Research CUTLASS Hopper GEMM blog

112 min read · April 18, 2026

2026 · GPU · GPU-NYU
Investigating Flaky `test_eagle_dp` — Batch Invariance Failure on L4 GPUs

Investigative notes and fixes for test_eagle_dp CI tests in vLLM

40 min read · April 14, 2026

2026 · GPU · GPU-NYU
GEMM Kernel Optimization Notes

My notes from Simon Boehm's CUDA GEMM optimization blog

73 min read · March 29, 2026

2026 · GPU · GPU-NYU
SiLU+Mul+FP8 Block Quant Pattern Matching Pipeline - vLLM Notes

Detailed walkthrough of vLLM's torch.compile pattern matching pipeline that fuses SiLU+Mul and FP8 block quantization into a single kernel launch, covering FX graphs, matchers, and the dispatch machinery

64 min read · March 25, 2026

2026 · GPU · GPU-NYU

Data + ML

Concepts, Notes and Intuitions

GPU Essentials - A Concise Technical Guide

Wrapping Up Our ML Foundations Journey

CuTe DSL - Notes

CUTLASS WGMMA on Hopper - Notes

Investigating Flaky `test_eagle_dp` — Batch Invariance Failure on L4 GPUs

GEMM Kernel Optimization Notes

SiLU+Mul+FP8 Block Quant Pattern Matching Pipeline - vLLM Notes