Notes and deep dives
Writeups derived from personal notes, then rewritten after I have built or studied something in enough depth.
13 entries
2026
Integrating the Vinardo Scoring Function into muDock
A technical deep dive into integrating Vinardo into muDock, from molecular representation and preprocessing to CPU scoring, validation against smina, and CASF-2016 results.
C++ · HPC · Molecular Docking · Drug DiscoveryDeep Dive into a Custom GPT Architecture
A from-scratch GPT implementation, its computational cost, and experiments on arithmetic and character-level language modeling.
Neural Networks · Deep Learning · Transformers · Attention · PythonIntroduction to BLAS
An introduction to BLAS routines, the roofline model, and SGEMM optimization
HPC · Linear Algebra · CFrom Self-Attention to a Small GPT
A personal from-scratch derivation of causal self-attention, starting from a character language model and ending with the core pieces of a small GPT.
Neural Networks · Deep Learning · Transformers · Attention · PythonNeural Network Training: Statistics, Initialization and Diagnostics
A structured study of neural network training dynamics, covering statistical preliminaries, loss interpretation, saturation, gradient flow, initialization schemes, diagnostic tools, and stabilization mechanisms.
Neural Networks · Deep Learning · Optimization · Initialization · Batch NormalizationEngineering MovHex: Modeling and Optimizing a Dynamic Hex-Grid Router in C
Engineering a dynamic routing engine over a hexagonal map in C, from geometric modeling to shortest-path optimization.
C · Graph Algorithms · Data Structures · Performance
2025
From Bigrams to Neural Networks: The First Step in Language Modeling
A hands-on walkthrough from count-based bigrams to a simple neural model.
NeuralNetworks · Math · Statistics · PythonBreaking the Sorting Barrier in Single-Source Shortest Paths
Exploring the ideas behind the new breakthrough paper, breaking the long-standing sorting barrier for single-source shortest paths.
Dijkstra · SSSP · Graph Algorithms · Complexity TheoryNeural Networks: Linear Regression
From math to code: build linear regression from scratch and see how it connects to neural networks.
NeuralNetworks · Python · Math
2024
Building a Simple Web App with Firebase Authentication and Firestore: A Step-by-Step Guide
Step-by-step guide to building a task management web app with Firebase Authentication.
Firebase · Firestore · Authentication · JavaScript · Web App · ProductivityBuilding a Daily Vocabulary Newsletter with Python, Google Docs, and Google Sheets
Step-by-step guide to creating a Python-powered vocabulary newsletter using Google Docs, Google Sheets, and automated email delivery.
Python · Google APIs · Google Docs · Google Sheets · Automation · NewsletterNeural Networks: Roadmap and Sources
Roadmap for the Neural Networks series and main sources.
NeuralNetworks · Math · Sources