Justin T ChiuJustin Chiuhttps://justinchiu.netlify.app/Character prefix completionhttps://justinchiu.netlify.app/blog/completion/https://justinchiu.netlify.app/blog/completion/Sampling given character prefixesThu, 09 Jan 2025 00:00:00 GMTDifferentiating through optimization with the IFThttps://justinchiu.netlify.app/blog/ift/https://justinchiu.netlify.app/blog/ift/Differentiating through optimizationThu, 26 Mar 2026 00:00:00 GMTDefinitions of Memorizationhttps://justinchiu.netlify.app/blog/memorization/https://justinchiu.netlify.app/blog/memorization/Information-theoretic definitions of memorizationMon, 16 Jun 2025 00:00:00 GMTRL should be the same shape as pretraininghttps://justinchiu.netlify.app/blog/opinionatedrl/https://justinchiu.netlify.app/blog/opinionatedrl/Token-level policy gradient is correct, average over batch tokens, and a packed batch is a replay bufferWed, 10 Jun 2026 00:00:00 GMTDifferentiating through an associative parallel scanhttps://justinchiu.netlify.app/blog/pscan_diff/https://justinchiu.netlify.app/blog/pscan_diff/Some calculus busyworkMon, 08 Jan 2024 00:00:00 GMTFirst posthttps://justinchiu.netlify.app/blog/setup/https://justinchiu.netlify.app/blog/setup/First postWed, 20 Dec 2023 00:00:00 GMTSFT is bad RLhttps://justinchiu.netlify.app/blog/sftrl/https://justinchiu.netlify.app/blog/sftrl/RL is better than SFTMon, 14 Jul 2025 00:00:00 GMTWhat objective is STaR optimizing?https://justinchiu.netlify.app/blog/star/https://justinchiu.netlify.app/blog/star/Everything is a latent variable modelSat, 27 Apr 2024 00:00:00 GMTSum-and-Sample RL: Replay Buffershttps://justinchiu.netlify.app/blog/sumsamplerl/https://justinchiu.netlify.app/blog/sumsamplerl/The math behind replay buffersSat, 09 Aug 2025 00:00:00 GMTTree RLhttps://justinchiu.netlify.app/blog/treerl/https://justinchiu.netlify.app/blog/treerl/An unbiased policy gradient estimator for branching rolloutsTue, 13 Oct 2026 00:00:00 GMTVariational Autoencoders from First Principleshttps://justinchiu.netlify.app/blog/vae/https://justinchiu.netlify.app/blog/vae/Brute-forcing VAE mathMon, 04 Aug 2025 00:00:00 GMTVariational inference: Ising modelshttps://justinchiu.netlify.app/blog/vi/https://justinchiu.netlify.app/blog/vi/Variational inference for a simple Ising modelSat, 30 Dec 2023 00:00:00 GMTWhy Routing Replay in MoE RL is Necessaryhttps://justinchiu.netlify.app/blog/weakening/https://justinchiu.netlify.app/blog/weakening/Unf***ing Your RL Gradient EstimatorWed, 03 Dec 2025 00:00:00 GMT