Sticky Jump Diffusions: A Unifying View of Masked, Continuous, and Hybrid Diffusion
P. Jutras-Dubé, P. Pynadath, J. Lu, Y. Gao, and R. Zhang. (2026). "Sticky Jump Diffusions: A Unifying View of Masked, Continuous, and Hybrid Diffusion." arXiv preprint arXiv:2607.10951.
Sticky Jump Diffusions (SJDs) are continuous-time Markov processes on R^d whose discrete anchors are token embeddings. In the forward process, anchors release mass at a hazard rate that diffuses in continuous space; time reversal pairs a score-driven SDE with a sticky jump kernel governed by flux balance. Scores and reverse hazards are estimated through Denoising Hazard Matching using simulation-free cross-entropy training. The framework unifies masked, continuous, and hybrid diffusion as limiting cases and explains features each treats as given. Beyond these limits, the unsticking kernel becomes a design space: cross-position blending corrupts each position toward a blend of its neighbors’ clean values or embeddings, improving results on CIFAR-10, Text8, and Sudoku.