Seeking Manifold

Search

SearchSearch
      • Attention-Head Progression
      • Low Rank Substitution
      • Residual Stream Data Lane
      • Structured Thinking
      • Virtual Layer Stacking (WIP)
      • Flow Model Training
      • KL Divergence
      • Maximum Likelihood Estimation
      • Score Matching
      • The ELBO
      • Variational Bayesian Inference
      • A Variety of Experts
      • Assembling a Face
      • Common Sense Training for LLMs?
      • LoRA Saturation?
      • Neural Cellular Automata
      • Objective Function Gaming
      • Reservoir Computing
      • The Ventral-Dorsal Split
      • The Vision System
      • Critters 2024
      • Deck Renovation!
      • Gardening 2024
      • Saying Goodbye to the Beast
      • (Another) 'Bitter Lesson' Beating
      • * in Sim
      • A Gaggle of Migos
      • Armstrong's Law of Bits and Bobs
      • Brandolini's Machete
      • CIFAR for Video
      • Embedding vs Attention and FFW Param Counts
      • Evaluating Representations from Self-Supervised Systems
      • GPT Visualizations
      • htmx ftw!
      • I Am Here
      • LLM Generation Degeneration
      • Migos
      • Model Evolution by Natural Selection?
      • Ogros Orejones
      • Predators in the Brush (A Taxonomy)
      • Residual Stream (??)
      • Streaming Data Augmentation?
      • Stupid Model Debugging Tip
      • Time as a First-Class Citizen
      • We're All Becoming PdMs?
        • 5 Alarm Fire
        • A Day's Worth of Calories
        • Biking to Work—Goofy Panniers and All
        • Damned Elevators
        • Food Security
        • I Laid Her Body There
        • Living at the Top of a House of Cards
        • Master of Scrums
        • Mom Died Today
        • More Thoughts on Mom
        • Open Source Software
        • Overshoot
        • Peak Oil
        • Ride on the Sidewalk!
        • Small World
        • Sparrow
        • Taking the Kids?
        • The Easter Island School of Resource Management
        • The End of an Orgy
        • We Burned It
      • A Conversational Work History
      • AI Research Interests
      • CLIP Guided Diffusion
      • Leaving Verizon
      • Publication List
      • Sabbatical Activities
      • Seeking Manifold As A Podcast
      • Seeking Manifold QR Code
      • Wikipedia Front Page As A Podcast
    Home

    ❯

    Distillations

    ❯

    Flow Model Training

    Flow Model Training

    Aug 09, 2024, 1 min read

    • #post/distillation

    This is a short distillation of how one trains a flow model.

    Distilled from Abbeel’s CS294 notes (see also the corresponding video).

    (I’m having difficulties getting all of the mathjax to render properly, so this is an image for now.)

    Backlinks

    • No backlinks found

    Get in touch: LinkedIn or chrissarmstrong at gmail (and put the name of this website in the subject)

    Authored with Obsidian, site generated with Quartz v4.2.3 © 2025