Dan Fu
Assistant Professor
Computer Science and Engineering Department
University of California, San Diego
Founding SVP of Research, Together AI
Previously: PhD, Department of Computer Science, Stanford University
Research Interests: machine learning and systems, with a focus on efficiency
About Me
I'm building a world-class team at Together AI working on everything related to inference, GPU optimization, kernels, and more. Please reach out if you're interested in joining the team!
I'm an assistant professor at UCSD leading the SandyResearch Lab and affiliated with the MLSys group. I'm also Founding SVP of Research at Together AI, where I'm thrilled to be building a world-class team focused on inference optimization. My research focuses on making machine learning models faster and more efficient, especially by designing efficient ML architectures that scale well on modern hardware.
Selected Research Interests:
- Hardware-aware algorithms for ML - how can we build the best systems & kernels algorithms for ML primitives like attention on modern hardware? ThunderKittens, ThunderMLA, FlashAttention, FlashFFTConv
- Efficient ML architectures - how do we change ML models to scale better along, e.g. sequence length? Parcae, Chipmunk, Hungry Hungry Hippos, Monarch Mixer,
Some links:
- An Opinionated Perspective on the Paths to AGI
- My lab website: SandyResearch
- How I Structure Introductions to Research Papers
- The Coffee Experiment
- Stanford MLSys Seminar on YouTube (we started during the pandemic)