Multimodal models and agents, and how to train, measure, and ship them.

About

Portrait of Sheng-Tse Lin

Hi, I'm Sheng-Tse, and you can also call me Hunter. I'm a master's student at Carnegie Mellon University, where I do research with Prof. Bhiksha Raj and Massa Baali at the Language Technologies Institute. I primarily work on open source, agents, and applied research, and this site is mostly a place to keep track of what I'm building and learning along the way.

My research focuses on multimodal models and agents, with a particular emphasis on agentic reinforcement learning, efficient LLM systems, and making models explainable and rigorously evaluated.

Now

  • M.S. student at Carnegie Mellon University, through Dec 2026
  • Building Argonauts Code, one orchestrator for every coding agent
  • Teaching assistant for 11-785 Introduction to Deep Learning
  • Capstone project with Smile Line AI: on-device vision for clinical photography

News

  • My fix to FlashInfer’s Mamba state-update kernels was merged, so head dims that aren’t multiples of 64 now compile and give correct results.

  • Released Argonauts Code, one orchestrator for every coding agent: Claude Code, Codex and others build in parallel and review each other’s work.

  • Released the code and data for AcoustiClaim. The paper is under review at ICASSP 2027.

  • Joined Smile Line AI as a Forward Deployed Engineer.

  • Released jupynvim, Jupyter notebooks and remote kernels in Neovim.

Publications

AcoustiClaim: A Numeric Claim Benchmark with Instrument Ground Truth

Sheng-Tse Lin, Siyuan Zhai*, Chien-Liang Kuo*, Massa Baali, Bhiksha Raj

Under reviewICASSP 2027PaperCode

* equal contribution

All publications

Thanks for scrolling all the way down. Say hi anytime.