X · @togethercompute
· X / Twitter
The apps you use swap AI models constantly. Doing that without downtime or a bad rollout reaching users is still often manual. We rebuilt that workflo…
The apps you use swap AI models constantly. Doing that without downtime or a bad rollout reaching users is still often manual.We rebuilt that workflow based on what we’ve learned serving more than 400 trillion tokens each month.In a new technical series, our inference team will break down routing, testing, rollouts, an