X · @teortaxesTex
· X / Twitter
> Another shocking data point is DSpark's TPOT, which is only 2.9-5.2ms, indicating that the built-in neural network layer in DSpark runs exceptionall…
> Another shocking data point is DSpark's TPOT, which is only 2.9-5.2ms, indicating that the built-in neural network layer in DSpark runs exceptionally fast. The latency introduced by DSpark can basically be ignored.DSpark is a small thing… but great engineeringkarminski-牙医: SGLang 的 DSpark 实测数据在PR里放出了, 几个测试场景基本都能达到预测3