2800/896*16 = 50 ✅ 1600/384*7= 29,166 ❌ Bloomberg should learn arithmetic. Activated parameters cannot be calculated from expert sparsity ratio alon…
2800/896*16 = 50 ✅1600/384*7= 29,166 ❌Bloomberg should learn arithmetic. Activated parameters cannot be calculated from expert sparsity ratio alone, at a minimum there's the attention backbone.…