X · @jeremyphoward
· X / Twitter
RT Albert Gu: Transformers are better at copying, while RNNs are better at modeling "meaning-bearing words—the nouns, verbs, & adjectives that say wh…
RT Albert GuTransformers are better at copying, while RNNs are better at modeling "meaning-bearing words—the nouns, verbs, & adjectives that say what a sentence is about"Ai2: Hybrid (transformer–RNN) models are fast becoming a serious alternative to the transformer, but a big question remains: how do they process token