Дифференцируемая обрезка подмножества

AbstractMulti-head attention, a collection of several attention mechanisms that independently attend to different parts of the input, is the key ingredient in the Transformer. Recent work has shown, however, that …...