Runtime Compute
otherentity
ID: runtimecompute
Related Papers
DeFormer: Decomposing Pre-trained Transformers for Faster Question Answering
AbstractTransformer-based QA models use input-wide self-attention – i.e. across both the question and the input passage – at all layers, causing them to be slow and memory-intensive. It turns out …...