Hybrid Encoder with Adaptive Restart

AbstractA naive application of state-of-the-art bidirectional encoders for streaming sequence tagging would require encoding each token from scratch for each new token in an incremental streaming input (like transcribed speech). …...