Sequence Parallelism: Long Sequence Training from System Perspective

38720

Knowledge Triples

Source Entity	Relationship	Target Entity
Ring Self Attention Method	integrates	Self Attention Method
Sequence Parallelism Method	enables	Efficient Attention Method