Хиберт
method
ID: hibert
Related Papers
HIBERT: Document Level Pre-training of Hierarchical Bidirectional Transformers for Document Summarization
AbstractNeural extractive summarization models usually employ a hierarchical encoder for document encoding and they are trained using sentence-level labels, which are created heuristically using rule-based methods. Training the hierarchical encoder …...
Stepwise Extractive Summarization and Planning with Structured Transformers
AbstractWe propose encoder-centric stepwise models for extractive summarization using structured transformers – HiBERT and Extended Transformers. We enable stepwise summarization by injecting the previously generated summary into the structured transformer …...
Hierarchical Transformer for Task Oriented Dialog Systems
AbstractGenerative models for dialog systems have gained much interest because of the recent success of RNN and Transformer based models in tasks like question answering and summarization. Although the task …...