method ID: hibert

Related Papers

HIBERT: Document Level Pre-training of Hierarchical Bidirectional Transformers for Document Summarization

Authors: nan

Publication: TIPSTER (2019)

DOI: nan

AbstractNeural extractive summarization models usually employ a hierarchical encoder for document encoding and they are trained using sentence-level labels, which are created heuristically using rule-based methods. Training the hierarchical encoder …...

39465

Stepwise Extractive Summarization and Planning with Structured Transformers

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractWe propose encoder-centric stepwise models for extractive summarization using structured transformers – HiBERT and Extended Transformers. We enable stepwise summarization by injecting the previously generated summary into the structured transformer …...

30383

Hierarchical Transformer for Task Oriented Dialog Systems

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractGenerative models for dialog systems have gained much interest because of the recent success of RNN and Transformer based models in tasks like question answering and summarization. Although the task …...

21326