Character Level Segmentation

method ID: characterlevelsegmentation

Related Papers

On Target Segmentation for Direct Speech Translation

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

Recent studies on direct speech translation show continuous improvements by means of data augmentation techniques and bigger deep learning models. While these methods are helping to close the gap between …...

29145

Bridging the Gap between Subword and Character Segmentation in Pretrained Language Models

Authors: nan

Publication: TIPSTER (2023)

DOI: nan

AbstractPretrained language models require the use of consistent segmentation (e.g., subword- or character-level segmentation) in pretraining and finetuning. In NLP, many tasks are modeled by subword-level segmentation better than by …...

20052