Penn Treebank Tokenizer
method
ID: penntreebanktokenizer
Entity Details
Basic Information
Entity ID
penntreebanktokenizer
Entity Type
Method
English Label
Penn Treebank Tokenizer
Russian Label
Токенизатор Penn Treebank
Kazakh Label
Penn Treebank токенизаторы
Frequency
1
Description
English Description
A tokenizer compliant with the Penn Treebank standards.
Russian Description
-
Kazakh Description
-