Skip to content

OPENNLP-1885: Add subword API and WordPiece encoder, remove BertTokenizer - #1165

Open
krickert wants to merge 8 commits into
apache:mainfrom
ai-pipestream:sentencepiece
Open

OPENNLP-1885: Add subword API and WordPiece encoder, remove BertTokenizer#1165
krickert wants to merge 8 commits into
apache:mainfrom
ai-pipestream:sentencepiece