OPENNLP-1885: Add subword API and WordPiece encoder, remove BertTokenizer - #1165

Open

krickert wants to merge 4 commits into

apache:mainfrom

ai-pipestream:sentencepiece

Commits on Sep 4, 2026

OPENNLP-1885: Add subword API and WordPiece encoder
krickert
committed
6491446
OPENNLP-1885: Cover WordPiece parity and model ids
krickert
committed
c7ebfce
OPENNLP-1885: Align WordPiece API and DL callers
krickert
committed
141160e

Commits on Sep 5, 2026

OPENNLP-1885: Merge current main and resource installer
krickert
committed
d130e1c