Searched defs:split_unknown_characters (Results 1 – 1 of 1) sorted by relevance
51 bool split_unknown_characters, const WordpieceVocab* vocab_map, in LongestMatchStartingAt()163 bool split_unknown_characters, const WordpieceVocab* vocab_map, in TokenizeL2RGreedy()213 bool split_unknown_characters, const WordpieceVocab* vocab_map, in WordpieceTokenize()