Searched defs:FindTokenizationRange (Results 1 – 2 of 2) sorted by relevance
61 const TokenizationCodepointRangeT* Tokenizer::FindTokenizationRange( in FindTokenizationRange() function in libtextclassifier3::Tokenizer
104 TEST(TokenizerTest, FindTokenizationRange) { in TEST() argument