Home
last modified time | relevance | path

Searched refs:TokenizeSubstring (Results 1 – 2 of 2) sorted by relevance

/aosp_15_r20/external/libtextclassifier/native/utils/
H A Dtokenizer.cc179 void Tokenizer::TokenizeSubstring(const UnicodeText& unicode_text, in TokenizeSubstring() function in libtextclassifier3::Tokenizer
226 TokenizeSubstring(unicode_text, span, &result); in InternalRetokenize()
231 TokenizeSubstring(unicode_text, span, &result); in InternalRetokenize()
H A Dtokenizer.h113 void TokenizeSubstring(const UnicodeText& unicode_text, CodepointSpan span,