Searched defs:CreateTokenizer (Results 1 – 2 of 2) sorted by relevance
45 std::unique_ptr<Tokenizer> CreateTokenizer( in CreateTokenizer() function
165 std::unique_ptr<BertTokenizer> CreateTokenizer(const PodNerModel *model) { in CreateTokenizer() function