Searched defs:BertTokenizer (Results 1 – 2 of 2) sorted by relevance
98 : BertTokenizer(LoadVocabFromFile(path_to_vocab), options) {} in BertTokenizer() function104 : BertTokenizer(LoadVocabFromBuffer(vocab_buffer_data, vocab_buffer_size), in BertTokenizer() function
102 : BertTokenizer(utils::LoadVocabFromFile(path_to_vocab), options) {} in BertTokenizer() function108 : BertTokenizer( in BertTokenizer() function