Home
last modified time | relevance | path

Searched defs:pad_token (Results 1 – 3 of 3) sorted by relevance

/aosp_15_r20/external/tflite-support/tensorflow_lite_support/cc/test/text/
H A Dregex_tokenizer_test.cc108 int pad_token; in TEST() local
126 int pad_token; in TEST() local
/aosp_15_r20/external/tflite-support/tensorflow_lite_support/cc/text/tokenizers/
H A Dregex_tokenizer.cc104 bool RegexTokenizer::GetPadToken(int* pad_token) { in GetPadToken()
/aosp_15_r20/external/executorch/examples/mediatek/aot_utils/llm_utils/tokenizers_/
H A Dtokenization_llama.py170 pad_token=None, argument