Home
last modified time | relevance | path

Searched defs:unk_token (Results 1 – 4 of 4) sorted by relevance

/aosp_15_r20/external/executorch/examples/mediatek/aot_utils/llm_utils/tokenizers_/
H A Dtokenization_llama.py167 unk_token="<unk>", argument
/aosp_15_r20/external/executorch/examples/mediatek/models/llm_models/weights/Llama-3.2-1B-Instruct/
H A Dtokenizer.json2405 "unk_token": null, null
/aosp_15_r20/external/executorch/examples/mediatek/models/llm_models/weights/Llama-3.2-3B-Instruct/
H A Dtokenizer.json2405 "unk_token": null, null
/aosp_15_r20/external/executorch/examples/mediatek/models/llm_models/weights/llama3-8B-instruct/
H A Dtokenizer.json2346 "unk_token": null, null