Home
last modified time | relevance | path

Searched defs:prev_token (Results 1 – 11 of 11) sorted by relevance

/aosp_15_r20/external/yapf/yapf/yapflib/
H A Dlogical_line.py501 def _MustBreakBefore(prev_token, cur_token): argument
517 def _CanBreakBefore(prev_token, cur_token): argument
621 def _SplitPenalty(prev_token, cur_token): argument
H A Dreformatter.py765 def _NoBlankLinesBeforeCurrentToken(text, cur_token, prev_token): argument
/aosp_15_r20/external/executorch/examples/models/phi-3-mini/
H A Drunner.cpp57 auto prev_token = input_tokens.back(); in generate() local
/aosp_15_r20/external/executorch/extension/llm/runner/
H A Dtext_token_generator.h60 uint64_t prev_token; in generate() local
/aosp_15_r20/external/coreboot/util/kconfig/
H A Dlexer.l30 static int prev_token = T_EOL; variable
/aosp_15_r20/external/executorch/extension/llm/tokenizer/
H A Dbpe_tokenizer.cpp134 Result<std::string> BPETokenizer::decode(uint64_t prev_token, uint64_t token) in decode()
/aosp_15_r20/external/executorch/examples/qualcomm/oss_scripts/llama3_2/runner/
H A Drunner.cpp180 int64_t pos = 0, prev_token, cur_token = prompt_tokens[0]; in generate() local
/aosp_15_r20/external/executorch/examples/qualcomm/qaihub_scripts/llama/runner/
H A Drunner.cpp248 int64_t pos = 0, prev_token, cur_token = prompt_tokens[0]; in generate() local
/aosp_15_r20/external/executorch/examples/mediatek/executor_runner/
H A Dmtk_llama_executor_runner.cpp241 uint64_t prev_token = input_token; in gen_response() local
H A Dmtk_llama_runner.cpp251 uint64_t prev_token = input_token; in gen_response() local
/aosp_15_r20/external/executorch/examples/qualcomm/oss_scripts/llama2/runner/
H A Drunner.cpp256 int32_t pos = 0, prev_token, cur_token = prompt_tokens[0]; in generate() local