Searched defs:num_blocks_per_chunk (Results 1 – 3 of 3) sorted by relevance
165 num_chunks, num_key_value_heads, num_blocks_per_chunk, head_dim, max_cache_size argument189 num_blocks_per_chunk, argument230 num_blocks_per_chunk, argument
21 def check_all_chunks_same_num_layer(num_blocks_per_chunk): argument
538 const int64_t num_blocks_per_chunk = start_block_idx_per_tensor_chunk.back(); in get_chunk_cat_metadata() local