Searched defs:num_experts (Results 1 – 3 of 3) sorted by relevance
149 def __init__(self, num_experts, intermediate_size, dim, target_dtype): argument
29 num_experts: int = 8 variable in ModelArgs
94 num_experts: int = 8 # Number of experts variable in ModelArgs