Searched defs:softmax_d (Results 1 – 1 of 1) sorted by relevance
934 auto softmax_d = at::empty({batch_size, num_heads, seqlen_q_rounded}, opts.dtype(at::kFloat)); in mha_bwd() local1158 auto softmax_d = at::empty({batch_size, num_heads, seqlen_q_rounded}, opts.dtype(at::kFloat)); in mha_varlen_bwd() local