Searched defs:output_ulp (Results 1 – 9 of 9) sorted by relevance
45 …const float output_ulp = fp16_ieee_to_fp32_value(output_abs + 1) - fp16_ieee_to_fp32_value(output_… in ComputeError() local
46 const float output_ulp = uint32_as_float(float_as_uint32(output_abs) + 1) - output_abs; in ComputeError() local
52 …const float output_ulp = fp16_ieee_to_fp32_value(output_abs + 1) - fp16_ieee_to_fp32_value(output_… in ComputeError() local
53 const float output_ulp = uint32_as_float(float_as_uint32(output_abs) + 1) - output_abs; in ComputeError() local