Commit 0e380ff1 authored by Tomoaki Teshima's avatar Tomoaki Teshima

calib3d: compare error and threshold both in square

  * resolve #5183
parent e4cd2453
......@@ -462,7 +462,7 @@ public:
double b = F[4]*f.x + F[5]*f.y + F[ 6]*f.z + F[ 7] - t.y;
double c = F[8]*f.x + F[9]*f.y + F[10]*f.z + F[11] - t.z;
errptr[i] = (float)std::sqrt(a*a + b*b + c*c);
errptr[i] = (float)(a*a + b*b + c*c);
}
}
......
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment