API is synchronous per thread and threads are coordinated so that
we know when we hit the last iteration everything is done.
Using join() to gate end of iterations was introducing too much
overhead to timing as verified via checking traces.