Jeff, I used a Forstner or a spur bit, so the pilot was not needed anymore than if you were drilling in a wood project. In fact, too big a pilot could throw you off, when you switched to the Forstner/spur.

If I were using regular metal working bits, such as drilling for a shifter knob, the pilot would be, as you pointed out, a must. However, I’d still, likely, use a spur or Forstner because they cut nice.

As you can see in the attached photo, it went fine. In fact, the Forster would be better than a metal bit, because the dowel would have to have the same [large] hole in both the pool ball and the wood or plywood.