So, tried some knife-chisel-router plane. Not good.
When I try to go "north" I get tearout, but if I flip the board to smooth the top part, I cannot get the router plane to track (hangs up on the blade). Plus I think the grain direction is a factor. I'm obviously doing something wrong.
So, my next question, if using a "real" router, I assume it has to have the plunge base?
