How do I drill a hole straight through a pipe?

I often want to drill holes straight through pipes for bolts and such. Most of the time the hole on the other side will be left or right, up or down from the original hole. Without expensive jigs and all, how does one do that consistently? (I have a drill press & it helps with the up and down displacement, but not the left to right displacement).