Brass is grabby. You have to be real careful drilling it on the lathe with the tailstock. It will suck the drill in and break it off.
Definitely a learning experience. My butthole puckered real tight when that bushing came flying out of the lathe at Mach 1.It takes more work. But I've found that making an arbor to hold bushings makes for easier and safer machining.