Hi Nate, Just my 2 cents worth, unless you are using flood cooling I would not increase the speed, you heat that SS and you heat treat it, then drills will break, likely taps too. I would probably decrease the feed in that scenario. With flood then I think you should be Ok up to about 1800 rpm. Are you sure it's 304 ? Which is to ask if you sourced the material or did the customer? Big also; when drilling stainless, do not try to save money with drills made in China.
It seems like when I center drill then the drill bit chatters really bad getting past the center drilled hole.
Might be you are getting things too hot with the center drill, try slowing it down. NO BLUE or BROWN chips allowed in SS.
We're not in business to make parts, we're in business to make money, making parts is just how we do that.