It has been my experience that if you refuse to give a reference it will get your message accross without putting you in an uncomfortable position. Even when I worked in-house I would not give a negative reference.
This is CABL.com posting #128028. Tiny Link: cabl.co/mHs8