I was certainly aware that the minister had his own letterhead. I think from time to time the minister purchases, or at least he had an assistant purchase, out of his pocket, some stationery and some stamps.
I have to admit that I have never put a stamp on a letter, so I wouldn't know where to find them.