I cannot explain why. It is for historic reasons. The headquarters has always been in Ottawa, since income tax collection began, in 1917, I believe. The taxes were, in principle, to be temporary. Over time, offices have been opened up throughout the country. I am not going to make something up, because there is nothing else to say. It is historical.
On May 6th, 2008. See this statement in context.