Yes, that's where I was leading.
As a general rule, they would be exempt from Canadian tax, unless they had some Canadian connection, for example, carrying on business in Canada. In that case, where you're not in a country that has exemption from Canadian tax such that you'd be exempt under section 81, I think you'd still be taxable in Canada.