I think it would be hard. In my case, the reason I'm back in Australia is mostly personal. It's to be near family and in my country of birth.
I think that a permanent job with good pay would be right up there. I think that's what I have now in Australia. I think a permanent job with good pay and a visa to go with it would be what would drag me back to Canada.