Yes, it goes right back to a time when it would be difficult, for example, to access a judge in order to secure a warrant. Hence the provisions allowing for arrest without a warrant.
As to the precise date and whether it's in the initial Dominion Elections Act of 1874, I don't recall. It is quite far back.