I cannot give you an answer on rights-holders because the 2006 post-censal survey on the vitality of official language minorities was the first time we were able to enumerate rights-holders according to the three criteria set out in section 23 of the charter.
If we use only the most important criterion in Canada outside Quebec, that of French as a mother tongue, the number has always increased and continues to do so.