I think that's true. When I go shopping or to the grocery store, my son asks me why no one speaks to him in French and why we can't do grocery shopping in French. However, sometimes I meet students who have been taught in French immersion and who provide services in French. When that happens, my son is surprised.
I think that, yes, we speak French most often at home, but it should be done more outside the home.