No. There are public services that can be efficiently and effectively provided by the public sector. The private sector is not necessarily better at providing those services, because those services don't necessarily generate profit, which is what the private sector is interested in. Those services serve the welfare of society as a whole.
I'm talking about services that businesses benefit from: having efficient water, roads, electricity, education, and health care all publicly provided. You get better service, and it's more efficient if the public sector is providing it. The research shows that to be the case.