We need to make a distinction here between the Internet and the web. You can have technology that is designed for the Internet and for mobile devices that is not apps that are available through the app store.
When Google and Apple and their iOS systems become implicated in the delivery of our public services and we're not in charge of how Google and Apple develop their mobile operating systems, we are creating a dependency in our technical infrastructure that is a major liability.
We can have modern technology. It doesn't have to live in the apps.