Yes. One of the big misconceptions we have about Bitcoin is that most of the articles we read always display the physical coin, but there are not many of these coins around. The coins are just an abstraction.
Bitcoin—the network—is what we call the “peer-to-peer network”. Instead of having a centralized server—for example, Google or Microsoft—it's a network of thousands of computers that are all connected. That's why the network is safe and is also immune to political censure: you cannot physically pinpoint all the locations of the network.
Speaking of that, the locations of the Bitcoin are stored on what we call the “blockchain”, which is the open public ledger. Think of an accounting ledger. All the Bitcoin transactions since day one have been stored on that open database, stored on thousands of computers across the world. One of the major properties of that network is that all the transactions are completely open and transparent for audit. That's a new paradigm. Of course, public finance could benefit from that.