It's a bit like the "energy" in an electric capacitor. It's a property of the system's state that is related to the interactions between the particles.

In a charged capacitor, there's a lot of electrons on one side, but very few of them on the other. When you close the capacitor, suddenly you get a lot of energy out of it.