In Firewatch, you can pick up some Objects to interact with.
The Cave Keys are found as you progress through the story and are necessary to go further into Cave 452.