In Firewatch, you can pick up some Objects to interact with.
The Loose Stone can be found at Cache 241 and many other places throughout Two Forks.