Not just any cave but the sightless pit. The sightless pit does eventually lead back around to the other side of the barred door in the abandoned cave. One of those unlock the door from the right side and you re free to go type things.
