I originally thought the caves were created by natural erosion. Watching “Lost Cave Temples” on PBS convinced me these were likely man made. See http://www.pbs.org/video/1336049754/