Above the spring in the Roman period, dominating the city on its northern end, was a group of shrines. Only their foundations have survived. On the west side, there is a cave, which served as the sacred grotto of the temple that Herod the Great built here in 19 BC to honor his patron, Augustus. To its left are niches for statues. We have an idea what the temple looked like, because the city minted coins with its image, showing four Ionic columns in front. From Josephus we also have a description of the grotto, which had water, and the gushing spring beneath:

And when Caesar had further bestowed upon him another additional country, he built there also a temple of white marble, hard by the fountains of Jordan: the place is called Panium, where is a top of a mountain that is raised to an immense height, and at its side, beneath, or at its bottom, a dark cave opens itself; within which there is a horrible precipice, that descends abruptly to a vast depth; it contains a mighty quantity of water, which is immovable; and when any body lets down any thing to measure the depth of the earth beneath the water, no length of cord is sufficient to reach it. Now the fountains of Jordan rise at the roots of this cavity outwardly; and, as some think, this is the utmost origin of Jordan: but we shall speak of that matter more accurately in our following history. (Josephus, War , Book  I. 21.3) 

Ascending a bit to the right, one enters the Court of Pan and the Nymphs, dated to the 1st century AD. It was open to the sky. The grotto that is carved in the cliff belonged to it. In 148 AD the niches were added and statues put in, as indicated by this inscription: "The priest Victor, son of Lysimachos, dedicated this goddess to the god Pan, lover of Echo."

The next shrine to the right was a temple to Zeus, and beside that a courtyard dedicated to Nemesis, goddess of revenge, whose cult was (and is, though not by name) a regional favorite. The inscription above it mentions her shrine, which "was made by cutting away the rock underneath."

Below on our right, we see an apse, which was partitioned off from the rest of the building. It is thought that the sacred goats used to dance here to the music of the Pan flutes, played by the priests beyond the partition.