Guheswori temple is dedicated to Adi Shakti or Guhyeshwari. The Shakti Peetha temple is situated on the southern bank of the Bagmati River, about a kilometer east of Pashupatinath Temple.

The goddess is worshiped in a kalasha (water jar) that is covered in a layer of silver and gold in the center of the temple. The kalasha is supported by a stone base that hides a natural water spring beneath it. Water seeps out of the base's sides. Four golden snakes that hold the finial roof are atop the temple, which is situated in the middle of a courtyard. Taking photos inside the temple is strictly prohibited. There is image of copper and silver kalash around the wall of the temple.

It is believed the genitals of Sati Devi is said to have fallen when Lord Shiva carried it and wandered in sorrow. There are more than 20 images of lions dated surrounding the temple and some pillars with images of king, lions, trident on top of it.