Goddess Hangseshwari is a manifestation of Goddess Kali. This form of the deity makes the temple so famous. The beautiful architecture too makes it a wonder. The temple is about 27 meters high. The Archaeological Survey of India has declared the temple as a heritage site. There are five floors in total and 13 minars made in the shape of lotus buds. The central minar has an idol of the rising Sun. The inner parts of the minars are designed according to the human anatomy. The overall architectural concept is fascinating. Both the idols of Lord Shiva and Mother Shakti are established in the temple. 'Hong' represents Shiva and 'Saa' stands for Shakti. So it is named Hangseshwari. The deity is unique because the posture is something not generally seen everywhere. The deity stands in a yogic position with her left leg resting on the right leg. Her upper left hand holds a sword to slay the demons and the lower left hand even holds a demon's head. The upper right hand is made in the Abhaya Mudra pose to show her as the force protecting the world from evils and the lower right hand blesses all. Such is the architectural beauty of the temple and the idols. The divinity and the beauty of the deity create a mystical aura that draws devotees and tourists all over the year.

Since the temple is built on yogic concepts and Tantrik principles, it is said that the five stories of the temple follows the structure of the human anatomy. The five stories symbolize-Ida and Pingal, the Bajraksha, the Shushumna and lastly, the Chitrini. These are some of the chakras through which energy passes in the body as per traditionally belief.