The mosque is situated north of Jalan Tukang Emas, also known as "Harmony Street" because of its proximity to the Sri Payyatha Viyanagar Moorthi Temple and Cheng Hoon Teng Temple.
The architectural design of the mosque is a cross between Sumatran, Chinese, Hindu, and the Melaka Malay. The minaret, ablution pool and entrance arch were built at the same time with the main building. The minaret resembles a pagoda.
The mosque should not be confused with Kampung Kling Mosque, located a few blocks to the south; it also has a pagoda-like minaret.