The town consists of the main centre, Brtnice (2410 inhabitants), and 9 town districts named: Dolní Smrčné (90 inhabitants), Jestřebí (144 inhabitants), Komárovice (72 inhabitants), Malé (45 inhabitants), Panská Lhota (234 inhabitants), Přímělkov (125 inhabitants), Příseka (233 inhabitants), Střížov (312 inhabitants), Uhřínovice (70 inhabitants).
The large ancestral and childhood house of the architect Josef Hoffmann is in the centre of the town. The architect's great-grandfather Franz Hoffmann moved into it in the 1780s. From a young age, Hoffmann spent most of the year away from the house but would often return, spending his summers there. His parents having died, he made subtle alterations to it in 1910–11, redecorating its interior and keeping much of the furnishings but also adding some of his own work. He and his sisters returned to it every summer until 1945, when it was seized by the (Soviet) Red Army and subsequently confiscated by the state and used as a "Workers' House". However, a plaque commemorating Hoffmann was placed on the house as early as 1970, and extensive work to strengthen the foundations and reinforce the vaults was done from 1974 to 1980. Following a 1992 exhibition in Brtnice on Hoffmann's work mounted by the town and MAK (Vienna), the house was turned into a permanent exhibition space. From then on, an ambitious programme of refurbishing the building to Josef Hoffmann's design was carried out; this was completed in 2003. From 2006, the building has been administered by the Moravian Gallery in Brno, with the assistance of MAK.