The local aboriginal people tell a dreamtime story of three brothers of the Birpai tribe who were killed by a witch called Widjirriejuggi and were buried where the mountains stand. The youngest of the three was Dooragan, for whom the park is named.
By amazing coincidence, when Captain Cook passed the area on 12 May 1770 he named the mountains Three Brothers, since "these Hills bore some resemblance to each other". Cook had earlier (25 January 1769) written of the Three Brothers hills west of Cape St Diego, so perhaps he was inspired by them too.
North Brother Mountain (Dooragan) supports a wide range of vegetation communities – including some of the best examples of old growth blackbutt forest in the area and pockets of sub-tropical rainforest – that provide habitat for gliders, bats and koalas. The park has a weed problem with the spreading of lantana.
The mountain was made a timber reserve in 1892 and later called the Camden Haven State Forest. Portions of the mountain were logged but large sections were untouched due to the terrain. It was opened to the public in 1970 when a road to the summit was constructed. The steep windy road has now been sealed, but it is unsuitable for caravans. Viewing platforms, which have wheelchair access, offer good views up and down the coast. Picnic, barbecue and toilet facilities are available. There are walks of varying length and difficulty.