A teacher by profession, Berge started his political career in Lista in the present-day municipality of Farsund, where he was in 1882 elected mayor. From here he went on to the Norwegian Parliament in 1891. He served, in different periods, as both Church Minister and Minister of Finance. Then, after a 10-year absence from politics, he became again Minister of Finance, and later also Prime Minister, when sitting Prime Minister Otto Bahr Halvorsen died. He resigned this post as the result of the defeat in a vote to lift prohibition.
In 1926 he was, as the only Norwegian Prime Minister ever, impeached. The charge was withholding information relating to the government rescue of a bank threatened by bankruptcy. He was, however, acquitted in 1927, along with the six ministers who stood trial alongside him.
Books by Abraham Berge:
Listerlandets kystværn og kaperfart 1807-14 (Tønsberg 1914) and Lista. En bygdebok (Tønsberg 1926). Both books reprinted 2006 by Klokkhammer Forlag AS.