Levy was elected as a Democrat to the Forty-fourth Congress (March 4, 1875-March 3, 1877). He was an unsuccessful candidate for renomination in 1876. He served as member of the State constitutional convention in 1879. He was appointed associate justice of the State supreme court in 1879 and served until his death in Saratoga, New York, August 14, 1882. His funeral was in the Protestant Episcopal Church in Natchitoches, Louisiana, and he was interred in the American Cemetery there.