The experiment was not successful. The locomotive proved prone to slipping, because its factor of adhesion was very low; in simple terms it was too powerful for its ability to grip the rails. John L. McIntyre, the road foreman of engines at Clinton, Illinois where the locomotive was assigned during the 1938–1939 period, made some modifications to the locomotive, including to the weight equalization across the locomotives' wheels and to reduce the cylinder diameter from 27 to 24 inches (686 to 610 mm). The latter was to reduce the starting tractive effort to a level the locomotive's grip on the rails could handle. The improvements were successful, but not to the degree that the railroad ordered any further conversions.
In 1945, the locomotive was renumbered 2499 and assigned to passenger service between Louisville, Kentucky and Fulton, Kentucky. It was retired from service in 1949 and soon after scrapped.