Jerry played on the field with his brother Avraham. In 1939, during a tour of Australia, Avraham decided to stay in the country and it was the last time that Jerry would see his brother who ended up dying in battle against Japanese forces in New Guinea.
After the retirement of Egon Pollack, Beit haLevi took over the reins of the club that made him famous as a player. He built a strong side that was arguably the strongest side in the country. Star players Eli Fuchs, Itzhak Schneor and Shiye Glazer and tough tactics helped Beit haLevi capture two league championships in 1951 and 1952 as well as a double in 1954. He left Maccabi for a brief stint at city rivals Hapoel Tel Aviv before bringing Maccabi another league title in 1956.
During his time with Maccabi, Beit haLevi served two terms as manager of the Israel national football team. His bunker tactics led to the national team's style of play being referred to as "Jerry's bunker". After the 1956 season with Maccabi, Beit haLevi was fired, though he returned in the 1960s and is credited with the development of such national team stars such as Giora Spiegel. After retiring from coaching, he served as the chairman for the club.
In 1960, Jerry received an offer to coach the Nigerian national football team, which he accepted. In his first match against Ghana, Nigeria were crushed 3–0 in front of 100,000 fans in Lagos and the press called for Beit haLevi to be fired. He decided to stick with the job and helped build up a better Nigerian side. During this time he was also heavily involved in trying to exhume the body of his brother for burial in Israel, but was unsuccessful.