Prior to the 2012 season, Baseball America rated Swihart the 72nd best prospect in baseball. He batted .602 (56-for-93) with 17 doubles, five triples, five homers, 41 RBIs and 58 runs scored in 28 games as a high school senior, being named to the Class 5A North All-Star squad by the New Mexico High School Coaches Association. He also played for the USA Baseball 18-Under National Team in 2010 and led his team with a .448 average, earning Louisville Slugger All-American honors and playing in the 2010 Aflac All-American High School Baseball Classic.
Swihart played briefly for the GCL Red Sox in 2011, gaining consecutive promotions to Class A Greenville Drive in 2012 and Class A+ Salem Red Sox in 2013. He is currently the 10th highest-ranked prospect in the Red Sox organization.