Jump to content

USMLE Step 1

From Wikipedia, the free encyclopedia

This is an old revision of this page, as edited by Javert2113 (talk | contribs) at 23:13, 14 November 2022 (Importing Wikidata short description: "First part of the U.S. Medical Licensing Examination"). The present address (URL) is a permanent link to this revision, which may differ significantly from the current revision.

The USMLE Step 1 (more commonly just Step 1 or colloquially, The Boards) is the first part of the United States Medical Licensing Examination. It aims to assess whether medical school students or graduates can apply important concepts of the foundational sciences fundamental to the practice of medicine. US medical students who wish to seek licensure to practice medicine in the US typically take Step 1 at the end of the second year of medical school. Graduates of international medical schools (i.e., those outside the US or Canada) must also take Step 1 if they want to practice in the US. Graduates from international medical schools must apply through ECFMG, and the registration fee is $915.[1] For 2020, the NBME registration fee for the test is $645, with additional charges for applicants who choose a testing region outside the United States or Canada.[2]

Prior to January 2022, Step 1 scoring is a three-digit score, theoretically ranging from 1 to 300, with a passing score of 194. It was announced on February 12, 2020 that beginning no earlier than January 2022, USMLE Step 1 would transition to a Pass/Fail scoring system.[3] In July 2020, the USMLE stated that "All scores for Step 1 exams taken prior to the date of the policy change will continue to be reported using the three-digit numeric score on all USMLE transcripts. The USMLE program does not retroactively alter transcripts."[4]

History

Prior to 1992, the NBME Part I examination served as the staple basic science examination for medical students at the end of their second year. Upon the launch of the three-part United States Medical Licensing Examination, NBME Part I exam was carried forward in its new format, the USMLE Step 1 examination, which has since evolved to become an increasingly clinically-applied examination of the foundational sciences. The exam became computer-based several years later. In May 2015, the USMLE began emphasizing concepts regarding patient safety and quality improvement across all parts of the USMLE exam series, including Step 1.[5]

While the USMLE Step 1 has traditionally been taken after students complete foundational sciences and before core clinical clerkships. In recent years, a number of medical schools have reformed their curricula to have students take the USMLE Step 1 after core clinical clerkships or preliminary clinical training. Top medical schools such as Harvard Medical School, University of Colorado School of Medicine, Vanderbilt University School of Medicine, Penn State College of Medicine, UCSF School of Medicine, University of Wisconsin School of Medicine and Public Health, Baylor College of Medicine, Weill Cornell Medical College, Perelman School of Medicine at the University of Pennsylvania, Vagelos College of Physicians and Surgeons at Columbia University, Stanford School of Medicine, University of Michigan, Yale School of Medicine, Roy J. and Lucille A. Carver College of Medicine at the University of Iowa and New York University School of Medicine have instituted these changes, requiring completion of the exam in the third year of medical school.[6]

Format

The exam is currently an eight-hour computer-based test taken in a single-day, composed of seven 60-minute blocks of questions with a maximum of 40 multiple-choice questions per section and 280 for the exam.[7] One hour is provided for each section, allotting an average of a minute and thirty seconds to answer each question.[8] Between test sections, the test taker is allotted a cumulative 45 minutes (during the test day) for personal breaks. (There is a 15-minute tutorial at the beginning of the exam, which the test-taker can choose to skip and have that time added to break time.) If the taker finishes any section before the allotted one-hour time limit, the unused time is added to the break time total.[9] The test is administered at any of several Prometric computer testing sites. Starting in 2022, the USMLE Step I examination will be reported as Pass/Fail rather than a three-digit score.[10]

Subjects

Step 1 is designed to test the knowledge learned during the basic science years of medical school as applied in the form of clinical vignettes. This includes anatomy, behavioral sciences, biochemistry, microbiology, pathology, pharmacology, and physiology, as well as to interdisciplinary areas including genetics, aging, immunology, nutrition, and molecular and cell biology.[11] Epidemiology, medical ethics and questions on empathy are also emphasized. Each exam is dynamically generated for each test taker; while the general proportion of questions derived from a particular subject is the same, some test takers report that certain subjects are either emphasized or deemphasized.

Scoring

Currently, students receive a score of pass or fail following sitting for the Step 1 examination. In 1999, the USMLE phased out the use of a percentile-based system in favor of a three-digit and two-digit scaled scoring system. In October 2011, two-digit scaled scores were no longer reported to any parties besides the examinees. In April 2013, the two-digit score was eliminated completely from the score report.

While the USMLE program does not disclose how the three-digit score is calculated, Step 1 scores theoretically range from 1 to 300, most examinees score in the range of 140 to 260, the passing score is 196, and the national mean and standard deviation are approximately 232 and 19, respectively.[12][13] Rise in the national mean Step 1 score has been observed with time, as shown in the table below.[14] According to the National Resident Matching Program, the mean score for U.S. allopathic seniors who matched to residency programs in 2016 was 233.2 (SD=17.4).[15]

In 1994, the average Step 1 score for applicants was 200, whereas, in 2018, the average score was 230. In 2021, a score of 200 would place the test taker in the 9th percentile, whereas a 230 in 1994 would have put the test taker in the 93rd percentile.[16] The USMLE scoring scale was originally set to have a mean score of 200 with a standard deviation of 20. The scale has never been re-centered, so a score of 200 in 1994 reflects the same number of questions answered correctly as a score of 200 in 2021.[17]

It was announced on February 12, 2020 that beginning no earlier than January 2022, USMLE Step 1 would transition to a Pass/Fail scoring system.[18] Mean and median USMLE scores have increased significantly from 2003 to today leading to the testing board having to increase the score it takes to pass; independent research cited that practice-question usage was self-reported as a completion fraction of UWorld, USMLE-Rx, or Kaplan question banks or self-assessments.[19]

The USMLE has decided that three-digit score results for Step 1 exams taken prior to January 26, 2022, will "continue to be reported using the three-digit numeric score on all USMLE transcripts."[20]

National Step 1 means among US and Canadian first time test-takers by year
Year Mean Score Standard Deviation
2021[21] 231 19
2020[21] 235 18
2019[22] 232 19
2018[22] 230 19
2017[22] 229 20
2016[23] 228 21
2015[23] 229 20
2014[23] 229 20
2013 226 21
2012 224 21
2011 224 22
2010 222 24
2009 221 24
2008 221 23

Changes to Step 1 scoring

It was announced on February 12, 2020 that beginning no earlier than January 2022, USMLE Step 1 would transition to a Pass/Fail scoring system.[24] In July 2020, the USMLE stated that "All scores for Step 1 exams taken prior to the date of the policy change will continue to be reported using the three-digit numeric score on all USMLE transcripts. The USMLE program does not retroactively alter transcripts."[4]

While the NBME, USMLE, and FSMB were originally against these changes (which critics argued may have been from potential monetary loss), as of 2020 (and after the formation of InCUS[clarification needed]), they have changed their stance in support of the public opinion. Humayun Chaudhry, the President of the FSMB, (who was originally in opposition to the Step changes), later said that “although the primary purpose of the exam is to assess the knowledge and skills essential to safe patient care, the new policies will “address concerns about Step 1 scores impacting student well-being and medical education.” Because students put so much emphasis on getting a high USMLE Step 1 score, they often skimmed the medical school curriculum that they deemed to be not as relevant in order to get the maximum score on the USMLE Step 1. [25]

Use of Step 1 scores by residency programs

The medical community has criticized the USMLE and residency programs for using Step 1 scores as the main screening tool in selecting applicants for a residency interview, creating a "barrier that was never meant to exist." Residency directors are “overweighting a screening test in a manner not supported by evidence and for which the test was not specifically designed. Step 1 was designed as a Pass/Fail exam, and beyond the Pass/Fail designation, the scores were not meant to have meaning.[26] Residency program directors utilize the scores as a means of filtering the significant applications down to a more manageable number that allows for a more thorough review of the remaining applications. A significant amount of residency program directors believe that the conversion to Pass/Fail will make "applicant screening more arduous."[27]

For state licensing purposes, the exam always has been Pass/Fail, but over the past few years, its three-digit numeric score has been used as the main determination in granting medical interviews.[28] In recent years, an applicant's Step 1 score has been cited by residency program directors as their most important criterion in selecting graduating medical students for their residency program, despite lack of evidence or data to support that practice.[29] Average USMLE Step 1 scores for various residencies are available in Charting Outcomes in the Match.

Studies on Step 1 performance found that "Step 1 is neither precise nor does it predict student performance as residents beyond a certain threshold. With a standard error of eight points, two applicants with scores as far as 15 points apart may not be meaningfully different and yet several programs use singular cutoff points as screening tools."[30][31] This, as well as the negative impact on student learning, cost, gross misuse of student time, and attempt to decrease racial bias, are amongst the many reasons that the USMLE announced it would revert to Pass/Fail reporting of Step 1 beginning 2022.

Unintended consequences

In a 2017 study, students started studying for Step 1 during their preclinical curriculum and increased the intensity of their study time until it reached a maximum of 11 hours a day over the period of a month before the exam. Instead of relying on their medical school curriculum, the students instead focused heavily on third-party study materials. According to Kristen Moon, "While this “parallel curriculum” did lead to an increased Step 1 score, it often did not help them learn the medical school curriculum, because students were skipping lectures and classes." [32]

Racial disparity in score outcomes

Since 2001, there has been a strong plea to remove the Step 1 score barrier that disproportionately affects select racial and ethnic groups. "Using Step 1 scores to screen residency applications puts students who are underrepresented in medicine at a disadvantage."[33] Black and Latino students receive markedly lower scores on Step 1 than white students.[26] The mean USMLE step 1 score was significantly greater among white applicants (223) as compared to black and Hispanic applicants (216).[34] Depending on the threshold score, an African American was 3-6x less likely to be offered an interview.[35]

A 2001 study in internal medicine residency showed that "when Step 1 scores were used to screen applicants for interviews, a significantly greater proportion of Black students were refused interviews."[36] A 2019 study on Orthopedic Surgery residency programs (the specialty with the lowest percentage of underrepresented students) showed that between 2005 and 2014, Black and Latino applicants were accepted into residency programs at a significantly lower rate (61%) than white applicants (71%).[37]

Further studies showed a lack of diversity within specialties and that those underrepresented students were more likely to go into specialties that have lower Step 1 cut-offs like Primary Care.[38]

The American Academy of Family Physicians and Association of American Medical Colleges supported changing Step 1 to pass or fail to reduce racial bias.[39][40][41] The AAFP wrote that changing Step 1 to Pass/Fail creates a "more equitable student evaluation and residency selection process, as it will reduce the impact of racial and other biases on residency selection. Factors that impact student experience with standardized testing (such as access to test preparation) perpetuate inequities and disparities that impact test performance, but do not predict or capture competency or skills for future physicians."[39] The American Medical Student Association recommended changing scoring to Pass/Fail to reduce the adverse impact of the current overemphasis on USMLE performance in residency screening as well as the associated racial bias.[42] The ECFMG and AMA supported this transition as well.[43]

Support for USMLE changes

According to the NMBE's InCUS survey results, there were mixed responses regarding support for "consideration of changes such as pass/fail scoring categorical/tiered scoring, and composite scoring." Per the survey, those in agreement with changes include 26% of residency program directors, 32% of current or former state board members, 39% of interns, residents, and fellows, 39% of medical school faculty, 44% of medical students, 67% of course directors, and 75% of Associate/Assistant Deans (of medical schools).[44] Notably, medical students and program directors were among parties with only a minority in favor of this change, despite being the most directly affected. Parties associated with medical schools, namely course directors and Deans were noted to have the most support for changes.

The USMLE parent organizations, including the AAFP, AMSA,[40] and AAMC wrote letters to the USMLE recommended broad, systemic changes to the medical program including changing Step 1 to Pass/Fail. "The current overemphasis on USMLE Step 1 is having an overwhelmingly negative impact on students. This should be addressed immediately. A Pass/Fail score will help provide a more meaningful learning environment, improved emotional climate, and better student-student interactions, which can lead to better academic performance that includes USMLE tests (see Cause or effect?). Additionally, it will decrease racial bias for programs that use USMLE Step 1 scores to grant interviews."[45] Further, they supported the move to Step 1 Pass/Fail citing unintentional negative impact of a single standardized exam on career exploration and selection.[46]

Objection to USMLE changes

According to the NMBE's InCUS survey results, there were mixed responses regarding support for "consideration of changes such as pass/fail scoring, categorical/tiered scoring, and composite scoring." Per the survey, those in agreement with changes include 26% of residency program directors, 32% of current or former state board members, 39% of interns, residents, and fellows, 39% of medical school faculty, 44% of medical students, 67% of course directors, and 75% of Associate/Assistant Deans (of medical schools).[44] Notably, medical students and program directors were among parties with only a minority in favor of this change, despite being the most directly affected. Parties associated with medical schools, namely course directors and Deans were noted to have the most support for changes.

Immediately following the announcement by USMLE that Step 1 would become Pass/Fail in 2022, concern has been expressed from several parties in the medical community, namely residency program directors and medical students, both among US graduates and international graduates.

In a survey of nearly 300 residency program directors in surgical fields, program directors were found to significantly disagree with the statements that changing to Pass/Fail "is a good idea" (78.1% [69.9–86.4%] disagree) and the statement that "Step 2 CK should also be changed to Pass/Fail" (84.0% [76.7–91.3%]). They were also found to significantly agree with the statements that changing to Pass/Fail: "Will make it more difficult to objectively compare applicants" (88.3% [81.9–94.7%]), "Will increase emphasis on Step 2 CK scores in selecting applicants for my program" (88.7% [82.5–95.0%]), "Will make applicant screening more arduous" (85.4% [78.4–92.4%]), "I will now require applicants to submit Step 2 CK scores with ERAS" (88.4% [81.7–95.0%]), and "Where an applicant goes to medical school will be more important in screening and selection for my program" (63.5% [53.8–73.2%]).[27]

US medical students have also expressed concern that priority that would have gone to Step 1 score will instead be shifted to school prestige, student connections, clinical grading, Step 2 CK scores, and extracurricular experiences.[47] In particular, students from DO (Doctor of Osteopathic Medicine) and "low tier" MD schools may be at considerable disadvantage compared to students from prestigious schools.[48] This concern is validated by the aforementioned program director survey.[27] These same schools are less likely to provide the same robust extracurricular opportunities, particularly in terms of highly valued research opportunities for these schools.

Step 2 CK is a three-digit-scored exam typically taken after the third year of medical school, which consists of clinical rotations in primary care fields. In February 2020, the Harvard Crimson wrote, "the fact that Step 2 is a more clinically relevant exam than Step 1, makes it a better proxy for clinical acumen."[48] However, the timing of Step 2 CK is often only months before residency applications are submitted, meaning a poor score could jeopardize a student's application without allowing time to change tracks or bolster other application components.

International medical students and graduates expressed growing concerns that the change will further decrease IMG (International Medical Graduates) chances of matching into US residency programs. Historically, IMGs have been at a significant disadvantage when applying to US residency programs. Outside of scores, residency program directors consider letters of recommendation, clinical grades, and research. Since international medical students come from medical schools with different grading systems and do not usually have access to well-known faculty and American research opportunities, USMLE Step 1 is often seen as a major opportunity to boost IMG residency applications with a high score.[49] Without a numerical score on the USMLE Step 1, there is speculation that IMG's will be further be pushed out of the race for residency program spots. This was supported to some extent by General Surgery program director respondents, which significantly agreed that the changes to Pass/Fail "Will put IMGs at a disadvantage" 56.0% [48.6–63.4%].[27]

Formation of InCUS and Outcomes

The current use of Step 1 scoring as a major determinant for granting residency interviews has been met with tremendous criticism by the medical community. The public outcry led to the formation of a committee and investigation in early 2019 called the Invitational Conference on USMLE Scoring (InCUS).[43] The USMLE published a list of InCUS participants.[50] In February 2020, InCUS concluded that residencies were overemphasizing Step 1 and not using it for its original purpose for which it was designed as a means of licensing.[51]

Upon reaching these conclusions, the USMLE program announced a plan to change Step 1 score reporting to a Pass/Fail system in an effort "to reduce overemphasis on Step 1 performance while allowing licensing authorities to use the exam for its primary purpose of medical licensure eligibility." The USMLE stated that transition will occur no earlier than January 1, 2022.[52][53][43][54]

In July 2020, the USMLE stated that "All scores for Step 1 exams taken prior to the date of the policy change will continue to be reported using the three-digit numeric score on all USMLE transcripts. The USMLE program does not retroactively alter transcripts."[4]

Effect on residency matching

The USMLE score is one of many factors considered by residency programs in selecting applicants. The median USMLE Step 1 score for graduates of U.S. Medical Schools for various residencies is charted in Chart 6 on page 9 of "Charting Outcomes in the Match" available through the NRMP Website.

Many residency programs use a "cutoff" score for Step 1, below which applicants are unlikely to be considered, although in some cases individuals with significantly higher Step 2 CK scores may still receive further consideration. The NRMP Residency Program Director survey contains more information, both overall and by specialty, regarding "cutoff" scores (i.e., scores below which programs generally do not grant interviews).[55]

Studies on Step 1 performance found that "Step 1 is neither precise nor does it predict student performance as residents beyond a certain threshold. With a standard error of eight points, two applicants with scores as far as 15 points apart may not be meaningfully different and yet several programs use singular cutoff points as screening tools."[30][31] This, as well as the impact on student learning, cost of preparation, diversion of student time toward exam preparation, and desire to decrease racial bias, are amongst the reasons that the USMLE announced it would switch to Pass/Fail reporting of Step 1 at the beginning of 2022.[56][57]

Controversies

Converting to Pass/Fail Scoring

See Support for USMLE changes and Objection to USMLE changes in Changes to Step 1 scoring.

USMLE response to COVID-19

During the COVID-19 pandemic, the USMLE and NBME were met with criticism from some members of the medical community, including the American Medical Association (AMA),[58] for miscommunication, delays and lack of flexibility[59][60] during the COVID-19 global pandemic.[61] They were also criticized for reducing the length of the exam at newly established testing centers in some U.S. medical schools to be able to accommodate more students for testing as those changes would diminish the standardization of the tests.[62] There were concerns that these issues would lead to many applicants having incomplete applications during the 2021 match season which would then negatively affect the ability of program directors to effectively evaluate candidates.[63] Prometric eventually added testing sites at some medical schools[64] and re-opened testing centers with new safety protocols. USMLE also reverted the announced changes to the exams length.[62] To accommodate these changes, the Electronic Residency Application Service (ERAS) adjusted the application timeline to allow students an additional month to submit their applications.[65]

Experimental Questions

On June 4, 2020, the USMLE announced a plan to administer tests at medical schools throughout the nation, but that these exams would notably lack experimental questions, while exams administered at testing centers during the same time period would still have these experimental questions.[citation needed][66] These experimental questions accounted for 80 of the 280 on the exam, which would have led to the decreasing the total test taking time from 7–8 hours to 5–6 hours. Some commenters expressed concerns since this practice would have "destandardized" the text and test-takers would have been "experimented" on without consent.[citation needed] [66] The USMLE ultimately reverted the announced changes to the exams length,[62].

Katsufrakis & Chaudhry comments on Step 1 changes

In December 2018, NBME President Peter Katsufrakis and FSMB President Humayun Chaudhry wrote in opposition of USMLE Step 1 changes in from Improving Residency Selection Requires Close Study and Better Understanding of Stakeholder Needs: "If students reduce time and effort devoted to preparing for Step 1, they may indeed devote attention to other activities that will prepare them to be good physicians. This would arguably be an ideal outcome of such a change. However, if students were to devote more time to activities that make them less prepared to provide quality care, such as binge-watching the most recent Netflix series or compulsively updating their Instagram account, this could negatively impact residency performance and ultimately patient safety. We know that assessment drives learning, so another concern resulting from a shift to pass/fail scoring may be a less knowledgeable physician population."[24] This was met with significant backlash from students and the medical education community as this was felt to be a "tone-deaf assumption that medical trainees with more time may instead redirect their effort toward Netflix and Instagram."[24][67][68]

Within a few days, Katsufrakis and Chaudhry issued an apology and removed the phrase.[69]

Exam Pricing and NBME Executive Salaries

NBME and USMLE were met with criticism when they announced their raising cost for Step standardized tests. Kevin MD wrote, "Safeguards are needed to ensure fees for mandatory testing such as the USMLE do not exceed reasonable operating costs, particularly for financially vulnerable medical students."[70] As part of a broader public plea for systemic changes to the improper use of USMLE Step 1 exams, STAT wrote that this "multimillion-dollar industry has exploited the opportunity to extract thousands of dollars from already overly indebted students. Registering for Step exams test cost $645–$1300, while Step preparation materials and courses run much higher."[30]

As of 2020, the USMLE currently charges $645 for Step and $60 for each NBME Self Assessments. The Self Assessments are practice exams similar to Step 1 that are frequently used by students in preparation for the exam.

The NBME executives received public criticism after their salaries were released after increasing costs for students, showing many executives receiving high said to seven figures. "Former NBME President Dr. Melnick's compensation increased from $399,160 in 2001 to over $1.2 million in 2016, almost perfectly in parallel with the tripling of USMLE costs."[71][72] "As of 2016, NBME President also gets free first-class airfare for himself and his travel partner, as well as a membership to a Philadelphia social club. According to the 2017 Form 990, Schedule J, two lower executives received total compensation over $700,000; another two over $600,000; another three receiving over $500,000, and another 6 receiving over $400,000...Yet, the total number of test-takers for the USMLE Step 1 has been essentially unchanged for the past 10–15 years."[73]

See also

References

  1. ^ http://www.ecfmg.org/fees.html ECFMG Fees
  2. ^ http://www.nbme.org/Students/examfees.html USMLE Fees
  3. ^ "Change to pass/fail score reporting for Step 1". USMLE. Retrieved 13 February 2021.{{cite web}}: CS1 maint: url-status (link)
  4. ^ a b c "USMLE Score Reporting Policy Updates | CORONAVIRUS RESOURCE CENTER". covid.usmle.org. Retrieved 2021-02-22.
  5. ^ "Home | United States Medical Licensing Examination" (PDF).
  6. ^ Michelle Daniel; Amy Fleming; Colleen O’Conner Grochowski; Vicky Harnik; Sibel Klimstra; Gail Morrison; Arnyce Pock; Michael L. Schwartz; Sally Santen. Why Not Wait? Eight Institutions Share Their Experiences Moving United States Medical Licensing Examination Step 1 After Core Clinical Clerkships, Academic Medicine 2017 Nov;92(11):1515–1524. doi:10.1097/ACM.0000000000001714.
  7. ^ https://www.usmle.org/step-1/ USMLE General Announcements
  8. ^ http://www.usmle.org/General_Information/announcements.html#Step1Change USMLE Announcements
  9. ^ http://www.usmle.org/bulletin/testing/#step12ck3 USMLE Testing Bulletin
  10. ^ "United States Medical Licensing Examination | Invitational Conference on USMLE Scoring".
  11. ^ "USMLE™ : Test Content & Practice Materials". www.usmle.org. Archived from the original on 2007-10-09.
  12. ^ http://www.usmle.org/pdfs/transcripts/USMLE_Step_Examination_Score_Interpretation_Guidelines.pdf [bare URL PDF]
  13. ^ "United States Medical Licensing Examination – Scores & Transcripts".
  14. ^ Interactive, Wellfire. "Medical Student Handbook".
  15. ^ http://www.nrmp.org/wp-content/uploads/2016/09/Charting-Outcomes-US-Allopathic-Seniors-2016.pdf [bare URL PDF]
  16. ^ Carmody, Micheal (13 January 2021). "USMLE Step 1 Pass/Fail – How did we get here?". Archived from the original on 2021-12-21. Retrieved 21 February 2021.
  17. ^ Carmody, Micheal (4 August 2020). "The Rise and Fall of USMLE Step 1". Archived from the original on 2021-12-21. Retrieved 21 February 2021.
  18. ^ "United States Medical Licensing Examination | Invitational Conference on USMLE Scoring". www.usmle.org. Retrieved 2020-02-13.
  19. ^ Burk-Rafel, Jesse; Santen, Sally A.; Purkiss, Joel (2017). "Study Behaviors and USMLE Step 1 Performance". Academic Medicine. 92 (11S Association of American Medical Colleges Learn Serve Lead: Proceedings of the 56th Annual Research in Medical Education Sessions): S67–S74. doi:10.1097/ACM.0000000000001916. PMID 29065026. S2CID 3214347.
  20. ^ "United States Medical Licensing Examination | Frequently Asked Questions (FAQs)".
  21. ^ a b "USMLE Score Interpretation Guidelines" (PDF). USMLE. Retrieved 7 September 2022.
  22. ^ a b c "USMLE Score Interpretation Guidelines" (PDF). USMLE. Retrieved 8 May 2021.
  23. ^ a b c "USMLE Score Interpretation Guidelines" (PDF). 2016.
  24. ^ a b c Katsufrakis, Peter J.; Chaudhry, Humayun J. (March 2019). "Improving Residency Selection Requires Close Study and Better Understanding of Stakeholder Needs". Academic Medicine: Journal of the Association of American Medical Colleges. 94 (3): 305–308. doi:10.1097/ACM.0000000000002559. ISSN 1938-808X. PMID 30570495.
  25. ^ "USMLE Step 1 is Now Pass/Fail – Who Benefits from This Big Change?". Forbes.
  26. ^ a b "Why are medical students non-essential?". 4 May 2020.
  27. ^ a b c d Pontell, Matthew E.; Makhoul, Alan T.; Ganesh Kumar, Nishant; Drolet, Brian C. (2021). "The Change of USMLE Step 1 to Pass/Fail: Perspectives of the Surgery Program Director". Journal of Surgical Education. 78 (1): 91–98. doi:10.1016/j.jsurg.2020.06.034. ISSN 1931-7204. PMC 7347473. PMID 32654997.
  28. ^ "Step 1 Scores Should Not be the Number 1 Barrier to A "Good" Residency or Fellowship". 10 September 2015.
  29. ^ www.nrmp.org https://web.archive.org/web/20111216082513/http://www.nrmp.org/data/programresultsbyspecialty.pdf. Archived from the original (PDF) on December 16, 2011. {{cite web}}: Missing or empty |title= (help)
  30. ^ a b c "Step 1 test for medical students should be pass/Fail". 8 March 2019.
  31. ^ a b https://www.usmle.org/pdfs/transcripts/USMLE_Step_Examination_Score_Interpretation_Guidelines.pdf [bare URL PDF]
  32. ^ "USMLE Step 1 is Now Pass/Fail – Who Benefits from This Big Change?". Forbes.
  33. ^ "Cheers and jeers as med school's Step 1 test becomes pass/Fail". 14 February 2020.
  34. ^ Williams, Myia; Kim, Eun Ji; Pappas, Karalyn; Uwemedimo, Omolara; Marrast, Lyndonna; Pekmezaris, Renee; Martinez, Johanna (2020). "The impact of United States Medical Licensing Exam ( USMLE ) step 1 cutoff scores on recruitment of underrepresented minorities in medicine: A retrospective cross‐sectional study". Health Science Reports. 3 (2): e2161. doi:10.1002/hsr2.161. PMC 7170452. PMID 32318628. S2CID 216036643.
  35. ^ Edmond, Michael B.; Deschenes, Jennifer L.; Eckler, Maia; Wenzel, Richard P. (December 2001). "Racial Bias in Using USMLE Step 1 Scores to Grant Internal Medicine Residency Interviews". Academic Medicine. 76 (12): 1253–1256. doi:10.1097/00001888-200112000-00021. PMID 11739053. S2CID 7029050.
  36. ^ Edmond, Michael B.; Deschenes, Jennifer L.; Eckler, Maia; Wenzel, Richard P. (December 2001). "Racial Bias in Using USMLE Step 1 Scores to Grant Internal Medicine Residency Interviews". Academic Medicine. 76 (12): 1253–1256. doi:10.1097/00001888-200112000-00021. ISSN 1040-2446. PMID 11739053.
  37. ^ McDonald, Tyler C.; Drake, Luke C.; Replogle, William H.; Graves, Matthew L.; Brooks, Jaysson T. (April 2020). "Barriers to Increasing Diversity in Orthopaedics: The Residency Program Perspective". JB & JS Open Access. 5 (2): e0007. doi:10.2106/JBJS.OA.20.00007. ISSN 2472-7245. PMC 7418923. PMID 32832828.
  38. ^ "Cheers and jeers as med school's Step 1 test becomes pass/fail". STAT. 2020-02-14. Retrieved 2021-02-28.
  39. ^ a b "USMLE Step 1 Scoring Change Removes a Harmful Barrier to Holistic Specialty Selection". Archived from the original on 2020-04-16.
  40. ^ a b "USMLE Change Benefits Students, Reflects AAFP Guidance".
  41. ^ Edmond, M. B.; Deschenes, J. L.; Eckler, M.; Wenzel, R. P. (2001). "Racial bias in using USMLE step 1 scores to grant internal medicine residency interviews". Academic Medicine: Journal of the Association of American Medical Colleges. 76 (12): 1253–6. doi:10.1097/00001888-200112000-00021. PMID 11739053. S2CID 7029050.
  42. ^ "AMSA's response to USMLE scoring change recommendations". 29 July 2019.
  43. ^ a b c "United States Medical Licensing Examination | Invitational Conference on USMLE Scoring".
  44. ^ a b "SUMMARY OF INCUS PUBLIC COMMENT" (PDF). Retrieved 21 February 2021.{{cite news}}: CS1 maint: url-status (link)
  45. ^ "Archived copy" (PDF). Archived from the original (PDF) on 2020-08-11. Retrieved 2020-06-16.{{cite web}}: CS1 maint: archived copy as title (link)
  46. ^ "AAMC Statement on Police Brutality and Racism in America and Their Impact on Health".
  47. ^ Childers, Daniel (2020-07-14). "Pass/Fail: A Student Perspective on the Monumental Change Coming to USMLE Step 1". Georgetown Medical Review. 4 (1): 13245. doi:10.52504/001c.13245. S2CID 225784790.
  48. ^ a b LaShyra T. Nolen (18 February 2020). "Why Pass/Fail Step 1 is Really Only Step 1". The Harvard Crimson. Retrieved 6 May 2021.
  49. ^ Aakash Desai, MD, MPH; Aparna Hegde, MD; Devika Das, MD (2020). "Change in Reporting of USMLE Step 1 Scores and Potential Implications for International Medical Graduates". JAMA. 323 (20): 2015–2016. doi:10.1001/jama.2020.2956. PMID 32142104. S2CID 212567454. Retrieved 6 May 2021.{{cite journal}}: CS1 maint: multiple names: authors list (link)
  50. ^ "Invitational Conference on USMLE Scoring (InCUS) Conference Attendees" (PDF). Retrieved 28 February 2021.{{cite web}}: CS1 maint: url-status (link)
  51. ^ "Medical Licensing Examinations in the COVID-19 Era". 11 May 2020.
  52. ^ "United States Medical Licensing Examination | Invitational Conference on USMLE Scoring". www.usmle.org. Retrieved 2020-02-12.
  53. ^ "USMLE Step 1 Moves to Pass/Fail; Medical Education". Staff Care. 2020-03-24. Retrieved 2021-12-11.
  54. ^ "United States Medical Licensing Examination". www.usmle.org. Archived from the original on 2020-06-01.
  55. ^ National Resident Matching Program (June 2016). "Results of the 2016 NRMP Program Director Survey" (PDF).
  56. ^ "Pros and Cons of the New Pass/Fail Step 1 of USMLE — Savvy Pre-Med". Archived from the original on 2020-02-19.
  57. ^ https://aamc-orange.global.ssl.fastly.net/production/media/filer_public/0f/7b/0f7b547e-65b5-4d93-8247-951206e7f726/updated_dermatology_program_director_statement_on_2020-21_application_cycle_.pdf [bare URL PDF]
  58. ^ "Delays, miscommunications add even more stress to USMLE Step exams". American Medical Association. 2 June 2020.
  59. ^ Lexi Krupp (15 June 2020). "USMLE Testing Chaos May Harm Current and Future Doctors". Medscape.
  60. ^ "Step 1 in the Time of COVID". In-training. 8 May 2020.
  61. ^ Marcia Frellick (4 May 2020). "Students Upset by USMLE Response to COVID-19 Demand Changes". Medscape.
  62. ^ a b c Marcia Frelick (9 June 2020). "USMLE Abandons Plan for Shorter Tests After Backlash". Medscape.
  63. ^ "Potential Implications of COVID-19 for the 2020–2021 Residency Application Cycle". JAMA. 324 (1):29–30): 29–30. 3 June 2020. doi:10.1001/jama.2020.8911. PMID 32492097. {{cite journal}}: Unknown parameter |authors= ignored (help)
  64. ^ "Brown's medical school leads the way in establishing first USMLE regional testing site".
  65. ^ "ERAS News and Announcements".
  66. ^ a b "Why does the USMLE use experimental items?". The Sheriff of Sodium. 2020-06-07. Retrieved 2021-02-22.
  67. ^ in-House (2018-12-30). "Dear NBME and FSMB, I watch HGTV more than Netflix: A Response to the Invited Commentary on USMLE Step 1". in-House. Retrieved 2021-02-28.
  68. ^ "Step 1 vs. Netflix and Instagram". opmed.doximity.com. Retrieved 2021-02-28.
  69. ^ "No More Numerical Scores for USMLE Step 1 Exam". 14 February 2020.
  70. ^ "The cost of taking the USMLE exams is staggering". Kevinmd.com. 18 July 2016.
  71. ^ "USMLE – STEP 3 Trick Works!!".
  72. ^ "National Board of Medical Examiners – Nonprofit Explorer". 9 May 2013.
  73. ^ "A Non-MBA's Guide to NBME Revenue in 9 Simple Charts". February 2019.