Evidence-based education

From Wikipedia, the free encyclopedia
Jump to navigation Jump to search

Evidence-based education is an approach to all aspects of education—from policy-making to classroom practice—where that is based on randomized trials, as with the testing of new drugs in evidence-based medicine. When several of these studies are compared, and their conclusions combined, we get a meta-study or meta-analysis. This is significantly more reliable than the results of individual studies due to the difficulty in controlling variables and individual bias.[1]. "Evidence-based teaching" refers to the teaching aspects.

Sources of evidence[edit]

There are numerous researchers and institutions that produce analysis of the existing evidence, below are some.

What Works Clearinghouse[edit]

"What Works Clearinghouse" evaluates educational programs by evidence, rates the quality and quantity of the evidence and estimates the effectiveness. It's operated by the federal National Center for Education Evaluation and Regional Assistance (NCEE). The 10 interventions below are currently the interventions with both the highest effectiveness rating of strong evidence of a positive effect with no overriding contrary evidence.[2]

Program Intervention Description Grades Improvement area and effect size
Success for All In kindergarten through first grade, teachers read aloud and discuss with students focusing on phonemic awareness, auditory discrimination, and sound blending. In the second through fifth grades cooperative learning activities built around partner reading are used. It's delivered with daily 90-minute reading classes consisting of 15-20 students, grouped by performance and regardless of their age. One-on-one tutoring is provided to students with learning difficulties. 8 Alphabetics (+9%)
READ 180 A reading program for those that are two or more grades years below grade level. The classes start off with whole-class instructions, which is followed by computer practices that are adaptive and individualized, small group activities or independent reading, with a whole-class wrap up in the end of the class. 4-10 Comprehension (+6%) and general literacy achievement (+4%)
Phonological Awareness Training Activities where children identify, detect, delete, segment, or blend segments of spoken words (i.e., words, syllables, onsets and rimes, phonemes) or that focus on teaching children to detect, identify, or produce rhyme or alliteration. PK Phonological processing (+27%)
Phonological Awareness Training plus Letter Knowledge Training The added letter knowledge training component includes teaching children the letters of the alphabet and making an explicit link between letters and sounds. PK Phonological processing (+30%), Print knowledge(+27)
Reading recovery Daily 30 minute one-on-one tutoring sessions to students who have difficulties in reading and writing over the course of 12-20 weeks. 1 Alphabetics (+21%), Reading achievement (+27)
Instructional Conversations and Literature Logs Program for English learners where teachers engage students to Instructional Conversations, where stories or personal experiences are discussed with teachers acting as faciliators. Literature Logs require students to respond in writing to prompts or questions. Responses are then shared in small groups or with a partner. 2-5 Reading achievement (+27%)
SpellRead Literacy program for struggling readers, including special education students and English language learners. SpellRead breaks the recognizing and manipulating of English sounds into specific skills, and focuses on mastering each skill through systematic and explicit instruction. 5-6 Alphabetics (+18%)
Dialogic Reading Shared picture book reading practice where the adult and the child switch roles so that the child learns to become the storyteller with the assistance of the adult, who functions as an active listener and questioner. PK Oral language (+19%)
DaisyQuest Computer-assisted instruction with a storyline and practices that teach children how to recognize words that rhyme; words that have the same beginning, middle, and ending sounds, words that can be formed from a series of phonemes presented separately and also teaches children how to count the number of sounds in words. PK-1 Alphabetics (+23%)
Earobics Interactive software that provides individual instruction for phonemic awareness, auditory processing, and phonics, as well as the cognitive and language skills required for comprehension. Each level of instruction addresses recognizing and blending sounds, rhyming, and discriminating phonemes. The software is supported by audio, video and reading materials. 3 Alphabetics (+19%)
Stepping Stones to Literacy The program includes serial rapid automatic naming activities where children practice making quick visual-verbal associations of known sets of colors, numbers, and/or letter names in a left-to-right format, and instructional prompts in English and Spanish. 3 Alphabetics (+19%)
Teach For America Placing non-traditionally trained teachers in high-need public schools. Many TFA teachers hold bachelors’ degrees from selective colleges and universities. 12 Mathematis Achievement (+4%)
Caring School Community (CSC) Program consists of class meeting lessons, cross-age “buddies” programs, “homeside” activities, and creation of schoolwide community by bringing school staff, parents and students together to create new school traditions. 6 Behavior (+8%), Knowledge, attitudes, and values (+7%)
First Step to Success Program seeks to detect children who at risk to develop antisocial behavior patterns and match them with behavior coaches who work with the child, his or her classpeers and parents for approximately 50-60 hours over a 3-month period. 3 External behavior (+28)
Social Skills Training Collection of practices using modeling, role-playing, and specific instruction on social skills, with positive reinforcement for engaging in appropriate social behavior. PK Social-emotional development (+12)
Dual Enrollment Programs The intervention allows high school students to take college courses and earn college credits while still attending high school. 9-12 Access and enrollment (+15), Attainment (+25), Completing school (+7), Credit accumulation (+14), General academic achievement - high school (+7)
Check & Connect Students are assigned a “monitor” who regularly checks their performance (in particular, whether students are having attendance, behavior, or academic problems) and connects with school personnel, family members, and community service providers when problems are identified. 9-12 Staying in school (+25)
ACT/SAT Test Preparation and Coaching Programs Test preparation programs with the goal of increasing student scores on college entrance tests. 10-12 General academic achievement-high school (+9)
Positive action Teaches children positive and constructive way of thinking about themselves and acting towards others using methods such as discussions, role-playing and games. The program uses factsheets, booklets and songs as teaching material. 1-12 Behavior (+19%) and general academic achievement (+14%)
Coping power The program consists of a child and a parent component. The child component consists of thirty-four 50 minute group sessions and periodic individual sessions over the course of 15–18 months. The parent component consists of 16 group sessions and periodic invidula meetings. The child component emphasizes goal setting, problem solving, anger management and peer relationships and consists, while the parent lessons emphasize setting expectations, praise, discipline, managing stress, communication and child study skills. K-12 students with emotional disturbances External behavior (+8%) and social outcomes (+6%)
Too Good for Drugs and Violence The program promotes prosocial behavior and norms, and consists of 14 core lessons with additional 12 lessons that include roleplaying and co-operative learning. Pupils are encouraged to apply the skills taught, for example by infusing the lessons into subjects such as English, science or social studies 5, with additional program for 8 Knowledge, attitudes and values (+16%)
I CAN Learn Algebra The program is mastery based and uses self-paced educational software. 8 Mathematics achievement (+7%)
Pre-K Mathematics The program uses small group activities (4 - 6 children) with concrete manipulatives and includes take home picture strips and activities that are designed to help parents support their learning, as well as a software with activities to reinforce the lessons. PK Mathematics achievement (19%)
Literacy Express Includes lessons on oral language, emergent literacy, basic math, science, general knowledge, socioemotional development. It offers the staff with recommendations for room arrangement, daily schedules, classroom management and activities, and provides them with teaching materials. PK students, especially those with special needs Print knowledge (+12%), oral language (+12%) and psychological processing (+12%)
Accelerated Middle Schools The intervention gives additional teaching and attempts to cover an additional year of curriculum during its 1 or 2-year duration. Classes link multiple subjects and are designed to have a 'hands on' practical approach. 6-8, High risk and low performing students in grades who are behind their grade levels Progressing in school (+35%), staying in school (+18%)

Metastudies of Marzano and Hattie[edit]

Two sources of meta-analyses in education include: Visible Learning from a team in New Zealand under John Hattie[3] and Classroom Instruction that Works from a Colorado, USA team under Robert Marzano.[4]

According to the Marzano study, there are ten classroom methods which have been shown to work significantly better than many others:

Although Hattie's work does not exactly mirror this list, the main reason is that the New Zealand study looks at everything related to education, including family effects and changes to the curriculum, while the Colorado study looked only at classroom methods. There are, however, no incompatibilities and most of Marzano's top-ten appear high on Hattie's list.

Hattie points out that there is no shortage of effective methods - almost anything you try in education seems to have a small beneficial effect. He therefore uses a scale of effect size which measures by how much the learning is improved. As an effect-size of 0.4 is the average for all interventions (and also the effect of a hard working, well organised and enthusiastic teacher), he suggests that methods with an effect size above 0.4 should be used as a priority. This ties with Marzano, whose list starts at an effect size of 0.59 for Advance Organisers and increases up the list.

The Coalition For Evidence-Based Policy Congressional Top Tier Programs[edit]

The Coalition For Evidence-Based Policy, which is a non-partisan, non-profit organization advocating the use of well conducted randomized controlled trials in policy, has recognized three educational programs as "Top Tier". Programs classified as "Top Tier" must have been proven to be effective in randomized controlled trials that were well designed and implemented.[5]

Program Intervention Description Sample size Sample characteristics Outcomes Costs
Career Academies The intervention happens in learning communities consisting of 150 - 200 students. It combines academic and technical curricula in partnership with local employeers, typically with a specific career theme. 1 764 students in 9 high schools 86% of the students in the study sample were Hispanic or African-American and the high schools were in high poverty urban areas. 11% increase in average annual earnings ($2,460 per year), sustained over the eight years after scheduled high school graduation. The effect was concentrated among men (who experienced a 17% earnings increase), and was not statistically significant for women. Approximately $2,300 per student for a three-year Career Academy, or $3,000 per student for a four-year Career Academy.
Success For All A school wide reading program to grades K2 with emphasis on early detection and prevention of reading problems. Key program elements include daily 90-minute reading classes where students are grouped by performance, not age and in addition daily one-on-one tutoring to students with learning problems. First year includes curriculum that focuses on language development and phonemic awareness and second year learning activities that happen in teams or pairs. 41 schools with a total student population of 2,694 56% African-American, 10% Hispanic of whom 72% of students were eligible for federally subsidized lunches. Schools that were allocated to the program increased their average reading achievement by 25-30% of a grade-level three years after random assignment. Approximately $220,000 per school (K5) or $510 per student, over the full three-year period.*
H&R Block College Financial Aid Application Assistance Offering personal assistance in completing a college financial aid application. Approximately 1045 students 57% female, 55% white, 39% African American who had family income was below average (23,000 $) and average age was 17.7. A sizable increase in college attendance and persistence over the 3½-4 years following the intervention, 29% greater likelihood of attending college for two consecutive years. Approximately $90 per person to deliver the intervention, in 2012 dollars. $375 per person in federal need-based (“Pell”) grants for college.

Effective professional development[edit]

For students' results to reflect these high effect-sizes, teachers need to develop the skills of their use. According to several studies,[6][7] the time taken to do this lies somewhere between the learning of new facts and the development of a musical or sporting skill. While facts can be learned with a few repetitions, skills may need several hundred hours to develop. The evidence is that teachers start to become skilled with a particular method after about 10 repetitions with improvement plateauing after 6 months to 2 years of use. Continuing professional development (CPD) needs to reflect these findings. Teaching staff need the opportunity to learn about and then practice these skills. The role of CPD managers is to ensure that the time is available and the process takes place, not to instruct the teachers to follow directions. Where staff self-select their training either from external providers or from a range of sessions on a training day, they do not have the chance to develop their skills. Training, development and discussion of a smaller list of high-effect-size methods will be more effective. This process is sometimes referred to as supported experimentation or peer mentoring.

Implications for teachers[edit]

Teachers have more effect on the outcomes for their students than anyone else. The difference in outcomes for 2 teachers in the same college is significantly greater than the average of teachers in a 'good' rather than a 'weak' school. The main reason why some schools do better is that they have a higher percentage of teachers who use high effect-size methods. While individual teachers can improve their students' results using these methods in isolation, it is far more effective if they are adopted department or college-wide so that the discussions, observations and sharing-of-practice can take place easily.

References[edit]

  1. ^ Zucker, S. (2004). Scientifically based research: NCLB and assessment. Retrieved from http://images.pearsonassessments.com/images/tmrs/tmrs_rg/ScientificallyBasedResearch.pdf?WT.mc_id=TMRS_Scientifically_Based_Research)
  2. ^ http://ies.ed.gov/ncee/wwc/findwhatworks.aspx
  3. ^ Hattie, J (2003) Visible Learning Oxford: Routledge
  4. ^ Marzano, R (2001) Classroom Instruction that Works Alexandria, VA: ASCD
  5. ^ http://toptierevidence.org/
  6. ^ Joyce.B (2002) Student Achievement Through Staff Development ASCD
  7. ^ Helen Timperley et al (2007) Teacher Professional Learning and Development

External links[edit]