In natural and social science research, a protocol is most commonly a predefined procedural method in the design and implementation of an experiment. Protocols are written—or in some cases electronically recorded—whenever it is desirable to standardize a laboratory method to ensure successful replication of results by others in the same laboratory or by other laboratories. Additionally, and by extension, protocols have the advantage of facilitating the assessment of experimental results through peer review. In addition to detailed procedures, equipment, and instruments, protocols will also contain study objectives, reasoning for experimental design, reasoning for chosen sample sizes, safety precautions, and how results were calculated and reported, including statistical analysis and any rules for predefining and documenting excluded data to avoid bias.
Similarly, a protocol may refer to the procedural methods of health organizations, commercial laboratories, manufacturing plants, etc. to ensure their activities (e.g., blood testing at a hospital, testing of certified reference materials at a calibration laboratory, and manufacturing of transmission gears at a facility) are consistent to a specific standard, encouraging safe use and accurate results.
Finally, in the field of social science, a protocol may also refer to a "descriptive record" of observed events or a "sequence of behavior" of one or more organisms, recorded during or immediately after an activity (e.g., how an infant reacts to certain stimuli or how gorillas behave in natural habitat) to better identify "consistent patterns and cause-effect relationships." These protocols may take the form of hand-written journals or electronically documented media, including video and audio capture.
Experiment and study protocol
Various fields of science, such as environmental science and clinical research, require the coordinated, standardized work of many participants. Additionally, any associated laboratory testing and experiment must be done in a way that is both ethically sound and results can be replicated by others using the same methods and equipment. As such, rigorous and vetted testing and experimental protocols are required. In fact, such predefined protocols are an essential component of Good Laboratory Practice (GLP) and Good Clinical Practice (GCP) regulations. Protocols written for use by a specific laboratory may incorporate or reference standard operating procedures (SOP) governing general practices required by the laboratory. A protocol may also reference applicable laws and regulations that are applicable to the procedures described. Formal protocols typically require approval by one or more individuals—including for example a laboratory directory, study director, and/or independent ethics committee—before they are implemented for general use. Clearly defined protocols are also required by research funded by the National Institutes of Health.
In a clinical trial, the protocol is carefully designed to safeguard the health of the participants as well as answer specific research questions. A protocol describes what types of people may participate in the trial; the schedule of tests, procedures, medications, and dosages; and the length of the study. While in a clinical trial, participants following a protocol are seen regularly by research staff to monitor their health and to determine the safety and effectiveness of their treatment. Since 1996, clinical trials conducted are widely expected to conform to and report the information called for in the CONSORT Statement, which provides a framework for designing and reporting protocols. Though tailored to health and medicine, ideas in the CONSORT statement are broadly applicable to other fields where experimental research is used.
- safety: Safety precautions are a valuable addition to a protocol, and can range from requiring goggles to provisions for containment of microbes, environmental hazards, toxic substances, and volatile solvents. Procedural contingencies in the event of an accident may be included in a protocol or in a referenced SOP.
- procedures: Procedural information may include not only safety procedures but also procedures for avoiding contamination, calibration of equipment, equipment testing, documentation, and all other relevant issues. These procedural protocols can be used by skeptics to invalidate any claimed results if flaws are found.
- equipment used: Equipment testing and documentation includes all necessary specifications, calibrations, operating ranges, etc. Environmental factors such as temperature, humidity, barometric pressure, and other factors can often have effects on results. Documenting these factors should be a part of any good procedure.
- reporting: A protocol may specify reporting requirements. Reporting requirements would include all elements of the experiments design and protocols and any environmental factors or mechanical limitations that might affect the validity of the results.
- calculations and statistics: Protocols for methods that produce numerical results generally include detailed formulas for calculation of results. A formula may also be included for preparation of reagents and other solutions required for the work. Methods of statistical analysis may be included to guide interpretation of the data.
- bias: Many protocols include provisions for avoiding bias in the interpretation of results. Approximation error is common to all measurements. These errors can be absolute errors from limitations of the equipment or propagation errors from approximate numbers used in calculations. Sample bias is the most common and sometimes the hardest bias to quantify. Statisticians often go to great lengths to ensure that the sample used is representative. For instance political polls are best when restricted to likely voters and this is one of the reasons why web polls cannot be considered scientific. The sample size is another important concept and can lead to biased data simply due to an unlikely event. A sample size of 10, i.e., polling 10 people, will seldom give valid polling results. Standard deviation and variance are concepts used to quantify the likely relevance of a given sample size. The placebo effect and observer bias often require an experiment to use a double blind protocol and a control group.
- A single blind protocol requires that the subject does not know the specifics of the experiment, but the experimenter is privy to the details. It is appropriate when no human subjects are involved.
- A double blind protocol comes into play when human subjects are tested and requires ensuring neither the experimenter nor experimental subjects have knowledge of the identity of the treatments or the results until after the experiment is complete.
- A triple blind protocol is used when it is required that neither the experimenter, experimental subject(s), nor statisticians have knowledge of the identity of the treatments or the results until after the experiment is complete.
An experimenter may have latitude defining procedures for blinding and controls but may be required to justify those choices if the results are published or submitted to a regulatory agency. When it is known during the experiment which data was negative there are often reasons to rationalize why that data shouldn't be included. Positive data are rarely rationalized the same way.
- Adaptive clinical trial
- Blocking (statistics)
- Design of experiments
- Double blind
- Estimation theory
- Margin of error
- Medical guideline
- Milwaukee protocol
- Observational error
- Paradigm (experimental)
- Propagation of error
- Protein methods and Nucleic acid methods
- Random error
- Randomized controlled trial
- Sample (statistics)
- Sample size
- Sampling error
- Scientific control
- Standard deviation
- Statistical population
- Survey sampling
- Systematic error
- Triple blind
- Hinkelmann, K.; Kempthorne, O. (1994). Design and Analysis of Experiments: Introduction to Experimental Design. 1. John Wiley & Sons. p. 11. ISBN 0471551783. Retrieved 22 March 2019.CS1 maint: Multiple names: authors list (link)
- Selwyn, M.R. (1996). Principles of Experimental Design for the Life Sciences. CRC Press. pp. 12–13. ISBN 0849394619. Retrieved 22 March 2019.
- Desposato, S. (2015). Ethics and Experiments: Problems and Solutions for Social Scientists and Policy Professionals. Routledge. p. PT382. ISBN 9781317438663.
- American Society for Microbiology (2016). "Laboratory Protocols". Retrieved 22 March 2019.
- National Research Council Canada (June 2003). "Recommended practices for calibration laboratories". Retrieved 22 March 2019.
- Nash, T. (July 2005). "Automotive Protocols & Standards". Motor. Retrieved 22 March 2019.
- Thiagarajan, S. (1980). Protocol Packages. Educational Technology Publications. p. 3. ISBN 0877781516. Retrieved 22 March 2019.
- Reading, H.F. (1996). Dictionary of the Social Sciences. Atlantic Publishers and Distributors. p. 164. ISBN 8171566057. Retrieved 23 March 2019.
- Fiske, D.W. (1986). Metatheory in Social Science: Pluralisms and Subjectivities. University of Chicago Press. p. 61–62. ISBN 0226251926. Retrieved 22 March 2019.
- O'Shaughnessy, J. (2012). Consumer Behaviour: Perspectives, Findings and Explanations. Palgrave Macmillan. pp. 71–2. ISBN 9781137003768.
- World Health Organization; TDR (2009). "Chapter 2: Good Laboratory Practice Training". Handbook: Good Laboratory Practice (2nd ed.). WHO. pp. 10–13. ISBN 9789241547550. Retrieved 23 March 2019.
- World Health Organization (2002). "Handbook for Good Clinical Research Practice (GCP): Guidance for Implementation" (PDF). WHO. pp. 27–34. Retrieved 23 March 2019.
- World Health Organization (2002). "Handbook for Good Clinical Research Practice (GCP): Guidance for Implementation" (PDF). WHO. p. 12. Retrieved 23 March 2019.
- National center for Complementary and Integrative Health (24 July 2018). "NCCIH Clinical Research Toolbox". NIH. Retrieved 23 March 2019.
NCCIH requires that study investigators submit a final protocol document for all funded clinical projects.
- "History". CONSORT. Retrieved 23 March 2019.
- Holman, L.; Head, M.L.; Lanfear, R.; Jennions, M.D. (2015). "Evidence of Experimental Bias in the Life Sciences: Why We Need Blind Data Recording". PLoS Biology. 13 (7): e1002190. doi:10.1371/journal.pbio.1002190. PMC 4496034.CS1 maint: Multiple names: authors list (link)
- Salkind, N.J., ed. (2010). "Trible-Blind Study". Encyclopedia of Research Design. Sage. doi:10.4135/9781412961288.n471. Retrieved 23 March 2019.