Clinical trials are experiments done in clinical research. Such prospective biomedical or behavioral research studies on human participants are designed to answer specific questions about biomedical or behavioral interventions, including new treatments (such as novel vaccines, drugs, dietary choices, dietary supplements, and medical devices) and known interventions that warrant further study and comparison. Clinical trials generate data on safety and efficacy. They are conducted only after they have received health authority/ethics committee approval in the country where approval of the therapy is sought. These authorities are responsible for vetting the risk/benefit ratio of the trial - their approval does not mean that the therapy is 'safe' or effective, only that the trial may be conducted.
Depending on product type and development stage, investigators initially enroll volunteers and/or patients into small pilot studies, and subsequently conduct progressively larger scale comparative studies. Clinical trials can vary in size and cost, and they can involve a single research center or multiple centers, in one country or in multiple countries. Clinical study design aims to ensure the scientific validity and reproducibility of the results.
Trials can be quite costly, depending on a number of factors. The sponsor may be a governmental organization or a pharmaceutical, biotechnology or medical device company. Certain functions necessary to the trial, such as monitoring and lab work, may be managed by an outsourced partner, such as a contract research organization or a central laboratory.
- 1 Overview
- 2 History
- 3 Types
- 4 Trial design
- 5 Administration
- 6 Ethical aspects
- 7 Safety
- 8 Economics
- 9 Participating in a clinical trial
- 10 Clinical trials around the world
- 11 References
- 12 Further reading
- 13 External links
Trials of drugs
Some clinical trials involve healthy subjects with no pre-existing medical conditions. Other clinical trials pertain to patients with specific health conditions who are willing to try an experimental treatment.
When participants are healthy volunteers who receive financial incentives, the goals are different than when the participants are sick. During dosing periods, study subjects typically remain under supervision for one to 40 nights.
Usually pilot experiments are conducted to gain insights for design of the clinical trial to follow.
There are two goals to testing medical treatments: to learn whether they work well enough, called "efficacy" or "effectiveness"; and to learn whether they are safe enough, called "safety". Neither is an absolute criterion; both safety and efficacy are evaluated relative to how the treatment is intended to be used, what other treatments are available, and the severity of the disease or condition. The benefits must outweigh the risks.:8 For example, many drugs to treat cancer have severe side effects that would not be acceptable for an over-the-counter pain medication, yet the cancer drugs have been approved since they are used under a physician's care, and are used for a life-threatening condition.
In the US, the elderly constitute only 14% of the population, while they consume over one-third of drugs. People over 55 (or a similar cutoff age) are often excluded from trials because their greater health issues and drug use complicate data interpretation, and because they have different physiological capacity than younger people. Women, children and people with unrelated medical conditions are also frequently excluded. For women, a major reason for exclusion is the possibility of pregnancy and the unknown risks to the fetus.
The sponsor designs the trial in coordination with a panel of expert clinical investigators, including what alternative/existing treatments to compare to the new drug and what type(s) of patients might benefit. If the sponsor cannot obtain enough subjects at one location, investigators at other locations are recruited to join the study.
During the trial, investigators recruit patients with the predetermined characteristics, administer the treatment(s) and collect data on the patients' health for a defined time period.
Subjects are volunteers who are not paid for participating. (However, the investigators are paid.)
Data include measurements such as vital signs, concentration of the study drug in the blood and/or tissues, changes to symptoms and whether health outcomes. The researchers send the data to the trial sponsor, who then analyzes the pooled data using statistical tests.
Examples of clinical trial goals include assessing the safety and (relative) effectiveness of a medication or device:
- On a specific kind of patient (e.g., patients who have been diagnosed with Alzheimer's disease)
- At a different dose (e.g., 10-mg dose instead of 5-mg dose)
- For a new indication
- Is more effective for the patient's condition than the standard therapy
- Relative to two or more already approved/common interventions for that disease (e.g., device A vs. device B, therapy A vs. therapy B)
While most clinical trials test one alternative to the novel intervention, some expand to three or four.
Except for small, single-location trials, the design and objectives are speciied in a document called a clinical trial protocol. The protocol is the trial's 'operating manual' and ensures that all researchers perform the trial in the same way on similar patients and that the data is comparable across all patients.
The most common clinical trials evaluate new drugs, medical devices (such as a new catheter), biologics, psychological therapies, or other interventions. Clinical trials may be required before a national regulatory authority approves marketing of the innovation.
Trials of devices
Similarly to drugs, medical devices are sometimes subjected to clinical trials. Device trials may compare a new device to an established therapy to a new device, or may compare similar devices to each other. An example of the former in the field of vascular surgery is the Open versus Endovascular Repair (OVER trial) for the treatment of abdominal aortic aneurysm, which compared the older open aortic repair technique to the newer endovascular aneurysm repair device. An example of the latter is the LEOPARD trial, which compares EVAR devices.
The concepts behind clinical trials are ancient. The Book of Daniel chapter 1, verses 12 through 15, for instance, describes a planned experiment with both baseline and follow-up observations of two groups who either partook of, or did not partake of, "the King's meat" over a trial period of ten days. Persian physician Avicenna, in The Canon of Medicine (1025) gave similar advice for determining the efficacy of medical drugs and substances.
Although early medical experimentation was often performed, the use of a control group to provide an accurate comparison for the demonstration of the intervention's efficacy, was generally lacking. For instance, Lady Mary Wortley Montagu, who campaigned for the introduction of inoculation (then called variolation) to prevent smallpox, arranged for seven prisoners who had been sentenced to death to undergo variolation in exchange for their life. Although they survived and did not contract smallpox, there was no control group to assess whether this result was due to the inoculation or some other factor. Similar experiments performed by Edward Jenner over his smallpox vaccine were equally conceptually flawed.
The first proper clinical trial was conducted by the physician James Lind. The disease scurvy, now known to be caused by a Vitamin C deficiency, would often have terrible effects on the welfare of the crew of long distance voyages. In 1740, the catastrophic result of Anson's circumnavigation attracted much attention in Europe; out of 1900 men, 1400 had died, most of them allegedly from having contracted scurvy. John Woodall, an English military surgeon of the British East India Company, had recommended the consumption of citrus fruit (it has an antiscorbutic effect) from the 17th century, but their use did not become widespread.
Lind conducted the first systematic clinical trial in 1747. He included a dietary supplement of an acidic quality in the experiment after two months at sea, when the ship was already afflicted with scurvy. He divided twelve scorbutic sailors into six groups of two. They all received the same diet but, in addition, group one was given a quart of cider daily, group two twenty-five drops of elixir of vitriol (sulfuric acid), group three six spoonfuls of vinegar, group four half a pint of seawater, group five received two oranges and one lemon, and the last group a spicy paste plus a drink of barley water. The treatment of group five stopped after six days when they ran out of fruit, but by that time one sailor was fit for duty while the other had almost recovered. Apart from that, only group one also showed some effect of its treatment.
After 1750 the discipline began to take its modern shape. John Haygarth demonstrated the importance of a control group for the correct identification of the placebo effect in his celebrated study of the ineffective remedy called Perkin's tractors. Further work in that direction was carried out by the eminent physician Sir William Gull, 1st Baronet in the 1860s.
Frederick Akbar Mahomed (d. 1884), who worked at Guy's Hospital in London, made substantial contributions to the process of clinical trials, where "he separated chronic nephritis with secondary hypertension from what we now term essential hypertension. He also founded the Collective Investigation Record for the British Medical Association; this organization collected data from physicians practicing outside the hospital setting and was the precursor of modern collaborative clinical trials."
Sir Ronald A. Fisher, while working for the Rothamsted experimental station in the field of agriculture, developed his Principles of experimental design in the 1920s as an accurate methodology for the proper design of experiments. Among his major ideas, was the importance of randomization - the random assignment of individuals to different groups for the experiment; replication - to reduce uncertainty, measurements should be repeated and experiments replicated to identify sources of variation; blocking - to arrange experimental units into groups of units that are similar to each other, and thus reducing irrelevant sources of variation; use of factorial experiments - efficient at evaluating the effects and possible interactions of several independent factors.
The British Medical Research Council officially recognized the importance of clinical trials from the 1930s. The Council established the Therapeutic Trials Committee to advise and assist in the arrangement of properly controlled clinical trials on new products that seem likely on experimental grounds to have value in the treatment of disease.
The first randomised curative trial was carried out at the MRC Tuberculosis Research Unit by Sir Geoffrey Marshall (1887–1982). The trial, carried out between 1946-1947, aimed to test the efficacy of the chemical streptomycin for curing pulmonary tuberculosis. The trial was both double-blind and placebo-controlled.
The methodology of clinical trials was further developed by Sir Austin Bradford Hill, who had been involved in the streptomcyin trials. From the 1920s, Hill applied statistics to medicine, attending the lectures of renowned mathematician Karl Pearson, amongst others. He became famous for a landmark study carried out in collaboration with Richard Doll on the correlation between smoking and lung cancer. They carried out a case-control study in 1950, which compared lung cancer patients with matched control and also began a sustained long-term prospective study into the broader issue of smoking and health, which involved studying the smoking habits and health of over 30,000 doctors over a period of several years. His certificate for election to the Royal Society called him "...the leader in the development in medicine of the precise experimental methods now used nationally and internationally in the evaluation of new therapeutic and prophylactic agents."
International clinical trials day is celebrated on 20 May.
One way of classifying clinical trials is by the way the researchers behave.
- In a clinical observational study, the investigators observe the subjects and measure their outcomes. The researchers do not actively manage the study.
- In an interventional study, the investigators give the research subjects a particular medicine or other intervention. Usually, they compare the treated subjects to subjects who receive no treatment or standard treatment. Then the researchers measure how the subjects' health changes.
- Prevention trials look for better ways to prevent disease in people who have never had the disease or to prevent a disease from returning. These approaches may include medicines, vitamins, vaccines, minerals, or lifestyle changes.
- Screening trials test the best way to detect certain diseases or health conditions.
- Diagnostic trials are conducted to find better tests or procedures for diagnosing a particular disease or condition.
- Treatment trials test experimental treatments, new combinations of drugs, or new approaches to surgery or radiation therapy.
- Quality of life trials (supportive care trials) explore ways to improve comfort and the quality of life for individuals with a chronic illness.
- Compassionate use trials or expanded access trials provide partially tested, unapproved therapeutics to a small number of patients who have no other realistic options. Usually, this involves a disease for which no effective therapy has been approved, or a patient who has already failed all standard treatments and whose health is too compromised to qualify for participation in randomized clinical trials. Usually, case-by-case approval must be granted by both the FDA and the pharmaceutical company for such exceptions.
A third classification is whether the trial design allows changes based on data accumulated during the trial.
- Fixed trials consider existing data only during the trial's design, do not modify the trial after it begins and do not assess the results until the study is complete.
- Adaptive clinical trials use existing data to design the trial, and then use interim results to modify the trial as it proceeds. Modifications include dosage, sample size, drug undergoing trial, patient selection criteria and "cocktail" mix. Adaptive trials often employ a Bayesian experimental design to assess the trial's progress. In some cases, trials have become an ongoing process that regularly adds and drops therapies and patient groups as more information is gained. The aim is to more quickly identify drugs that have a therapeutic effect and to zero in on patient populations for whom the drug is appropriate.
Finally, a common way of distinguishing trials is by phase, which in simple terms, relates to how close the drug is to being clinically proven both effective for its stated purpose and accepted by the regulatory authorities for use for that purpose.
Clinical trials involving new drugs are commonly classified into four phases. Each phase of the drug approval process is treated as a separate clinical trial. The drug-development process will normally proceed through all four phases over many years. If the drug successfully passes through Phases 0, 1, 2, and 3, it will usually be approved by the national regulatory authority for use in the general population. Before pharmaceutical companies start clinical trials on a drug, they will also have conducted extensive preclinical studies. Each phase has a different purpose and helps scientists answer a different question.
Phase Aim Notes Phase 0 Pharmacodynamics and pharmacokinetics in humans Phase 0 trials are the first-in-human trials. Single subtherapeutic doses of the study drug or treatment are given to a small number of subjects (10 to 15) to gather preliminary data on the agent's pharmacodynamics (what the drug does to the body) and pharmacokinetics (what the body does to the drugs). For a test drug, the trial documents the absorption, distribution, metabolization, and removal (excretion) of the drug, and the drug's interactions within the body, to confirm that these appear to be as expected. Phase 1 Screening for safety. Testing within a small group of people (20–80) to evaluate safety, determine safe dosage ranges, and begin to identify side effects. A drug's side effects could be subtle or long term, or may only happen with a few of people, so phase 1 trials are not expected to identify all side effects. Phase 2 Establishing the efficacy of the drug, usually against a placebo. Testing with a larger group of people (100–300) to see if it is effective and to further evaluate its safety. The gradual increase in test group size allows less-common side effects to be progressively sought. Phase 3 Final confirmation of safety and efficacy. Testing with large groups of people (1,000–3,000) to confirm its effectiveness, monitor side effects, compare it to commonly used treatments, and collect information that will allow it to be used safely. Phase 4 Sentry studies during sales. postmarketing studies delineate additional information, including the treatment's risks, benefits, and optimal use. As such, they are ongoing during the drug's lifetime of active medical use. (Particularly relevant after approval under FDA Accelerated Approval Program)
|This section does not cite any references or sources. (November 2014)|
A fundamental distinction in evidence-based practice is between observational studies and randomized controlled trials. Types of observational studies in epidemiology, such as the cohort study and the case-control study, provide less compelling evidence than the randomized controlled trial. In observational studies, the investigators only observe associations (correlations) between the treatments experienced by participants and their health status. However, under certain conditions, causal effects can be inferred from observational studies.
A randomized controlled trial can provide compelling evidence that the study treatment causes an effect on human health.
- Randomized: Each study subject is randomly assigned to receive either the study treatment or a placebo.
- Blind: The subjects involved in the study do not know which study treatment they receive. If the study is double-blind, the researchers also do not know which treatment a subject receives. This intent is to prevent researchers from treating the two groups differently. A form of double-blind study called a "double-dummy" design allows additional insurance against bias. In this kind of study, all patients are given both placebo and active doses in alternating periods.
- Placebo-controlled: The use of a placebo (fake treatment) allows the researchers to isolate the effect of the study treatment from the placebo effect.
Although the term "clinical trials" is most commonly associated with the large, randomized studies typical of Phase 3, many clinical trials are small. They may be "sponsored" by single researchers or a small group of researchers, and are designed to test simple questions. In the field of rare diseases, sometimes the number of patients is the limiting factor for the size of a clinical trial.
Active comparator studies
Of note, during the last 10 years or so, it has become a common practice to conduct "active comparator" studies (also known as "active control" trials). In other words, when a treatment is clearly better than doing nothing for the subject (i.e. giving them the placebo), the alternate treatment would be a standard-of-care therapy. The study would compare the 'test' treatment to standard-of-care therapy.
A growing trend in the pharmacology field involves the use of third-party contractors to obtain the required comparator compounds. Such third parties provide expertise in the logistics of obtaining, storing, and shipping the comparators. As an advantage to the manufacturer of the comparator compounds, a well-established comparator sourcing agency can alleviate the problem of parallel importing (importing a patented compound for sale in a country outside the patenting agency's sphere of influence).
In such studies, multiple experimental treatments are tested in a single trial. Genetic testing enables researchers to group patients according to their genetic profile, deliver drugs based on that profile to that group and compare the results. Multiple companies can participate, each bringing a different drug. The first such approach targets squamous cell cancer, which includes varying genetic disruptions from patient to patient. Amgen, AstraZeneca and Pfizer are involved, the first time they have worked together in a late-stage trial. Patients whose genomic profiles do not match any of the trial drugs receive a drug designed to stimulate the immune system to attack cancer.
Clinical trial protocol
A clinical trial protocol is a document used to define and manage the trial. It is prepared by a panel of experts. All study investigators are expected to strictly observe the protocol.
The protocol describes the scientific rationale, objective(s), design, methodology, statistical considerations and organization of the planned trial. Details of the trial are provided in documents referenced in the protocol, such as an investigator's brochure.
The protocol contains a precise study plan to assure safety and health of the trial subjects and to provide an exact template for trial conduct by investigators. This allows data to be combined across all investigators/sites. The protocol also informs the study administrators (often a contract research organization).
The format and content of clinical trial protocols sponsored by pharmaceutical, biotechnology or medical device companies in the United States, European Union, or Japan have been standardized to follow Good Clinical Practice guidance issued by the International Conference on Harmonization of Technical Requirements for Registration of Pharmaceuticals for Human Use (ICH). Regulatory authorities in Canada and Australia also follow ICH guidelines. Journals such as Trials, encourage investigators to publish their protocols.
Clinical trials recruit study subjects to sign a document representing their "informed consent". The document includes details such as its purpose, duration, required procedures, risks, potential benefits and key contacts. The participant then decides whether to sign the document. The document is not a contract, as the participant can withdraw at any time without penalty.
Informed consent is a legal process in which a recruit is instructed about key facts before deciding whether to participate. Researchers explain the details of the study in terms the subject can understand. The information is presented in the subject's native language. Generally, children cannot autonomously provide informed consent, but depending on their age and other factors, may be required to provide informed assent.
|This section does not cite any references or sources. (November 2014)|
The number of subjects has a large impact on the ability to reliably detect and measure effects of the intervention. This is described as its "power". The larger the number of participants, the greater the statistical power and the greater the cost.
The statistical power estimates the ability of a trial to detect a difference of a particular size (or larger) between the treatment and control groups. For example, a trial of a lipid-lowering drug versus placebo with 100 patients in each group might have a power of 0.90 to detect a difference between placebo and trial groups receiving dosage of 10 mg/dL or more, but only 0.70 to detect a difference of 6 mg/dL.
Merely giving a treatment can have nonspecific effects. These are controlled for by the inclusion of patients who receive only a placebo. Subjects are assigned randomly without informing them to which group they belonged. Many trials are doubled-blinded so that researchers do not know to which group a subject is assigned.
Assigning a subject to a placebo group can pose an ethical problem if it violates his or her right to receive the best available treatment. The Declaration of Helsinki provides guidelines on this issue.
Clinical trials are only a small part of the research that goes into developing a new treatment. Potential drugs, for example, first have to be discovered, purified, characterized, and tested in labs (in cell and animal studies) before ever undergoing clinical trials. In all, about 1,000 potential drugs are tested before just one reaches the point of being tested in a clinical trial. For example, a new cancer drug has, on average, six years of research behind it before it even makes it to clinical trials. But the major holdup in making new cancer drugs available is the time it takes to complete clinical trials themselves. On average, about eight years pass from the time a cancer drug enters clinical trials until it receives approval from regulatory agencies for sale to the public. Drugs for other diseases have similar timelines.
Some reasons a clinical trial might last several years:
- For chronic conditions such as cancer, it takes months, if not years, to see if a cancer treatment has an effect on a patient.
- For drugs that are not expected to have a strong effect (meaning a large number of patients must be recruited to observe 'any' effect), recruiting enough patients to test the drug's effectiveness (i.e., getting statistical power) can take several years.
- Only certain people who have the target disease condition are eligible to take part in each clinical trial. Researchers who treat these particular patients must participate in the trial. Then they must identify the desirable patients and obtain consent from them or their families to take part in the trial.
The biggest barrier to completing studies is the shortage of people who take part. All drug and many device trials target a subset of the population, meaning not everyone can participate. Some drug trials require patients to have unusual combinations of disease characteristics. It is a challenge to find the appropriate patients and obtain their consent, especially when they may receive no direct benefit (because they are not paid, the study drug is not yet proven to work, or the patient may receive a placebo). In the case of cancer patients, fewer than 5% of adults with cancer will participate in drug trials. According to the Pharmaceutical Research and Manufacturers of America (PhRMA), about 400 cancer medicines were being tested in clinical trials in 2005. Not all of these will prove to be useful, but those that are may be delayed in getting approved because the number of participants is so low.
For clinical trials involving a seasonal indication (such as airborne allergies, seasonal affective disorder, influenza, and others), the study can only be done during a limited part of the year (such as spring for pollen allergies), when the drug can be tested. This can be an additional complication on the length of the study, yet proper planning and the use of trial sites in the Southern, as well as the Northern Hemisphere allows for year-round trials, which can reduce the length of the studies.
Clinical trials that do not involve a new drug usually have a much shorter duration. (Exceptions are epidemiological studies, such as the Nurses' Health Study).
|This section does not cite any references or sources. (November 2014)|
Clinical trials designed by a local investigator, and (in the US) federally funded clinical trials, are almost always administered by the researcher who designed the study and applied for the grant. Small-scale device studies may be administered by the sponsoring company. Clinical trials of new drugs are usually administered by a contract research organization (CRO) hired by the sponsoring company. The sponsor provides the drug and medical oversight. A CRO is contracted to perform all the administrative work on a clinical trial. For Phases 2, 3 and 4, the CRO recruits participating researchers, trains them, provides them with supplies, coordinates study administration and data collection, sets up meetings, monitors the sites for compliance with the clinical protocol, and ensures the sponsor receives data from every site. Specialist site management organizations can also be hired to coordinate with the CRO to ensure rapid IRB/IEC approval and faster site initiation and patient recruitment. Phase 1 clinical trials of new medicines are often conducted in a specialist clinical trial clinic, with dedicated pharmacologists, where the subjects can be observed by full-time staff. These clinics are often run by a CRO which specialises in these studies.
At a participating site, one or more research assistants (often nurses) do most of the work in conducting the clinical trial. The research assistant's job can include some or all of the following: providing the local institutional review board (IRB) with the documentation necessary to obtain its permission to conduct the study, assisting with study start-up, identifying eligible patients, obtaining consent from them or their families, administering study treatment(s), collecting and statistically analyzing data, maintaining and updating data files during followup, and communicating with the IRB, as well as the sponsor and CRO.
Janet Yang uses the Interactional Justice Model to test the effects of willingness to talk with a doctor and clinical trial enrollment. Results found that potential clinical trial candidates were less likely to enroll in clinical trials if the patient is more willing to talk with their doctor. The reasoning behind this discovery may be patients are happy with their current care. Another reason for the negative relationship between perceived fairness and clinical trial enrollment is the lack of independence from the care provider. Results found that there is a positive relationship between a lack of willingness to talk with their doctor and clinical trial enrollment. Lack of willingness to talk about clinical trials with current care providers may be due to patients’ independence from the doctor. Patients who are less likely to talk about clinical trials are more willing to use other sources of information to gain a better incite of alternative treatments. Clinical trial enrollment should be motivated to utilize websites and television advertising to inform the public about clinical trial enrollment.
The last decade has seen a proliferation of information technology use in the planning and conduct of clinical trials. Clinical trial management systems are often used by research sponsors or CROs to help plan and manage the operational aspects of a clinical trial, particularly with respect to investigational sites. Advanced analytics for identifying researchers and research sites with expertise in a given area utilize public and private information about ongoing research. Web-based electronic data capture (EDC) and clinical data management systems are used in a majority of clinical trials to collect case report data from sites, manage its quality and prepare it for analysis. Interactive voice response systems are used by sites to register the enrollment of patients using a phone and to allocate patients to a particular treatment arm (although phones are being increasingly replaced with web-based (IWRS) tools which are sometimes part of the EDC system). While patient-reported outcome were often paper based in the past, measurements are increasingly being collected using web portals or hand-held ePRO (or eDiary) devices, sometimes wireless. Statistical software is used to analyze the collected data and prepare them for regulatory submission. Access to many of these applications are increasingly aggregated in web-based clinical trial portals. In 2011, the FDA approved a Phase 1 trial that used telemonitoring, also known as remote patient monitoring, to collect biometric data in patients' homes and transmit it electronically to the trial database. This technology provides many more data points and is far more convenient for patients, because they have fewer visits to trial sites.
Clinical trials are closely supervised by appropriate regulatory authorities. All studies involving a medical or therapeutic intervention on patients must be approved by a supervising ethics committee before permission is granted to run the trial. The local ethics committee has discretion on how it will supervise noninterventional studies (observational studies or those using already collected data). In the US, this body is called the Institutional Review Board (IRB). Most IRBs are located at the local investigator's hospital or institution, but some sponsors allow the use of a central (independent/for profit) IRB for investigators who work at smaller institutions.
To be ethical, researchers must obtain the full and informed consent of participating human subjects. (One of the IRB's main functions is to ensure potential patients are adequately informed about the clinical trial.) If the patient is unable to consent for him/herself, researchers can seek consent from the patient's legally authorized representative. In California, the state has prioritized the individuals who can serve as the legally authorized representative.
In some US locations, the local IRB must certify researchers and their staff before they can conduct clinical trials. They must understand the federal patient privacy (HIPAA) law and good clinical practice. The International Conference of Harmonisation Guidelines for Good Clinical Practice is a set of standards used internationally for the conduct of clinical trials. The guidelines aim to ensure the "rights, safety and well being of trial subjects are protected".
The notion of informed consent of participating human subjects exists in many countries all over the world, but its precise definition may still vary.
Informed consent is clearly a 'necessary' condition for ethical conduct but does not 'ensure' ethical conduct. The final objective is to serve the community of patients or future patients in a best-possible and most responsible way. However, it may be hard to turn this objective into a well-defined, quantified, objective function. In some cases this can be done, however, for instance, for questions of when to stop sequential treatments (see Odds algorithm), and then quantified methods may play an important role.
Conflicts of interest and unfavorable studies
In response to specific cases in which unfavorable data from pharmaceutical company-sponsored research were not published, the Pharmaceutical Research and Manufacturers of America published new guidelines urging companies to report all findings and limit the financial involvement in drug companies by researchers. The US Congress signed into law a bill which requires phase II and phase III clinical trials to be registered by the sponsor on the the clinical trials website compiled by the National Institutes of Health.
Drug researchers not directly employed by pharmaceutical companies often seek grants from manufacturers, and manufacturers often look to academic researchers to conduct studies within networks of universities and their hospitals, e.g., for translational cancer research. Similarly, competition for tenured academic positions, government grants and prestige create conflicts of interest among academic scientists. According to one study, approximately 75% of articles retracted for misconduct-related reasons have no declared industry financial support. Seeding trials are particularly controversial.
In the United States, all clinical trials submitted to the FDA as part of a drug approval process are independently assessed by clinical experts within the Food and Drug Administration, including inspections of primary data collection at selected clinical trial sites.
In 2001, the editors of 12 major journals issued a joint editorial, published in each journal, on the control over clinical trials exerted by sponsors, particularly targeting the use of contracts which allow sponsors to review the studies prior to publication and withhold publication. They strengthened editorial restrictions to counter the effect. The editorial noted that contract research organizations had, by 2000, received 60% of the grants from pharmaceutical companies in the US. Researchers may be restricted from contributing to the trial design, accessing the raw data, and interpreting the results.
Responsibility for the safety of the subjects in a clinical trial is shared between the sponsor, the local site investigators (if different from the sponsor), the various IRBs that supervise the study, and (in some cases, if the study involves a marketable drug or device), the regulatory agency for the country where the drug or device will be sold.
For safety reasons, many clinical trials of drugs are designed to exclude women of childbearing age, pregnant women, and/or women who become pregnant during the study. In some cases, the male partners of these women are also excluded or required to take birth control measures.
Throughout the clinical trial, the sponsor is responsible for accurately informing the local site investigators of the true historical safety record of the drug, device or other medical treatments to be tested, and of any potential interactions of the study treatment(s) with already approved treatments. This allows the local investigators to make an informed judgment on whether to participate in the study or not. The sponsor is also responsible for monitoring the results of the study as they come in from the various sites, as the trial proceeds. In larger clinical trials, a sponsor will use the services of a data monitoring committee (DMC, known in the US as a data safety monitoring board). This independent group of clinicians and statisticians meets periodically to review the unblinded data the sponsor has received so far. The DMC has the power to recommend termination of the study based on their review, for example if the study treatment is causing more deaths than the standard treatment, or seems to be causing unexpected and study-related serious adverse events.The sponsor is responsible for collecting adverse event reports from all site investigators in the study, and for informing all the investigators of the sponsor's judgment as to whether these adverse events were related or not related to the study treatment. This is an area where sponsors can slant their judgment to favor the study treatment.
The sponsor and the local site investigators are jointly responsible for writing a site-specific informed consent that accurately informs the potential subjects of the true risks and potential benefits of participating in the study, while at the same time presenting the material as briefly as possible and in ordinary language. FDA regulations and ICH guidelines both require "the information that is given to the subject or the representative shall be in language understandable to the subject or the representative." If the participant's native language is not English, the sponsor must translate the informed consent into the language of the participant.
Local site investigators
|This section does not cite any references or sources. (November 2014)|
The ethical principle of primum non nocere guides the trial, and if an investigator believes the study treatment may be harming subjects in the study, the investigator can stop participating at any time. On the other hand, investigators often have a financial interest in recruiting subjects, and can act unethically to obtain and maintain their participation.
The local investigators are responsible for conducting the study according to the study protocol, and supervising the study staff throughout the duration of the study. The local investigator or his/her study staff are also responsible for ensuring the potential subjects in the study understand the risks and potential benefits of participating in the study; in other words, they (or their legally authorized representatives) must give truly informed consent. They are responsible for reviewing all adverse event reports sent by the sponsor. (These adverse event reports contain the opinion of both the investigator at the site where the adverse event occurred, and the sponsor, regarding the relationship of the adverse event to the study treatments). They also are responsible for making an independent judgment of these reports, and promptly informing the local IRB of all serious and study treatment-related adverse events.
When a local investigator is the sponsor, there may not be formal adverse event reports, but study staff at all locations are responsible for informing the coordinating investigator of anything unexpected. The local investigator is responsible for being truthful to the local IRB in all communications relating to the study.
Institutional review boards (IRBs)
Approval by an Institutional Review Board (IRB), or ethics board, is necessary before all but the most informal research can begin. In commercial clinical trials, the study protocol is not approved by an IRB before the sponsor recruits sites to conduct the trial. However, the study protocol and procedures have been tailored to fit generic IRB submission requirements. In this case, and where there is no independent sponsor, each local site investigator submits the study protocol, the consent(s), the data collection forms, and supporting documentation to the local IRB. Universities and most hospitals have in-house IRBs. Other researchers (such as in walk-in clinics) use independent IRBs.
The IRB scrutinizes the study for both medical safety and protection of the patients involved in the study, before it allows the researcher to begin the study. It may require changes in study procedures or in the explanations given to the patient. A required yearly "continuing review" report from the investigator updates the IRB on the progress of the study and any new safety information related to the study.
In the US, the FDA can audit the files of local site investigators after they have finished participating in a study, to see if they were correctly following study procedures. This audit may be random, or for cause (because the investigator is suspected of fraudulent data). Avoiding an audit is an incentive for investigators to follow study procedures.
Alternatively, many American pharmaceutical companies have moved some clinical trials overseas. Benefits of conducting trials abroad include lower costs (in some countries) and the ability to run larger trials in shorter timeframes. Critics have argued that clinical trials performed outside the U.S. allow companies to avoid many of the FDA’s regulations, since the FDA audits these trials less frequently than U.S. studies. For drug applications approved by the FDA in 2008, 0.7 percent of foreign clinical study sites were audited by the FDA compared to 1.9 percent domestically. Other criticisms of foreign clinical studies, especially in developing countries, relate to the rights and welfare of study participants, integrity of study data, and relevance of data to the U.S. population.
Different countries have different regulatory requirements and enforcement abilities. An estimated 40% of all clinical trials now take place in Asia, Eastern Europe, and Central and South America. "There is no compulsory registration system for clinical trials in these countries and many do not follow European directives in their operations", says Jacob Sijtsma of the Netherlands-based WEMOS, an advocacy health organisation tracking clinical trials in developing countries.
Beginning in the 1980s, harmonization of clinical trial protocols was shown as feasible across countries of the European Union. At the same time, coordination between Europe, Japan and the United States led to a joint regulatory-industry initiative on international harmonization named after 1990 as the International Conference on Harmonisation of Technical Requirements for Registration of Pharmaceuticals for Human Use (ICH) Currently, most clinical trial programs follow ICH guidelines, aimed at "ensuring that good quality, safe and effective medicines are developed and registered in the most efficient and cost-effective manner. These activities are pursued in the interest of the consumer and public health, to prevent unnecessary duplication of clinical trials in humans and to minimize the use of animal testing without compromising the regulatory obligations of safety and effectiveness."
The cost of a study depends on many factors, especially the number of sites conducting the study, the number of patients required, and whether the study treatment is already approved for medical use. Clinical trials follow a standardized process.
The costs to a pharmaceutical company of administering a Phase 3 or 4 clinical trial may include, among others:
- manufacturing the drug(s)/device(s) tested
- staff salaries for the designers and administrators of the trial
- payments to the contract research organization, the site management organization (if used) and any outside consultants
- payments to local researchers (and their staffs) for their time and effort in recruiting patients and collecting data for the sponsor
- study materials and shipping
- communication with the local researchers, including on-site monitoring by the CRO before and (in some cases) multiple times during the study
- one or more investigator training meetings
- costs incurred by the local researchers, such as pharmacy fees, IRB fees and postage
- any payments to patients enrolled in the trial (all payments are strictly overseen by the IRBs to ensure the patients do not feel coerced to take part in the trial by overly attractive payments)
These costs are incurred over several years.
National health agencies, such as the US National Institutes of Health, offer grants to investigators who design clinical trials that attempt to answer research questions of interest to the agency. In these cases, the investigator who writes the grant and administers the study acts as the sponsor, and coordinates data collection from any other sites. These other sites may or may not be paid for participating in the study, depending on the amount of the grant and the amount of effort expected from them.
Clinical trials are traditionally expensive and difficult to undertake. Using internet resources can, in some cases, reduce the economic burden. New technologies enable sponsors and CRO's to reduce trial costs by executing online feasibility assessments and better collaborate with research centers such as ViS Research Institute.
Many clinical trials do not involve any money. However, when the sponsor is a private company or a national health agency, investigators are almost always paid to participate. These amounts can be small, just covering a partial salary for research assistants and the cost of any supplies (usually the case with national health agency studies), or be substantial and include 'overhead' that allows the investigator to pay the research staff during times between clinical trials.
Participants in Phase 1 drug trials do not gain any direct benefit from taking part. They are generally paid an inconvenience allowance because they give up their time (sometimes away from their homes); the amounts paid are regulated and are not related to the level of risk involved. In most other trials, subjects are not paid to ensure their motivation for participating is the hope of getting better or contributing to medical knowledge, without their judgment being skewed by financial considerations. However, they are often given small payments for study-related expenses such as travel or as compensation for their time in providing follow-up information about their health after they are discharged from medical care.
Participation as labour
It has been suggested that clinical trial participants be considered to be performing ‘experimental' or 'clinical labour’. Re-classifying clinical trials as labour is supported by the fact that information gained from clinical trials contributes to biomedical knowledge, and thus increases the profits of pharmaceutical companies. The labour performed by those participants in clinical trials includes the provision of tissue samples and information, the performance of other tasks, such as adhering to a special diet, or (in the case of Phase I trials particularly) exposing themselves to risk. The participants in exchange are offered potential access to medical treatment. For some, this may be a treatment with the potential to succeed where other treatments have failed. For other individuals, particularly those situated in countries such as China or India, they may be given access to healthcare which they otherwise would be unable to afford, for the duration of the trial. Thus, the exchange which exists may serve to classify clinical trials as a form of labour.
Participating in a clinical trial
Phase 0 and Phase 1 drug trials seek healthy volunteers. Most other clinical trials seek patients who have a specific disease or medical condition. The diversity observed in society, by consensus, should be reflected in clinical trials through the appropriate inclusion of ethnic minority populations. Patient recruitment plays a significant role in the activities and responsibilities of sites conducting clinical trials.
Depending on the kind of participants required, sponsors of clinical trials, or contract research organizations working on their behalf, try to find sites with qualified personnel as well as access to patients who could participate in the trial. Working with those sites, they may use various recruitment strategies, including patient databases, newspaper and radio advertisements, flyers, posters in places the patients might go (such as doctor's offices), and personal recruitment of patients by investigators.
Volunteers with specific conditions or diseases have additional online resources to help them locate clinical trials. For example, the Fox Trial Finder connects Parkinson's disease trials around the world to volunteers who have a specific set of criteria such as location, age, and symptoms. Other disease-specific services exist for volunteers to find trials related to their condition. Volunteers may search directly on ClinicalTrials.gov to locate trials using a registry run by the U.S. National Institutes of Health and National Library of Medicine.
However, many clinical trials will not accept participants who contact them directly to volunteer, as it is believed this may bias the characteristics of the population being studied. Such trials typically recruit via networks of medical professionals who ask their individual patients to consider enrollment.
Steps for volunteers
Before participating in a clinical trial, interested volunteers should speak with their doctors, family members, and others who have participated in trials in the past. After locating a trial, volunteers will often have the opportunity to speak or e-mail the clinical trial coordinator for more information and to answer any questions. After receiving consent from their doctors, volunteers then arrange an appointment for a screening visit with the trial coordinator.
All volunteers being considered for a trial are required to undertake a medical screening. Requirements differ for different trials, but typically volunteers will have the following tests in a medical laboratory:
- Measurement of the electrical activity of the heart (ECG)
- Measurement of blood pressure, heart rate and temperature
- Blood sampling
- Urine sampling
- Weight and height measurement
- Drugs abuse testing
- Pregnancy testing (females only)
In 2012, Z. Janet Yang, Katherine A. McComas, Geri K. Gay, John P. Leonard, Andrew J. Dannenberg, and Hildy Dillon conducted research on the attitudes towards clinical trial treatment and the decision making of signing up for such trials by cancer patients and the general population. They used the risk information seeking and processing (RISP) model to analyze the social implications that affect attitudes and decision making pertaining to clinical trials. People who hold a higher stake or interest in clinical trial treatment showed a greater likelihood of seeking information about clinical trials. Those with networks that stress the importance of learning about clinical trials are also more likely to seek and process information more deeply. People with more knowledge about clinical trials tend to have to a greater likelihood of signing up. In the study, cancer patients reported more optimistic attitudes towards clinical trials than the general population. Having a more optimistic outlook on clinical trials also leads to greater likelihood of enrolling.
Clinical trials around the world
- USA Clinical Trials:
- European Clinical Trials:
- "Clinical Trials" (PDF). Bill and Melinda Gates Foundation. Retrieved January 2014.
- FDA Page last updated 25 April 2014 FDA's Drug Review Process: Continued
- PhRMA. February 2007 Drug Discovery and Development
- Merck Manual. Last full review/revision October 2013 by Daniel A. Hussar, PhD Overview of Over-the-Counter Drugs
- Avorn J. (2004). Powerful Medicines, pp. 129–33. Alfred A. Knopf.
- Van Spall HG, Toren A, Kiss A, Fowler RA (March 2007). "Eligibility criteria of randomized controlled trials published in high-impact general medical journals: a systematic sampling review". JAMA 297 (11): 1233–40. doi:10.1001/jama.297.11.1233. PMID 17374817.
- The regulatory authority in the USA is the Food and Drug Administration; in Canada, Health Canada; in the European Union, the European Medicines Agency; and in Japan, the Ministry of Health, Labour and Welfare
- . PMID 19826022. Missing or empty
- "LEOPARD trial". Endologix.
- Curtis L. Meinert, Susan Tonascia (1986). Clinical trials: design, conduct, and analysis. Oxford University Press, USA. p. 3. ISBN 978-0-19-503568-1.
- Simon, Harvey B. (2002). The Harvard Medical School guide to men's health. New York: Free Press. p. 31. ISBN 0-684-87181-5.
- Brown, Stephen R. (2003). Scurvy: How a Surgeon, a Mariner, and a Gentleman Solved the Greatest Medical Mystery of the Age of Sail. New York, NY: St. Martin's Press. ISBN 0-312-31391-8
- Rogers, Everett M. (1995). Diffusion of Innovations. New York, NY: The Free Press. ISBN 0-7432-2209-1. Page 7.
- Carlisle, Rodney (2004). Scientific American Inventions and Discoveries, John Wiley & Songs, Inc., New Jersey. p. 393. ISBN 0-471-24410-4.
- "James Lind: A Treatise of the Scurvy (1754)". 2001. Retrieved 9 September 2007.
- Stephanie Green; John Crowley; Jacqueline Benedetti; Angela Smith (30 July 2002). Clinical Trials in Oncology, Second Edition. CRC Press. pp. 1–. ISBN 978-1-4200-3530-8.
- Shayne Cox Gad (17 June 2009). Clinical Trials Handbook. John Wiley & Sons. pp. 118–. ISBN 978-0-470-46635-3.
- O'Rourke, Michael F. (1992). "Frederick Akbar Mahomed". Hypertension (American Heart Association) 19 (2): 212–217 . doi:10.1161/01.HYP.19.2.212.
- Creswell, J.W. (2008). Educational research: Planning, conducting, and evaluating quantitative and qualitative research (3rd). Upper Saddle River, NJ: Prentice Hall. 2008, p. 300. ISBN 0-13-613550-1
- Hani (2009). "Replication study". Retrieved 27 October 2011.
- Metcalfe NH (February 2011). "Sir Geoffrey Marshall (1887-1982): respiratory physician, catalyst for anaesthesia development, doctor to both Prime Minister and King, and World War I Barge Commander". J Med Biogr 19 (1): 10–4. doi:10.1258/jmb.2010.010019. PMID 21350072.
- Pharmabiz.com, 19 May 2014, Mumbai ISCR releases Guide for clinical trial participants on International Clinical Trials Day (Accessed on 20 May 2014)
- "Glossary of Common Site Terms". clinicaltrials.gov.
- Helene S (2010). "EU Compassionate Use Programmes (CUPs): Regulatory Framework and Points to Consider before CUP Implementation". Pharm Med 24 (4): 223–229. doi:10.1007/BF03256820.
- Brennan 2013.
- "Adaptive Clinical Trials for Overcoming Research Challenges". News-medical.net. Retrieved 2014-01-04.
- Wang, Shirley S. (2013-12-30). "Health: Scientists Look to Improve Cost and Time of Drug Trials - WSJ.com". Online.wsj.com. Retrieved 2014-01-04.
- Peter W. Huber (12 November 2013). The Cure in the Code: How 20th Century Law Is Undermining 21st Century Medicine. Basic Books. ISBN 978-0-465-06981-1.
- The Lancet (2009). "Phase 0 trials: A platform for drug development?". The Lancet 374 (9685): 176–118. doi:10.1016/S0140-6736(09)61309-X. PMID 19616703.
- Young, Susan. "Foundation Medicine Joins Coalition Aiming to Shake Up Cancer Drug Trials | MIT Technology Review". Technologyreview.com. Retrieved 2013-11-14.
- ICH Guideline for Good Clinical Practice: Consolidated Guidance[dead link]
- "ICH Official web site : ICH". ich.org.
- "Learn About Clinical Studies". clinicaltrials.gov.
- "Frequently Asked Questions | University of Arizona Cancer Center". Azcc.arizona.edu. Retrieved 2013-11-14.
- Webb JE, Crossley MJ, Turner P, Thordarson P (2007). "Pyromellitamide aggregates and their response to anion stimuli". J. Am. Chem. Soc. 129 (22): 7155–62. doi:10.1021/ja0713781. PMID 17497782.
- Yamin Khan and Sarah Tilly. "Seasonality: The Clinical Trial Manager's Logistical Challenge" (PDF). Pharm-Olam International (POI). Retrieved 26 April 2010.
- Yamin Khan and Sarah Tilly. "Flu, Season, Diseases Affect Trials". Applied Clinical Trials Online. Retrieved 26 February 2010.
- Yang, Z. J., et al. (2010). "Motivation for Health Information Seeking and Processing About Clinical Trial Enrollment." Health Communication 25(5): 423-436.
- "BIO to Use ViS Analytics to Streamline Pediatric Clinical Research - WSJ.com". Online.wsj.com. 2013-05-07. Retrieved 2013-11-14.[dead link]
- Life Sciences Strategy Group, "Clinical Trial Technology Utilization, Purchasing Preferences & Growth Outlook" Syndicated Publication, May 2009
- "Electronic Patient Reported Outcomes (ePRO) – Changing the Face of Clinical Trials". Med-Quest.org. Retrieved 20 May 2015.
- Assembly Bill No. 2328
- Check Hayden, Erika (11 November 2014). "Ethical dilemma for Ebola drug trials". Nature 515 (7526): 177–178. doi:10.1038/515177a.
- Moynihan R (2003-05- cvc31). Who pays for the pizza? Redefining the relationships between doctors and drug companies. 2: Disentanglement. BMJ: British Medical Journal. Volume 326, Issue 7400, pp. 1193–1196. Retrieved on 2007-10-06.
- "Hogan & Hartson Update on Pharmaceutical Trial Registration" (PDF). 2008-03-03. Retrieved 2008-06-02.
- "Rise in Scientific Journal Retractions Prompts Calls for Reform - NYTimes.com".
- Woolley KL, Lew RA, Stretton S et al. (June 2011). "Lack of involvement of medical writers and the pharmaceutical industry in publications retracted for misconduct: a systematic, controlled, retrospective study". Curr Med Res Opin 27 (6): 1175–82. doi:10.1185/03007995.2011.573546. PMID 21473670.
- Sox HC, Rennie D (August 2008). "Seeding trials: just say "no"". Ann. Intern. Med. 149 (4): 279–80. doi:10.7326/0003-4819-149-4-200808190-00012. PMID 18711161. Retrieved 21 August 2008.
- "Development & Approval Process (Drugs)".
- "Information Sheet Guidance For IRBs, Clinical Investigators, and Sponsors: FDA Inspections of Clinical Investigators" (PDF). June 2010. Retrieved 16 October 2014.
- Davidoff F, DeAngelis CD, Drazen JM, Nicholls MG, Hoey J, Højgaard L, Horton R, Kotzin S, Nylenna M, Overbeke AJ, Sox HC, Van Der Weyden MB, Wilkes MS (September 2001). "Sponsorship, authorship and accountability". CMAJ 165 (6): 786–8. PMC 81460. PMID 11584570.
- Back Translation for Quality Control of Informed Consent Forms
- CHALLENGES TO FDA’S ABILITY TO MONITOR AND INSPECT FOREIGN CLINICAL TRIALS
- Barlett, Donald. "Deadly Medicine". Vanity Fair. Retrieved 7 May 2013.
- "India: Prime Destination for Unethical Clinical Trials". Common Dreams.
- Pmda.go.jp 独立行政法人 医薬品医療機器総合機構[dead link] (Japanese)
- ICH[dead link]
- "Tax Credit for Testing Expenses for Drugs for Rare Diseases or Conditions". Food and Drug Administration. 17 April 2001. Retrieved 27 March 2007.
- Paul J, Seib R, Prescott T (Mar 2005). "The Internet and Clinical Trials: Background, Online Resources, Examples and Issues" (FREE FULL TEXT). Journal of medical Internet research 7 (1): e5. doi:10.2196/jmir.7.1.e5. PMC 1550630. PMID 15829477.
- Cooper, Melinda., "Experimental Labour – Offshoring Clinical Trials to China East Asian Science, Technology and Society" An International Journal, 2 (1), 2008: 73–92
- Humphries, M.; Niese, D.; Dai, P. (2006). "China as a Growing Research Base for Innovation in Medicines Development". International Journal of Pharmaceutical Medicine 20 (6): 355. doi:10.2165/00124363-200620060-00003.
- Berton, E. (February 14, 2006). "More chinese get free drugs in clinical trials". Wall Street Journal. Retrieved April 2013.
- Vaidya, A., L. Anastasia, F. Kermani., The chinese biotechnology, life science and pharmaceutical industry (UK trade and investment life sciences sector group). London: UK Trade and Investment, 2007
- Xu, J.; Li, B.; Qiang, M.; Liu, H.; Cong, Y. (2006). "Human subjects protections in clinical drug trials in China: A focus on the institute level". International Journal of Pharmaceutical Medicine 20 (6): 367–372 [p. 371]. doi:10.2165/00124363-200620060-00005.
- Liu JJ, Davidson E, Sheikh A (2011). "Achieving Ethnic Diversity in Trial Recruitment". Pharm Med 25 (4): 215–222. doi:10.1007/BF03256863.
- "Parkinson's Disease Clinical Trials". Fox Trial Finder. Retrieved 2013-11-14.
- "Medical Information on the Internet". Mlanet.org. Retrieved 2013-11-14.
- "Parkinson's Disease Clinical Trials". pdtrials. 2012-07-03. Retrieved 2013-11-14.
- Life on a Trial – What to Expect
- Z. Janet Yang, Katherine A. McComas, Geri K. Gay, John P. Leonard, Andrew J. Dannenberg & Hildy Dillon (2012). "Comparing decision making between cancer patients and the general population: Thoughts, emotions, or social influence?". Journal of Health Communication: International Perspectives, 17(4) 477-494.
- "Home - ClinicalTrials.gov". clinicaltrials.gov.
- Chow, S-C and Liu, JP (2004). Design and Analysis of Clinical Trials: Concepts and Methodologies, ISBN 0-471-24985-8
- Finn, R (1999). Cancer Clinical Trials: Experimental Treatments and How They Can Help You., Sebastopol: O'Reilly & Associates. ISBN 1-56592-566-1
- Henninger, Daniel (2002). "Drug Lag". In David R. Henderson (ed.). Concise Encyclopedia of Economics (1st ed.). Library of Economics and Liberty. OCLC 317650570, 50016270 and 163149563
- Pocock, SJ (2004), Clinical Trials: A Practical Approach, John Wiley & Sons, ISBN 0-471-90155-5
- Rang, HP; Dale, MM; Ritter, JM; Moore, PK (2003). Pharmacology 5 ed. Edinburgh: Churchill Livingstone. ISBN 0-443-07145-4
- Brennan, Zachary (2013-06-05). "CROs Slowly Shifting to Adaptive Clinical Trial Designs". Outsourcing-pharma.com. Retrieved 2014-01-05.
- The International Conference on Harmonization of Technical Requirements for Registration of Pharmaceuticals for Human Use (ICH)
- Clinical Trials for cancer research – National Cancer Institute
- "Improving evidence-based medicine". CardiologyTrials.org. Retrieved 2014-01-07.