U.S. flag

An official website of the United States government

NCBI Bookshelf. A service of the National Library of Medicine, National Institutes of Health.

Lamprecht M, editor. Antioxidants in Sport Nutrition. Boca Raton (FL): CRC Press/Taylor & Francis; 2015.

Cover of Antioxidants in Sport Nutrition

Antioxidants in Sport Nutrition.

Show details

Chapter 13Methodological Considerations When Evaluating the Effectiveness of Dietary/Supplemental Antioxidants in Sport

, , , , and .

13.1. INTRODUCTION

In recent years, there has been an increasing practical, clinical and scientific interest in the effects of free radicals and antioxidants related to sporting activities and exercise performance (Nikolaidis et al. 2012a,b; Peternelj and Coombes 2011; Powers et al. 2011; Reid 2008; Stear et al. 2009). Most of these reviews agree that oxidative stress represents a fundamental biological response to exercise stimuli. The generation of reactive oxygen species (ROS) increases with inclining oxygen utilisation during endurance exercises and is potentially associated with the risk of damage to muscles and other tissues. The key question is how effectively athletes can defend against the increased free radicals resulting from exercise. Do athletes need to take extra antioxidants? Studies provide arguments for and against the use of antioxidants but also emphasise that additional research will be required until a final judgement can be made (Peternelj and Coombes 2011; Powers et al. 2011; Stear et al. 2009). Obviously, large discrepancies exist between scientific evidence and the promotion by manufacturers and distributors of antioxidants. The promises of manufacturers and distributors are often based on anecdotal reports, not well-controlled observational studies or even on theoretical assumptions or speculations. It is readily understandable that the expectations of athletes encourage business interests. However, the main goal of scientific studies is to find the truth. To accomplish this goal, appropriate study design and sound statistical methods are of utmost importance.

13.2. HOW TO OBTAIN THE TRUTH

Subjects taking nutritional supplements such as antioxidants expect ‘truly’ beneficial effects. Such an expectation may sometimes provoke substantial placebo effects which are often misinterpreted as true effects. Most of the consumers, however, will not really experience benefits. Thus, a rigorous scientific and practical verification of true effects is paramount. Based on the definition of John Dewey, a student of the pragmatic philosophers Sanders Pierce and William James, truth should be coherent with other knowledge, should be repeatable, and lead to correct predictions (Spector 2009). To meet these requirements, rigorous scientific methods have to be used, finally enabling the prediction of effects, for example, those of supplemental antioxidants.

13.3. TYPES OF STUDIES AND THEIR CONCLUSIVENESS AND LEVEL OF EVIDENCE

There are three types of research or studies advancing scientific knowledge: descriptive, explanatory and predictive research.

13.3.1. Descriptive Studies

Descriptive studies, also referred to as observational studies, collect information on existing relationships, for example, between health status or level of performance and the regular intake of antioxidants. They include not only cross-sectional and longitudinal (cohort) studies but also studies on single cases and case series. Whereas cross-sectional studies look on existing associations at a single time point or time interval within a defined population of interest, longitudinal studies follow the individuals of such a population over time. These studies do not change the environment or conditions but simply describe ‘what is’ or ‘what was’. The findings obtained from these studies provide associations between outcome variables but do not allow causality to be established. Thus, after this first step of research, explanatory and predictive studies are necessary to assess causality.

13.3.2. Explanatory Studies

Explanatory studies try to answer ‘how’ and ‘why’ an intervention works. For instance, when descriptive research found associations between the intake of antioxidants and high levels of performance, it will be of interest to show ‘how’ and ‘why’ antioxidants can improve performance, that is, to establish cause and effect relationships. Interventions in explanatory studies are strictly defined and controlled. Randomised controlled trials (RCT) are considered as simple and powerful tools in clinical research. In this type of study, participants are randomly assigned to the intervention group, for example, receiving supplemental antioxidants, or to the control group, for example, receiving placebo. To avoid biases (systematic errors), it is highly desirable that researchers performing outcome measurements as well as study participants are ‘blinded’, that is, they do not know whether somebody has been allocated to the intervention or the control group.

13.3.3. Predictive Research

Predictive research forecasts intervention effects based on the knowledge gathered by descriptive and experimental studies. For example, supplemental antioxidants, which have been demonstrated to be beneficial in descriptive studies and cause and effect relationship, have also been shown in explanatory studies and are consumed by a defined population, for example, athletes. Ideally, beneficial effects of the intervention should be predictable in a large proportion of the subjects studied.

13.4. EVIDENCE-BASED MEDICINE OR EVIDENCE-BASED PRACTICE

The most important reasons for prasticing evidence-based medicine (EBM) or evidence-based practice (EBP) are to improve quality of care by the use of practices that really work, and the elimination of those that do not work or are even harmful (Gray and Pinson 2003). According to Sackett et al. (1996), EBM means using the best evidence in making decisions about the care of the individual patient based on the best available evidence from systematic research integrating individual clinical expertise and patient values. The same is true with regard to medical care and support for athletes. The higher the level of evidence (Table 13.1), the better the quality of research and the more likely that the predicted effects will actually occur.

TABLE 13.1

TABLE 13.1

Levels of Evidence

13.5. GENERAL ASPECTS AND CRITICAL VIEW REGARDING EFFECTS OF ANTIOXIDANT SUPPLEMENTATION ON HEALTH BENEFITS AND FAVOURABLE ADAPTATIONS IN RESPONSE TO PHYSICAL ACTIVITY

When planning studies of antioxidant effects on exercise performance, a comprehensive knowledge of integrated biochemical and physiological mechanisms of exercise metabolism, free radicals and antioxidants is essential. The following section intends to provide some general thoughts and will focus on potentially negative effects of antioxidants. These adverse effects are discussed in more detail in other chapters of this book.

The dietary vitamin and supplement industry is one of the world’s fastest growing markets, with 32 billion dollars in revenue for nutritional supplements alone (www.forbes.com). Although it is generally accepted that the prevalence of vitamin deficiency is low in industrialised countries and physically active individuals do not show increased requirements of vitamins and minerals, food supplements are increasingly used by the general population and athletes. There is increasing evidence that antioxidants may not only lack health benefits but may even prevent health-promoting effects of physical exercise in humans (Ristow et al. 2009). Bjelakovic et al. (2007) looked at data from 67 studies on antioxidant supplementation and they concluded that β-carotene, vitamin A and vitamin E supplementation seemed to increase the risk of death. When a 6-week aerobic exercise training programme was carried out by patients with hypertension, supplementation of antioxidants (vitamins C and E and lipoic acid) maintained the hypertensive status of subjects and the inhibition of exercise-induced flow-mediated vasodilatation (Wray et al. 2009). Although a possible explanation (free radical acting as vasodilators) is put forward, the authors do not provide experimental evidence for the mechanism of their finding. Also, though the training period is rather short (6 weeks), the authors fail to include a time control group to account for a time effect. The authors apply spin trapping and electron paramagnetic resonance spectroscopy (EPR) to assess plasma-free radical concentration, which is considered the gold standard method. However, they used a different training modality (graded maximal cycling) than was used for the exercise training programme itself (knee-extensor exercise). Secondary, stress-related effects due to a difference in exercise modality for training and testing cannot therefore be excluded. Ristow et al. (2009) found a blunted induction of gene expression and an increase in insulin sensitivity in a vitamin C and E supplemented group undergoing about 60 min of circuit-type training 5 times a week for 4 weeks. By contrast, only the non-supplemented group increased the ROS-dependent transcription factors and insulin-mediated glucose disposal in response to the exercise training. Thiobarbituric acid-reactive substances (TBARS) levels were significantly increased in response to exercise in the non-supplemented group but not in the group taking the antioxidants. Ristow et al. (2009) emphasises the importance of oxidative stress to induce the above-mentioned changes. Plasma levels of vitamins C and E were not determined in the participants and, surprisingly, Ristow et al.’s report (2009) increased mRNA levels of PGC-1α, PGC-1ß, PPARβ as well as superoxide dismutase (SOD) 1 and 2 only in the non-supplemented group. Along these lines, it is worth mentioning that euglycemic–hyperinsulinemic clamps and muscle biopsies were performed 1 week after completion of training. It has been shown that increases in the mRNA levels of the above-mentioned transcription factors in response to exercise are transient in nature and return to baseline levels about 24 h after an exercise bout (Pilegaard et al. 2003). The same is true for training-induced increases in insulin-stimulated glucose disposal which quickly decays 3–4 days after cessation of training, being undetectable after 7 days (Oshida et al. 1991; Burstein et al. 1985). Thus, owing to some methodological flaws, the findings by Ristow et al. (2009) are difficult to comprehend. Further, the number of participants to be included to observe a true effect was not planned, which reduces the validity of the study. The authors state that ‘supplementation with antioxidants may preclude these health-promoting effects of exercise in humans’. This conclusion is not comprehensive, given the fact that hundreds of different antioxidants interplay to regulate the pro-oxidative–antioxidative balance in the body. Therefore, this statement cannot be extrapolated to antioxidants in general by using only two specific antioxidants.

Similarly, Yfanti et al. (2011) studied the effect of vitamin C and E supplementation on insulin sensitivity in response to endurance training. The training consisted of a mixture between interval and continuous cycling ~80 min, 5 times a week for 12 weeks. The authors report similar increases in insulin-stimulated glucose uptake in both groups of about 15% as well as VO2max of about 18% in both groups. They concluded that supplementation with vitamins C and E for 12 weeks of cycling exercise training had no effect on performance or insulin-stimulated glucose uptake. Unfortunately, no markers of oxidative stress were reported in this study providing no information on the effectiveness of antioxidant supplementation on levels of oxidative stress.

It is interesting that both Ristow et al. (2009) and Yfanti et al. (2011) use a similar regime and yet the outcome of their studies is distinct. A closer look, however, reveals a few differences between the two studies: Yfanti et al. (2011) provide 500 mg vitamin C and 400 IU vitamin E daily for 16 weeks (4 weeks lead-in phase), whereas in the study of Ristow et al. (2009), participants took double the amount of vitamin C (1000 mg) and the same dose of vitamin E (400 IU) daily for a total time of only 4 weeks. In the Ristow study, the supplement dosages of vitamin C and vitamin E for the participant’s age group are therefore 10 and 17 times higher, respectively, than the recommended dietary allowances. Also, the total time training is very different, being 4 weeks, 5 times a week (20 sessions) in the Ristow study and 12 weeks, 5 times a week (60 sessions) for the Yfanti study. Thus, more research is needed to clarify whether these parameters can explain the observed differences between the two studies. Furthermore, it is likely that methodological issues may partly account for the inconsistent results when comparing these two studies (see above).

ROS seem to play a role in disease prevention and the extension of the lifespan. ROS are actually ‘required’ for the extension of the lifespan, by a mechanism that is called mitohormesis (Radak et al. 2008; Ristow 2012). Antioxidants that interfere with ROS formation seem to prevent this effect (Gomez-Cabrera et al. 2012). This finding is discussed controversially (Higashida et al. 2011), but the vast majority of experimental evidence clearly advises against supplementation of antioxidative vitamins. Additionally, there is also growing evidence that antioxidative vitamins may play a role in the development of obesity (Mangge et al., 2013).

The number of overweight and obese individuals has reached epidemic proportions with serious social and psychological dimensions. For this development, life-style changes with increased consumption of more energy-dense but nutrient-poor foods with high levels of sugar and saturated fats, combined with reduced levels of physical activity, are considered to be most important. Reduced caloric intake in combination with regular physical activity is certainly the most effective way of preventing the development of obesity.

Recently, it was claimed that antioxidant supplements diminish the health-promoting effects of exercise in patients with type 2 diabetes (Ristow et al. 2009). As the most important mode of action, antioxidants neutralise ROS and thus counteract physiological responses to exercise-induced ROS. However, this relationship could be of much broader relevance and some other possible consequences could be extrapolated that are more generally relevant (Theodorou et al. 2011).

The increased mitochondrial formation of ROS induced by exercise (Powers and Jackson 2008; Kyparos et al. 2009) is central to oxidation of carbon fuels. It is also well documented that physical exercise and sport activities elicit a significant activation of inflammatory responses and create an oxidising milieu which involves the release of specific immune products like cytokines and neopterin and their serum-soluble receptors, sIL-2R, sTNF-R55 and sCD23 (Tilz et al. 1993). The pro-inflammatory cytokine cascade is activated by signal transduction elements such as nuclear factor-kappaB (NF-ϰB), which is inducible by ROS and critical for establishing a pro-inflammatory response (Schreck et al. 1991). Antioxidant compounds are able to dampen this pro-inflammatory response. As a consequence, ROS production as well as the molecular mediators of endogenous ROS defence, such as superoxide dismutase and glutathione peroxidise, are diminished in response to physical exercise (Ristow et al. 2009). However, whether this finding justifies their conclusion that antioxidant supplements prevent the health-promoting effects of physical exercise is probably too far-reaching and questionable, because the induction of antioxidant mediators cannot be regarded as the one and only benefit of sport and physical exercise.

Regular physical activity may be considered the most important condition counteracting metabolic and cardiovascular diseases (Szostak and Laurant 2011). There is ample evidence that physical activity is an independent and important factor for the assessment of cardiovascular risk and that increasing levels of physical fitness protect against elevations in most risk factors in subjects with and without cardiovascular diseases. Although, in general, there seems to be a reduction in biomarkers of oxidative stress with antioxidant intake, the physiological meaning of this is not clear and the significance for health implications is still poorly understood. The ergogenic potential of antioxidants is still debated; however, a meta-analysis of 68 randomised antioxidant supplement trials revealed that antioxidant intake does not improve overall health but may in fact increase mortality (Bjelakovic et al. 2007). Further studies are required before final conclusions can be drawn.

13.6. STUDIES OF ANTIOXIDANTS AND EXERCISE PERFORMANCE: WHAT IS THE SUPPORTIVE EVIDENCE?

This section is not intended to be comprehensive but tries to provide some representative examples underpinning the necessity of careful study planning. For an extensive review, the reader may refer to Peternelj and Coombes (2011).

Many athletes take vitamins and antioxidants with the expectation of increasing exercise performance (Huang et al. 2006). Athletes seem to use supplements more frequently than the general population, with a prevalence of about 46% in athletes and an increasing prevalence with higher levels of professionalism (Sobal and Marquart 1994). Therefore, it has long been of interest to athletes and coaches as well as to scientists whether the support of the endogenous antioxidant defence systems by additional supplementation of antioxidants is an effective strategy to reduce oxidative stress and ROS production and hence to possibly improve exercise performance. However, there is evidence that ROS are important signalling molecules that act on pathways essential to and beneficial for exercise-induced adaptations (Burgoyne et al. 2007; Powers et al. 2010) with regard to tissues such as skeletal muscle. As early as 1971, it was shown that vitamin E supplementation (400 IU/day for 6 weeks) caused unfavourable effects on endurance performance in swimmers (Sharman et al. 1971), and more recent studies also suggest negative effects of antioxidant supplementation such as blunted adaptation to exercise stimuli or promotion of exercise-induced oxidative stress (Malm et al. 1996, 1997; Avery et al. 2003; Nieman et al. 2004).

The number of antioxidants presented in the scientific literature and on the market is countless, including substances such as colostrum, caffeine, selenium, carotenoids such as β-carotene, lycopene, lutein, zeaxanthin, coenzyme Q and many others. It is worth mentioning that most of these substances have not undergone proper evaluation and that there is insufficient scientific evidence regarding the ergogenic effects and long-term safety. In this section, we will therefore focus on studies assessing the connection between antioxidant supplementation and performance using either vitamin E or C as they are among the most powerful and well-characterised antioxidants (Beyer 1994). Vitamin E is one of the most important nutritional antioxidants accounting for membrane stability and fluidity by preventing lipid peroxidation (Jiang et al. 2011). Vitamin C contributes to the prevention of lipid peroxidation in interstitial fluid and plasma (Bradshaw et al. 2011). Different studies report blunted adaptations to the endurance exercise. Gomez-Cabrera et al. (2008) found a significant increase of ~186% in endurance performance in rats subjected to running for 6 weeks, 5 days/week on an animal treadmill. Endurance performance was significantly blunted (increase ~26%) in rats that received a daily dose of vitamin C (0.24 mg/cm2 body surface area). The authors found that vitamin C supplementation had a significantly negative effect on mitochondrial biogenesis. VO2max, however, was not negatively affected by antioxidant supplementation along the lines of an excess capacity of muscle mitochondria over O2 delivery by the circulation (Boushel et al. 2011). Similar results were obtained in the same study with men training for 8 weeks (Gomez-Cabrera et al. 2008). Subjects receiving an oral dose of 1 g vitamin C per day increased VO2max by 11% compared to a 22% increase in the non-supplemented group after 8 weeks of training. The results were not significant, probably due to a small sample size of only five people in the supplemented group. Also, no mechanistic pathway analysis from muscle tissue obtained from biopsies was performed in the human group due to ethical restraints. Although it is, in general, commendable to include a human and an animal trial in one study, direct comparisons between humans and rats cannot be made and translations of results are not always straightforward. It is worth mentioning that inbred rats are nearly genetically identical compared to human subjects, who are inherently genetically diverse. Sample size calculations based on findings from homogeneous, nearly identical animals would therefore lead to an underestimation of subjects in human studies. This study represents a typical example where findings from an animal study were not confirmed in the human study branch possibly due to a type 2 error. The use of an adequate sample size is a prerequisite to obtaining meaningful results.

In another human study by Khassaf et al. (2003) the negative effects of ascorbic acid supplementation on the adaptive responses of endogenous antioxidant enzymes and stress proteins were demonstrated. The authors found increased baseline activities of SOD, catalase (CAT) and HSP60 on vitamin C supplementation, which could be an indication of a pro-oxidant effect of vitamin C (Carr and Frei 1999). However, it still remains unclear whether this up-regulation of defence mechanisms is beneficial or deleterious to the tissue. It is also not clear whether suppression of the expression of these proteins following stress to skeletal muscle will be beneficial to skeletal muscle viability over the longer term. Further studies are necessary to elaborate on these questions. Furthermore, it has been shown that supplementation with ascorbic acid does not preserve muscle function but hinders the recovery process, thereby being detrimental to future performance (Close et al. 2006).

Asha Devi et al. (2003a, 2003b) studied the effect of vitamin E supplementation on swimming performance in rats of different age groups (4, 8, 12 and 22 months of age). The authors report significant differences in endurance capacity between supplemented and control rats over all age groups studied with vitamin E-supplemented rats showing higher endurance capacity. Further, supplementation with vitamin E resulted in a beneficial plasma lipid profile. The findings of Asha Devi et al. suggest an ergogenic effect of vitamin E supplementation on exercise performance. However, not all animal studies have shown performance increases following antioxidant administration. As an example, rats supplemented with vitamin E failed to improve treadmill time to exhaustion in two studies (Mehlhorn et al. 1989; De Oliveira et al. 2003). Exercise per se lead to an up-regulation of CAT and SOD activity in all age groups except the old group. Old animals only showed increased SOD activity when supplemented with vitamin E. This might indicate that supplementation is not necessary during youth. Malondialdehyde (MDA) content was lower in supplemented rats compared to the non-supplemented control group. Interestingly, the authors report reduced tissue vitamin E levels in the control group concluding that the antioxidant is utilised during exercise to scavenge free radicals. Importantly, this is again just true for the animals from the old group. As for the aforementioned studies also in this study, the sample size is rather low and it remains elusive whether these findings are transferable to humans. Whereas a number of studies report an ergogenic effect of antioxidants, the majority of studies found no changes or even negative outcomes. For a review, see Peternelj and Coombes (2011).

Intake of dietary supplements is very prevalent among the community of professional athletes (Huang et al. 2006). It is well established that a number of commercially available dietary supplements can be cross-contaminated with prohibited substances found on the Prohibited List of the World Anti-Doping Agency (Geyer et al. 2008). The intake of dietary supplements is therefore not only connected with a high risk of inadvertent doping but can also jeopardise the health of an athlete. Athletes should therefore use caution when considering supplementation with antioxidants, especially at higher doses.

In one particular case, the use of antioxidants for athletes may be justified. Dietary recall studies show that some athletes do not consume a balanced diet containing enough fruits and vegetables, and therefore these athletes potentially lack antioxidants (Farajian et al. 2004). In this case, it may be necessary to supplement with antioxidants in reasonable dosages to achieve physiological levels of antioxidants. Apart from that, athletes are rather encouraged to focus on a healthy, energetically adequate diet that is rich in antioxidant-containing foods (such as whole grains, fruits, vegetables, nuts and seeds). A balanced diet is the best nutritional approach to optimise a person’s antioxidant status.

13.7. TYPICAL FLAWS AND PITFALLS OF STUDIES

The studies mentioned above show inconclusive results regarding the effects of antioxidants on health benefits and exercise performance. One limitation of these studies is the training status of the subjects. Participants are mostly untrained or moderately trained subjects with a VO2max in the range of around 45–60 mL/kg/min. Besides a limited number of recreationally active individuals who take supplements, it is mostly highly trained or even professional athletes who use antioxidants. It appears that there is a considerable difference with regard to oxidative stress between a single bout and regular physical activity. Repeated bouts of physical activity such as are experienced by athletes induce an up-regulation of the endogenous antioxidant defence system to minimise oxidative damage (Radak et al. 2008), whereas a single bout of exercise seems to be insufficient to induce these adaptations (Ji 2008). It is therefore not surprising that a number of markers of oxidative stress, for example, protein carbonyls (PC) and MDA appear to be unaffected in trained subjects in response to normal or even strenuous exercise (Farney et al. 2012; Bloomer et al. 2006) or if at all, seem to be more affected by a high fat diet than by exercise (McCarthy et al. 2013). These data suggest that oxidative stress is not elevated in exercise-trained subjects. Further, most of the studies only include an insufficient number of subjects and can therefore be considered as underpowered. Most studies do not provide sample size or power calculations in order for the reader to comprehend the likelihood that the findings are real. An important addition in every study would be to characterise the endogenous redox state of the subjects at baseline to characterise their defence system. It can be speculated that the endogenous defence system is better developed in well-trained than in untrained people, which again has an influence on the outcome in these different populations. Factors such as training status, age and sex have not been extensively studied and may have a considerable impact on oxidative stress response to exercise. Lastly, the site of occurrence between different organs and timing of the maximal effect of oxidative stress in response to an exercise bout have to be considered.

For future directions, it will be important for researchers to incorporate other substances than vitamins C, E and coenzyme Q10 based on the large number of available antioxidants that warrant systematic testing. The fact that these three substances were mainly studied makes generalisations difficult.

Regarding study design, a crossover design would be a clean way to study the effects of antioxidants. Also, established animal models of increased or decreased oxidative stress (e.g. the superoxide dismutase 2 nullizygous mouse as a model for increased oxidative stress and the transgenic mouse over-expressing mitochondrial catalase such as the mCAT mouse model for decreased oxidative stress) may prove very useful as positive or negative controls. It is, however, important to mention that findings from animal experiments cannot be automatically translated to humans.

Plasma volume decreases due to exercise-induced dehydration. This fact might be responsible for an overestimation of post-exercise markers of oxidative stress in studies that did not account for the changes in plasma volume.

A general problem of in vivo detection of antioxidants in humans lies in their short-lived nature. Although antioxidants have been detected ex vivo (Ashton et al. 1998), the transition to their behaviour in vivo is therefore often not necessarily scientifically sound. Free radicals exhibit a high reactivity and a relatively short half life (e.g. 10−5s for superoxide radicals and 10−9s for hydroxyl radical) (Fisher-Wellman and Bloomer 2009). They are therefore difficult to measure directly. A direct measurement method and gold standard of free radical assessment is electron spin resonance spectroscopy using spin traps (Ashton et al. 1998). Although these methods provide accurate information their application is costly and requires specialist personnel. That is why the majority of researchers make use of indirect methods that have been developed to assess biomarkers of oxidative stress. These markers are always selective and never thorough, and studies using a variety of markers do not always provide consistent results (Vollaard et al. 2005). As a general rule, it can be stated that the more markers that are assessed the better. Investigating only one marker does not give a representative view of the oxidative stress status of the subject. One extensively used marker is TBARS, a reagent commonly used to assay MDA, which is an end product of lipid peroxidation. As there are other cellular sources of MDA, the TBARS assay is not entirely representative for lipid peroxidation (Trevisan et al. 2001). The fact that TBARS is not specific for MDA is often ignored (Bird and Draper 1984). Methodological shortcomings such as TBARS production during the assay (Vollaard et al. 2005) have to be taken into account and different markers of oxidative stress (e.g. isoprostane, lipid hydroperoxide, conjugated dienes and pentane) have to be considered. To account for methodological problems of assessing biomarkers of oxidative stress, it is therefore paramount to include a non-exercising control group as the baseline readout. Furthermore, information on exact procedures of assays is often neglected but should be included in every publication to comprehend the outcome. Similar methodological constraints apply when assessing levels of the popular antioxidant marker glutathione with its reduced (GSH) and oxidised (GSSG) fractions.

13.8. APPROPRIATE STUDY DESIGN AND METHODS TO ASSESS THE EFFECTS OF ANTIOXIDANTS ON EXERCISE PERFORMANCE

Proper planning of the study is essential. A simple checklist is provided in Table 13.2.

TABLE 13.2

TABLE 13.2

Checklist to Support Study Planning

13.8.1. Rationale, Study Aim and Hypothesis

Numerous studies have investigated the effects of antioxidant supplementation on exercise performance, each having strengths but to some extent also weaknesses (Simon-Schnass and Pabst 1988; Reid et al. 1994; Matuszczak et al. 2005; Subudhi et al. 2006; Matzi et al. 2007; Gatterer et al. 2013). The rationale to study such effects is the hypothesis that oxidative stress possibly contributes to muscle fatigue and might impair exercise performance (Reid 2001). Supposed mechanisms are impairments of muscle and cellular function due to the modifications or damages of contractile proteins, suppression of the calcium sensitivity of myofilaments, alterations of mitochondrial function and its degradation (Callahan et al. 2001; Ott et al. 2007; Murphy et al. 2008). Consequently, eliminating oxidative stress is assumed to improve performance.

When investigating within this field, knowledge of the specific literature is of utmost importance. This enables gaps to be established in the research and is valuable in formulating the study rationale and the study aims. Importantly, any interventional study greatly benefits from a prospective hypothesis and a study design that makes it possible to accept or reject the hypothesis within the primary end point (Preiser et al. 2002). Within the field of nutritional studies, a double-blinded, randomised and placebo-controlled study design is favoured.

13.8.2. The Study Participant

When selecting participants it is important to recognise that various characteristics of the participants might influence the outcome of the investigation. These include anthropometric and demographic parameters (e.g. body composition, age and sex distribution), type of practised sport (e.g. cycling vs. running), fitness level (e.g. recreationally active individuals vs. elite athletes), training periodisation (e.g. off-season vs. in-season) and baseline oxidative stress and defence variables (e.g. participants with high vs. low levels of oxidative stress at baseline). Thus, selection depends on the study aims and hypotheses. Moreover, chronic and/or acute diseases of the participants and behavioural factors, including smoking, caffeine and alcohol consumption, drug use and special diet, need to be controlled and might, according to the study goal, be considered as exclusion criteria. It has to be mentioned that studying healthy trained subjects having a balanced oxidative and antioxidative status already at the start of the investigation might challenge the detection of effects of a supplementation (Ellinger et al. 2011).

13.8.3. Randomisation and Blinding

After the selection of participants, a random assignment to different groups (intervention or placebo) is advisable. Stratification for fitness level, oxidative status, age and sex results in homogeneous groups, and allows documentation of possible intervention effects. It is important that participants as well as investigators involved in data processing are, at best, blinded to the intervention. Needless to say, participants should receive antioxidants or placebos that are identical in taste and appearance, and only investigators not involved in data processing are allowed to manage group allocation and supplement distribution. This procedure guarantees that placebo effects and investigator biases can be excluded.

13.8.4. Sample Size and Statistical Power

To obtain appropriate results, the use of an adequate sample size is a prerequisite. Established statistical procedures will help to choose proper sample sizes. It is not enough to reject the null hypothesis only because of statistical significance, but also because of practical importance and clinical relevance. Further, type I and type II errors have to be considered. A type I error (corresponding to a significance level of usually 0.05) is an incorrect rejection of the true null hypothesis. A type II or beta error is an error not rejecting a false null hypothesis. The statistical power (1-beta) is the probability that a test will reject the null hypothesis, although it is false. Thus, a beta error of 0.1 corresponds to a power of 90%, meaning a 90% probability of rejecting an actually false null hypothesis. A statistical power of at least 80% is necessary for a test to detect an effect if it actually exists.

13.8.5. Main Outcome Measures

The effectiveness of the supplementation is evaluated by measuring exercise performance and oxidative status before and after the intervention. Tests need to fit the aims of the study. With respect to exercise performance, laboratory or field tests are applicable. Within the laboratory setting, incremental exercise tests, time-to-fatigue tests or time trial tests in combination with gas analyses, lactate diagnostics and so on may provide valuable information on the physiological responses and the mechanisms leading to performance changes. Field tests are considered to resemble competition situations more closely but might miss explanatory measures. It has to be added that effects of antioxidant administration on performance may critically depend on the type of exercise testing (Reid et al. 1994). With respect to the measured oxidative stress and defence parameters, a large number of markers are investigated. Selecting parameters supposedly involved in muscle and cellular function might yield additional information. Most frequently, hydrogen peroxide, total and oxidised glutathione, 8-hydroxydeoxyguanosine, MDA, protein carbonyl content, 4-hydroxynonenal and nitrotyrosine were investigated (Subudhi et al. 2006; Nikolaidis et al. 2012a; Gatterer et al. 2013). Moreover, activity levels of CAT, CuZnSOD, MnSOD, glutathione peroxidase and plasma concentrations of α-tocopherol and β-carotene were also used to reflect antioxidative status (Subudhi et al. 2006; Nikolaidis et al. 2012a). It has to be recognised that oxidative stress markers measured in blood plasma might not reflect the conditions within the working muscles (Subudhi et al. 2006).

13.8.6. Considerations during the Experiment

The study period (i.e. long-term vs. short-term supplementation) needs to be in accordance with the aims of the study. During the supplementation period, two different procedures can be followed. First, the training practice of participants is kept unaltered, with groups performing approximately the same training load. Second, participants of both groups perform the same training load which is different from their usual training regime, for example, high altitude training or high intensity training. Such procedures allow investigation of the effects of the supplementation on specific training adaptations. In any case, a training logbook helps to document training activities. Additionally, it is advisable to maintain normal nutritional habits throughout the study and to document any changes. Participants suffering from acute infections or injuries during the intervention period preferentially have to be excluded from the study, since such conditions might impact outcomes (Schwarz 1996; Tiidus 1998).

13.8.7. Use of Appropriate Statistical Tests

Nutritional studies typically compare the efficacy of a new preparation with another and/or a placebo. Besides a pure description, it is important to know whether observed differences between groups (preparations) are just random or are really true. Inferential statistical tests commonly used in the nutrition profession have been recently summarised by Saracino et al. (2013) and these authors also report how to choose them.

13.9. CONCLUSION

Making decisions about medical care and support of athletes, including the use of dietary/supplemental antioxidants in sport, should be based on the best available evidence from systematic research. However, large discrepancies exist between scientific evidence and the promotion by manufacturers and distributors of antioxidants. When evaluating the effectiveness of dietary/supplemental antioxidants, comprehensive knowledge of integrated biochemical and physiological mechanisms of exercise metabolism, free radicals and antioxidants is as necessary as the consideration of stringent methodological standards.

REFERENCES

  1. Asha Devi S, Prathima S, Subramanyam M.V. Dietary vitamin E and physical exercise: I. Altered endurance capacity and plasma lipid profile in ageing rats. Experimental Gerontology. 2003a;38:285–290. [PubMed: 12581792]
  2. Asha Devi S, Prathima S, Subramanyam M.V. Dietary vitamin E and physical exercise: II. Antioxidant status and lipofuscin-like substances in aging rat heart. Experimental Gerontology. 2003b;38:291–297. [PubMed: 12581793]
  3. Ashton T, Rowlands C.C, Jones E. et al. Electron spin resonance spectroscopic detection of oxygen-centred radicals in human serum following exhaustive exercise. European Journal of Applied Physiology and Occupational Physiology. 1998;77:498–502. [PubMed: 9650733]
  4. Avery N.G, Kaiser J.L, Sharman M.J. et al. Effects of vitamin E supplementation on recovery from repeated bouts of resistance exercise. Journal of Strength and Conditioning Research. 2003;17:801–809. [PubMed: 14636105]
  5. Beyer R.E. The role of ascorbate in antioxidant protection of biomembranes: Interaction with vitamin E and coenzyme Q. Journal of Bioenergetics and Biomembranes. 1994;26:349–358. [PubMed: 7844109]
  6. Bird R.P, Draper H.H. Comparative studies on different methods of malonaldehyde determination. Methods in Enzymology. 1984;105:299–305. [PubMed: 6727668]
  7. Bjelakovic G, Nikolova D, Gluud L.L, Simonetti R.G, Gluud C. Mortality in randomized trials of antioxidant supplements for primary and secondary prevention: Systematic review and meta-analysis. Journal of the American Medical Association. 2007;297:842–857. [PubMed: 17327526]
  8. Bloomer R.J, Falvo M.J, Fry A.C, Schilling B.K, Smith W.A, Moore C.A. Oxidative stress response in trained men following repeated squats or sprints. Medicine and Science in Sports and Exercise. 2006;38:1436–1442. [PubMed: 16888457]
  9. Boushel R, Gnaiger E, Calbet J.A. et al. Muscle mitochondrial capacity exceeds maximal oxygen delivery in humans. Mitochondrion. 2011;11:303–307. [PubMed: 21147270]
  10. Bradshaw M.P, Barril C, Clark A C, Prenzler P.D, Scollary G.R. Ascorbic acid: A review of its chemistry and reactivity in relation to a wine environment. Critical Reviews in Food Science and Nutrition. 2011;51:479–498. [PubMed: 21929328]
  11. Burgoyne J.R, Madhani M, Cuello F. et al. Cysteine redox sensor in PKGIa enables oxidant-induced activation. Science. 2007;317:1393–1397. [PubMed: 17717153]
  12. Burstein R, Polychronakos C, Toews C.J, MacDougall J.D, Guyda H.J, Posner B.I. Acute reversal of the enhanced insulin action in trained athletes. Association with insulin receptor changes. Diabetes. 1985;34:756–760. [PubMed: 3894119]
  13. Callahan L.A, Nethery D, Stofan D, DiMarco A, Supinski G. Free radical-induced contractile protein dysfunction in endotoxin-induced sepsis. American Journal of Respiratory Cell and Molecular Biology. 2001;24:210–217. [PubMed: 11159056]
  14. Carr A, Frei B. Does vitamin C act as a pro-oxidant under physiological conditions? FASEB Journal. 1999;13:1007–1024. [PubMed: 10336883]
  15. Close G.L, Ashton T, Cable T. et al. Ascorbic acid supplementation does not attenuate postexercise muscle soreness following muscle-damaging exercise but may delay the recovery process. British Journal of Nutrition. 2006;95:976–981. [PubMed: 16611389]
  16. De Oliveira S.L, Diniz D.B, Amaya-Farfan J. Carbohydrate-energy restriction may protect the rat brain against oxidative damage and improve physical performance. British Journal of Nutrition. 2003;89:89–96. [PubMed: 12568668]
  17. Ellinger S, Müllera N, Stehle P, Ulrich-Merzenich G. Consumption of green tea or green tea products: Is there an evidence for antioxidant effects from controlled interventional studies? Phytomedicine. 2011;18:903–915. [PubMed: 21802928]
  18. Farajian P, Kavouras S.A, Yannakoulia M, Sidossis L.S. Dietary intake and nutritional practices of elite Greek aquatic athletes. International Journal of Sport Nutrition and Exercise Metabolism. 2004;14:574–585. [PubMed: 15673103]
  19. Farney T.M, McCarthy C.G, Canale R.E, Schilling B.K, Whitehead P.N, Bloomer R.J. Absence of blood oxidative stress in trained men after strenuous exercise. Medicine and Science in Sports and Exercise. 2012;44:1855–1863. [PubMed: 22525774]
  20. Fisher-Wellman K, Bloomer R.J. Acute exercise and oxidative stress: A 30 year history. Dynamic Medicine. 2009;8:1. [PMC free article: PMC2642810] [PubMed: 19144121]
  21. Gatterer H, Greilberger J, Philippe M, Djukic R, Burtscher M. Short-term supplementation with alpha-ketoglutaric acid and 5-hydroxymethylfurfural does not prevent the hypoxia induced decrease of exercise performance despite attenuation of oxidative stress. International Journal of Sports Medicine. 2013;34:1–7. [PubMed: 22893323]
  22. Geyer H, Parr M.K, Koehler K, Mareck U, Schanzer W, Thevis M. Nutritional supplements cross-contaminated and faked with doping substances. Journal of Mass Spectrometry. 2008;43:892–902. [PubMed: 18563865]
  23. Gomez-Cabrera M.C, Domenech E, Romagnoli M. et al. Oral administration of vitamin C decreases muscle mitochondrial biogenesis and hampers training-induced adaptations in endurance performance. American Journal of Clinical Nutrition. 2008;87:142–149. [PubMed: 18175748]
  24. Gomez-Cabrera M.C, Ristow M, Viña J. Antioxidant supplements in exercise: Worse than useless? American Journal of Physiology Endocrinology and Metabolism. 2012;302:E476–E477. [PubMed: 22307485]
  25. Gray G.E, Pinson L.A. Evidence-based medicine and psychiatric practice. Psychiatric Quarterly. 2003;74:387–399. [PubMed: 14686461]
  26. Higashida K, Kim S.H, Higuchi M, Holloszy J.O, Han D.H. Normal adaptations to exercise despite protection against oxidative stress. American Journal of Physiology Endocrinology and Metabolism. 2011;301:E779–E784. [PMC free article: PMC3214004] [PubMed: 21750271]
  27. Huang S.H, Johnson K, Pipe A.L. The use of dietary supplements and medications by Canadian athletes at the Atlanta and Sydney Olympic Games. Clinical Journal of Sport Medicine. 2006;16:27–33. [PubMed: 16377972]
  28. Ji L.L. Modulation of skeletal muscle antioxidant defense by exercise: Role of redox signaling. Free Radical Biology and Medicine. 2008;44:142–152. [PubMed: 18191750]
  29. Jiang Z, Yin X, Jiang Q. Natural forms of vitamin E and 13’-carboxychromanol, a long-chain vitamin E metabolite, inhibit leukotriene generation from stimulated neutrophils by blocking calcium influx and suppressing 5-lipoxygenase activity respectively. Journal of Immunology. 2011;186:1173–1179. [PMC free article: PMC4050064] [PubMed: 21169551]
  30. Khassaf M, McArdle A, Esanu C. et al. Effect of vitamin C supplements on antioxidant defence and stress proteins in human lymphocytes and skeletal muscle. Journal of Physiology. 2003;549:645–652. [PMC free article: PMC2342961] [PubMed: 12692182]
  31. Kyparos A, Vrabas I.S, Nikolaidis M.G, Riganas C.S, Kouretas D. Increased oxidative stress blood markers in well-trained rowers following two thousand-meter rowing ergometer race. Journal of Strength and Conditioning Research. 2009;23:1418–1426. [PubMed: 19620924]
  32. 2013 Levels of Evidence From the Centre for Evidence-Based Medicine Oxford http://www​.essentialevidenceplus​.com/product/ebm_loe​.cfm?show=oxford; accessed April 8th.
  33. Malm C, Svensson M, Ekblom B, Sjodin B. Effects of ubiquinone-10 supplementation and high intensity training on physical performance in humans. Acta Physiologica Scandinavica. 1997;161:379–384. [PubMed: 9401591]
  34. Malm C, Svensson M, Sjoberg B, Ekblom B, Sjodin B. Supplementation with ubiquinone-10 causes cellular damage during intense exercise. Acta Physiologica Scandinavica. 1996;157:511–512. [PubMed: 8869734]
  35. Mangge H, Summers K, Almer G, Prassl R, Weghuber D, Schnedl W, Fuchs D. Antioxidant food supplements and obesity-related inflammation. Current Medicinal Chemistry. 2013;20:2330–2337. [PubMed: 23531214]
  36. Matuszczak Y, Farid M, Jones J. et al. Effects of N-acetylcysteine on glutathione oxidation and fatigue during handgrip exercise. Muscle and Nerve. 2005;32:633–638. [PubMed: 16025522]
  37. Matzi V, Lindenmann J, Muench A. et al. The impact of preoperative micronutrient supplementation in lung surgery. A prospective randomized trial of oral supplementation of combined α-ketoglutaric acid and 5-hydroxymethylfurfural. European Journal of Cardio-thoracic Surgery. 2007;32:776–782. [PubMed: 17768058]
  38. McCarthy C.G, Farney T.M, Canale R.E, Dessoulavy M.E, Bloomer R.J. High-fat feeding, but not strenuous exercise, increases blood oxidative stress in trained men. Applied Physiology, Nutrition and Metabolism. 2013;38:33–41. [PubMed: 23368826]
  39. Mehlhorn R.J, Sumida S, Packer L. Tocopheroxyl radical persistence and tocopherol consumption in liposomes and in vitamin E-enriched rat liver mitochondria and microsomes. Journal of Biological Chemistry. 1989;264:13448–13452. [PubMed: 2547761]
  40. Murphy R.M, Dutka T.L, Lamb G.D. Hydroxyl radical and glutathione interactions alter calcium sensitivity and maximum force of the contractile apparatus in rat skeletal muscle fibres. Journal of Physiology. 2008;586:2203–2216. [PMC free article: PMC2465198] [PubMed: 18308823]
  41. Nieman D.C, Henson D.A, McAnulty S.R. et al. Vitamin E and immunity after the Kona Triathlon World Championship. Medicine and Science in Sports and Exercise. 2004;36:1328–1335. [PubMed: 15292740]
  42. Nikolaidis M.G, Kerksick C.M, Lamprecht M, McAnulty S.R. Does vitamin C and E supplementation impair the favorable adaptations of regular exercise? Oxidative Medicine and Cellular Longevity. 2012b;2012:707941. [PMC free article: PMC3425865] [PubMed: 22928084]
  43. Nikolaidis M.G, Kyparos A, Spanou C, Paschalis V, Theodorou A.A, Vrabas I.S. Redox biology of exercise: An integrative and comparative consideration of some overlooked issues. Journal of Experimental Biology. 2012a;215:1615–1625. [PubMed: 22539728]
  44. Oshida Y, Yamanouchi K, Hayamizu S, Nagasawa J, Ohsawa I, Sato Y. Effects of training and training cessation on insulin action. International Journal of Sports Medicine. 1991;12:484–486. [PubMed: 1752716]
  45. Ott M, Gogvadze V, Orrenius S, Zhivotovsky B. Mitochondria, oxidative stress and cell death. Apoptosis. 2007;12:913–922. [PubMed: 17453160]
  46. Peternelj T.T, Coombes J.S. Antioxidant supplementation during exercise training: Beneficial or detrimental? Sports Medicine. 2011;41:1043–1069. [PubMed: 22060178]
  47. Pilegaard H, Saltin B, Neufer P.D. Exercise induces transient transcriptional activation of the PGC-1alpha gene in human skeletal muscle. Journal of Physiology. 2003;546:851–858. [PMC free article: PMC2342594] [PubMed: 12563009]
  48. Powers S, Nelson W.B, Larson-Meyer E. Antioxidant and vitamin D supplements for athletes: Sense or nonsense? Journal of Sports Science. 2011;29:S47–S55. [PubMed: 21830999]
  49. Powers S.K, Duarte J, Kavazis A.N, Talbert E.E. Reactive oxygen species are signalling molecules for skeletal muscle adaptation. Experimental Physiology. 2010;95:1–9. [PMC free article: PMC2906150] [PubMed: 19880534]
  50. Powers S.K, Jackson M.J. Exercise-induced oxidative stress: Cellular mechanisms and impact on muscle force production. Physiological Reviews. 2008;88:1243–1276. [PMC free article: PMC2909187] [PubMed: 18923182]
  51. Preiser J.C, Chioléro R, Wernerman J. ESICM (European Society of Intensive Care Medicine) Working Group on Nutrition and Metabolism. Nutritional papers in ICU patients: What lies between the lines? Intensive Care Medicine. 2002;29:156–166. [PubMed: 12594580]
  52. Radak Z, Chung H.Y, Koltai E, Taylor A.W, Goto S. Exercise, oxidative stress and hormesis. Ageing Research Reviews. 2008;7:34–42. [PubMed: 17869589]
  53. Reid M.B. Invited Review: Redox modulation of skeletal muscle contraction: What we know and what we don’t. Journal of Applied Physiology. 2001;90:724–731. [PubMed: 11160074]
  54. Reid M.B. Free radicals and muscle fatigue: Of ROS, canaries, and the IOC. Free Radical Biology and Medicine. 2008;44:169–179. [PubMed: 18191753]
  55. Reid M.B, Stokic D, Koch S.M, Khawli F.A, Leis A.A. N-acetylcysteine inhibits muscle fatigue in humans. Journal of Clinical Investigation. 1994;94:2468–2474. [PMC free article: PMC330079] [PubMed: 7989604]
  56. Ristow M. Interview with Michael Ristow. Aging. 2012;4:2. [PMC free article: PMC3292900] [PubMed: 22317964]
  57. Ristow M, Zarse K, Oberbach A. et al. Antioxidants prevent health-promoting effects of physical exercise in humans. Proceedings of the National Academy of Science (USA). 2009;106:8665–8670. [PMC free article: PMC2680430] [PubMed: 19433800]
  58. Sackett D.L, Rosenburg W.M, Gray J.A, Haynes R.B, Richardson W.S. Evidence-based medicine: What it is and it isn’t. British Medical Journal. 1996;312:71–72. [PMC free article: PMC2349778] [PubMed: 8555924]
  59. Saracino G, Jennings L.W, Hasse J.M. Basic statistical concepts in nutrition research. Nutrition in Clinical Practice. 2013;28:182–193. [PubMed: 23449772]
  60. Schreck R, Rieber P, Baeuerle P.A. Reactive oxygen intermediates as apparently widely used messengers in the activation of the NF-kappa B transcription factor and HIV-1. EMBO J. 1991;10:2247–2258. [PMC free article: PMC452914] [PubMed: 2065663]
  61. Schwarz K.B. Oxidative stress during viral infection: A review. Free Radical Biology and Medicine. 1996;21:641–649. [PubMed: 8891667]
  62. Sharman I.M, Down M.G, Sen R.N. The effects of vitamin E and training on physiological function and athletic performance in adolescent swimmers. British Journal of Nutrition. 1971;26:265–276. [PubMed: 5571788]
  63. Simon-Schnass I, Pabst H. Influence of vitamin E on physical performance. International Journal for Vitamin and Nutrition Research. 1988;58:49–54. [PubMed: 3384584]
  64. Sobal J, Marquart L.F. Vitamin/mineral supplement use among athletes: A review of the literature. International Journal of Sport Nutrition. 1994;4:320–334. [PubMed: 7874149]
  65. Spector R. Methodological and statistical issues in adult nutritional research. Skeptical Inquirer. 2009:33.
  66. Stear S.J, Burke L.M, Castell L.M. BJSM reviews: A-Z of nutritional supplements: Dietary supplements, sports nutrition foods and Ergogenic aids for health and performance Part 3. British Journal of Sports Medicine. 2009;43:890–892. [PubMed: 19900955]
  67. Subudhi A.W, Jacobs K.A, Hagobian T.A. et al. Changes in ventilatory threshold at high altitude: Effect of antioxidants. Medicine and Science in Sports and Exercise. 2006;38:1425–1431. [PubMed: 16888455]
  68. Szostak J, Laurant P. The forgotten face of regular physical exercise: A ‘natural’ anti-atherogenic activity. Clinical Science. 2011;121:91–106. [PubMed: 21729002]
  69. Theodorou A.A, Nikolaidis M.G, Paschalis V. et al. No effect of antioxidant supplementation on muscle performance and blood redox status adaptations to eccentric training. American Journal of Clinical Nutrition. 2011;93:1373–1383. [PubMed: 21508092]
  70. Tiidus P.M. Radical species in inflammation and overtraining. Canadian Journal of Physiology and Pharmacology. 1998;76:533–538. [PubMed: 9839079]
  71. Tilz G.P, Domej W, Diez-Ruiz A. et al. Increased immune activation during and after physical exercise. Immunobiology. 1993;188:194–202. [PubMed: 8104879]
  72. Trevisan M, Browne R, Ram M. et al. Correlates of markers of oxidative status in the general population. American Journal of Epidemiology. 2001;154:348–356. [PubMed: 11495858]
  73. Vollaard N.B, Shearman J.P, Cooper C.E. Exercise-induced oxidative stress: myths, realities and physiological relevance. Sports Medicine. 2005;35:1045–1062. [PubMed: 16336008]
  74. Wray D.W, Uberoi A, Lawrenson L, Bailey D.M, Richardson R.S. Oral antioxidants and cardiovascular health in the exercise-trained and untrained elderly: A radically different outcome. Clinical Science. 2009;116:433–441. [PubMed: 18795893]
  75. Yfanti C, Nielsen A.R, Akerstrom T. et al. Effect of antioxidant supplementation on insulin sensitivity in response to endurance exercise training. American Journal of Physiology Endocrinology and Metabolism. 2011;300:E761–E770. [PubMed: 21325105]
© 2015 by Taylor & Francis Group, LLC.
Bookshelf ID: NBK299043PMID: 26065082

Views

  • PubReader
  • Print View
  • Cite this Page

Related information

  • PMC
    PubMed Central citations
  • PubMed
    Links to PubMed

Similar articles in PubMed

See reviews...See all...

Recent Activity

Your browsing activity is empty.

Activity recording is turned off.

Turn recording back on

See more...