Skip to main content
Download PDF

Assessing the reporting quality of physical activity programs in randomized controlled trials for the management of juvenile idiopathic arthritis using three standardized assessment tools

Pediatric Rheumatology volume 18, Article number: 41 (2020) Cite this article

Abstract

Background

The reporting quality of physical activity (PA) programs in randomized controlled trials (RCTs) for the management of juvenile idiopathic arthritis (JIA) remains unknown. This study aimed to assess and compare the reporting quality of PA programs in RCTs for the management of JIA using three difference standardized assessment tools, and to describe the elements that were similar and different between these tools.

Methods

A systematic search was conducted for moderate-to high-quality RCTs of PA programs in JIA, published up until January 2019. Two reviewers independently included 10 RCTs and scored the reporting quality of PA programs using the following tools: Consensus on Exercise Reporting Template (CERT) checklist, Consensus on Therapeutic Exercise Training (CONTENT) scale, and Template for Intervention Description and Replication (TIDieR) checklist.

Results

Results showed that reporting of PA programs in 10 moderate- to high-quality RCTs for JIA management remains incomplete. The average reporting quality (± standard deviation) for all RCTs combined was moderate for the three standardized assessment tools with 70.8 (±14.3)% for the TIDieR checklist, 53.2 (±20.2)% for the CERT checklist, and 70.0 (±18.9)% for the CONTENT scale. Despite some overlap, the three standardized assessment tools (TIDieR, CERT, CONTENT) included different elements resulting in different scores. All tools assess elements linked to PA programs (provider, location, timing, personalization and adherence), but the CERT checklist includes other essential elements (e.g., additional resources, motivational strategies, adverse events).

Conclusions

The lack of complete reporting of PA programs in RCTs for the management of JIA and the variation in scores and assessed elements among standardized assessment tools show the need to improve reporting. Using the most comprehensive standardized tool (i.e., the CERT) and providing accessible supplemental information on PA programs may improve the reporting quality of PA programs in RCTs and help reproduce PA programs in research and clinical practice.

Background

Juvenile idiopathic arthritis (JIA) is a chronic childhood autoimmune disease, affecting approximately two in 1000 children [1]. JIA is characterized by prolonged inflammation in the youth’s joints including pain, redness and swelling [2], which often lead to physical, psychological and social limitations [3]. Practitioners diagnose JIA after symptoms are experienced in one or more joints for at least six consecutive weeks in youth under age 16 [4]. Such symptoms produce additional health and social difficulties: youth with JIA are less physically active than other kids, may miss school because of symptoms or appointments with health care providers, and may feel different from their peers when they cannot participate in physical education or play [3]. Healthy lifestyle choices, such as being physically active, are crucial in attaining improved outcomes in youth with JIA and as they become adults [5,6,7,8]. Moreover, children with JIA are developing their physical skills alongside their self-esteem and self-efficacy, which are crucial for their future [5, 7, 8]. It is particularly important for youth with JIA to learn how to self-manage their disease, which means that they should gain the knowledge and the ability to manage their symptoms, such as pain, and the consequences of their chronic condition on their life [7, 9]. This may be achieved by using various self-management strategies. In addition to pharmacological therapies and regimented exercises, treatment recommendations for JIA include recreational and physical activities (PA) within the child’s pain threshold for disease self-management [5].

PA programs are beneficial in various chronic diseases, such as fibromyalgia, chronic kidney disease, and heart failure [10], as well as JIA [7]. Specifically in JIA; the Ottawa Panel Evidence-Based Clinical Practice Guidelines [7], based on systematic reviews of randomized controlled trials (RCTs), found that most PA programs described improved JIA management. Their overall findings were that various PA programs, including pilates, home strengthening exercise programs, aquatic aerobic fitness programs, cardio-karate (aerobic exercise) and weight-bearing exercise programs improved various health outcomes such as pain, range of motion, muscle strength, quality of life and function [11,12,13,14,15]. The latest RCTs found that other PA programs, including balance-proprioceptive exercises, backward treadmill training, water-running programs, combination of resistive underwater exercises and interferential current therapy, combination of electromyographic biofeedback and a physical therapy program, also led to improved health outcomes such as balance, anaerobic exercise capacity, pain, muscle strength and function [16,17,18,19,20].

Although studies have shown that PA programs improve disease management and health outcomes, PA programs are not always well described [7]. This may be problematic since researchers and clinicians need specific details on PA programs in clinical trials to facilitate further high-quality research and to implement the most effective PA programs in clinical practice [21]. Since moderate- to high-quality RCTs frequently inform recommendations in clinical practice guidelines, it is important to assess the reporting quality of PA programs in these trials. The reporting quality of trials can be assessed using standardized tools, which could improve intervention descriptions in protocols and manuscripts, and allow for replication of PA programs in research and clinical practice [22]. According to the EQUATOR Network’s website and the scientific literature, three standardized tools can be used to assess the reporting quality of all types of PA programs in RCTs [23,24,25,26]. These tools are the Template for Intervention Description and Replication (TIDieR) checklist [23]; the Consensus on Exercise Reporting Template (CERT) checklist [24]; and the Consensus on Therapeutic Exercise Training (CONTENT) scale [25]. The TIDieR is applicable to most types of interventions [23] and is an extension of the CONSORT 2010 statement [27] and the SPIRIT 2013 statement [28]. The CERT is an extension of the TIDieR checklist, which provides more elements which are specific to exercise [24]. The CONTENT scale is another tool which is specific to exercise programs [25]. Other studies used these tools to assess the quality of reporting of PA programs in RCTs in other populations [29, 30].

The primary objective of this study was to assess the quality of reporting of PA programs in RCTs for the management of JIA using three different standardized assessment tools. The secondary objectives were: a) to compare the scoring of the three standardized assessment tools for all RCTs; and b) to describe the elements that are similar and different between the three standardized assessment tools.

Methods

Study design

First, we updated an earlier systematic search completed by Cavallo et al. [7], which identified moderate- to high-quality RCTs of PA programs for the management of JIA (including RCTs published up until May 2015). Second, we assessed the quality of reporting of PA programs in identified RCTs using three different standardized assessment tools.

Search strategy

Our study applied a similar search strategy as Cavallo et al. [7] to identify moderate- to high-quality RCTs of PA programs for JIA management published between May 2015 and January 2019 using these electronic databases: Cochrane Central Register of Controlled Trials, EMBASE (Ovid) and MEDLINE (Ovid) (see Appendix 1). The search produced a list of records to be reviewed.

Study selection

Two reviewers (T.K., A.S.) independently screened titles and abstracts of the records using pre-determined selection criteria, outlined by Cavallo et al. [7] Following the initial screening, the two independently assessed the eligible full-length articles to ensure all inclusion criteria were met. Finally, the two reviewers independently selected eligible articles and gained consensus. If consensus between the two reviewers was not reached, a third reviewer (M.D.B., L.B. or K.T.A.) facilitated a final decision. Eligible studies were RCTs of PA programs for JIA management, graded as moderate- to high-quality using the Physiotherapy Evidence Database (PEDro) scale (total scoring of 5 or greater out of 10 points). In addition, comparison groups needed to include a JIA population undergoing conventional therapy or lower intensity PA, or being on a wait list.

Reviewers’ training with the three standardized assessment tools

Training on the three standardized assessment tools occurred prior to the scoring of all selected and eligible RCTs of PA programs for JIA management. Two junior reviewers (T.K., A.S.) were trained by a senior reviewer (M.D.B.) using a practice session with two published RCTs of PA programs for the management of fibromyalgia [31, 32]. The senior reviewer ensured that the scores between the two junior reviewers were consistent and that definitions of all items from each standardized assessment tool were understood.

Study data extraction

An Excel spreadsheet was developed with the elements of the three standardized assessment tools and the characteristics of each RCT (e.g., year, authors’ names, types of PA interventions, control groups). If an RCT included two types of PA programs (i.e., other than usual care), the reporting of the programs was assessed separately. After independently scoring the reporting quality of PA programs, the two reviewers (T.K., A.S.) compared individual item scores, for all RCTs, from each of the standardized assessment tools and came to a consensus. Each item from the three standardized assessment tools were scored as 1 (reported) or 0 (not reported). A third senior reviewer (M.D.B) served as an arbitrator if needed for disagreements. E-mails were sent to authors to ask for additional information on their PA programs, including supplementary material, with up to two reminders.

Reporting quality of physical activity programs in randomized controlled trials

Three standardized assessment tools were used for assessing the reporting quality: Template for Intervention Description and Replication (TIDieR) checklist [23]; Consensus on Exercise Reporting Template (CERT) checklist [24]; and Consensus on Therapeutic Exercise Training (CONTENT) scale [25].

TIDieR checklist

The TIDieR checklist and guide (Table 2 in Appendix 2) were developed based on a literature review, a Delphi survey of international experts, and a panel meeting, with the aim of providing authors the minimum amount of information required for describing an intervention [23]. The TIDieR checklist was found to be applicable to most types of interventions, including pharmacological interventions, with the expectation that authors would provide additional information when required for their specific intervention type [23]. It is an extension of the CONSORT 2010 statement [27] and the SPIRIT 2013 statement [28]. The TIDieR checklist has 12 items: brief name of the intervention; goal of the intervention; materials used in the intervention; procedure; provider; how the intervention was delivered; where the intervention was delivered (location); when the intervention was delivered; how much of the intervention was delivered (dosage); tailoring of the intervention to each individual; modifications made to the intervention; whether the intervention was well-planned; and well-delivered.

CERT checklist

The CERT checklist (Table 3 in Appendix 2) was developed using the EQUATOR Network’s methodological framework through a meta-epidemiologic study, a Delphi survey and a Delphi workshop, with the aim of providing authors direction for reporting exercise interventions by including key items that are considered essential for replicating of exercise program interventions [24]. This checklist is an extension of the TIDieR checklist, providing more assessed elements and reporting requirements [24]. Similar to the TIDieR checklist, there is the expectation that reporting additional information may be required depending on the type of exercise program. The CERT checklist has 19 items covering seven categories: materials used in the intervention; provider; how the intervention was delivered; where the intervention was delivered; when the intervention was delivered/how much of the intervention was delivered (dosage); tailoring of the intervention to each individual; and how well participants followed the intervention (compliance).

CONTENT scale

The CONTENT scale (Table 4 in Appendix 2) was created based on consensus findings from a Delphi study and was designed to determine the therapeutic effectiveness of an exercise program (evaluated based on an individual score of 6 out of 9 CONTENT scale items or higher) [25]. This scale guides authors in providing sufficient reporting detail for readers to understand how the intervention was implemented. The CONTENT scale is a 9-item scale that contains 17 sub-items. There are five specific item categories: patient eligibility; competences of the provider and setting of the exercise program; rationale; content; and adherence to the exercise program.

Descriptive statistical analysis

Standardized assessment tools’ scores for all RCTs combined

For each standardized assessment tool, the total mean scores and standard deviation (SD) were calculated using the individual RCT scores. A 95% confidence interval was also computed for each standardized assessment tool. To compare the total mean scores of each standardized assessment tool, the total mean scores were expressed as a percentage. The reporting quality of the RCTs was evaluated by each standardized assessment tool using this grading method for each mean percentage score: 50% or less = poor; 51 to 79% = moderate; and 80 to 100% = good, as described by Mack et al. [33]

Standardized assessment tools’ scores for individual RCTs

To assess the reporting quality, each PA program in RCTs for JIA received three individual scores, one from each of the three standardized assessment tools. The three individual scores were reported as scores out of: 12 (TIDieR checklist), 19 (CERT checklist) and nine (CONTENT scale). Subsequently, the individual scores were reported as a percentage score, thus each PA program in RCTs for JIA received three percentage scores.

Reporting of each item from the three standardized assessment tools

At the level of each standardized assessment tool, the reporting of each item was expressed as a percentage of RCTs which reported this item. A descriptive analysis was used to identify the items of each standardized assessment tool which were most and least reported.

Shared and different elements between the three standardized assessment tools

The elements that were shared between all three tools were noted, along with those that were different. Items were categorized across tools as overlap, uncertain overlap or no overlap.

Results

Search results

The update of the systematic search (from 2015 to present) produced 37 articles after removing duplicates. Of those, five were included after two selection rounds [16,17,18,19,20]. These were added to the five RCTs found by Cavallo et al. [7] in their previous search (until 2015) [11,12,13,14,15], totaling10 RCTs (Fig. 1). Four of the authors replied, but none provided additional information on their PA programs. Five of the RCTs had supplementary material, but we could access it only for one RCT [11], and thus did not consider this information to treat all RCTs equally.

Fig. 1
figure 1

Study flow diagram (Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA)) for selected RCTs. This PRISMA flow chart is developed using the “PRISMA Statement” referenced in: Moher D, Liberati A, Tetzlaff J, Altman DG, The PRISMA Group (2009) Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement. PLoS Med 6 (7): e1000097.https://doi.org/10.1371/journal.pmed.1000097

Full size image

Standardized assessment tools’ scores for all RCTs combined

The average reporting quality for all RCTs combined was moderate for the three standardized assessment tools. The mean percentage (± standard deviation) total reporting quality score for RCTs evaluated was 70.8 (±14.3) % for the TIDieR checklist, 53.2 (±20.2) % for the CERT checklist, and 70.0 (±18.9) % for the CONTENT scale (Table 1).

Table 1 Individual, total and percentage consensus scores for the TIDieR checklist, the CERT checklist, and the CONTENT scale
Full size table

Standardized assessment tools’ scores for individual RCTs

None of the RCTs had complete reporting quality for PA programs. The highest scoring RCTs for the TIDieR checklist, CERT checklist, and CONTENT scale were: Bayraktar et al. [18] and Tarakci et al. [12]; Mendonca et al. [11]; and Tarakci et al. [12], respectively. The lowest scoring RCTs for the TIDieR checklist, CERT checklist, and CONTENT scale were: Eid et al. [20]; El Aziz et al. [17]; and Eid et al. [20] and Sandstedt et al. [15], respectively (Table 1).

Reporting of each item from the three standardized assessment tools

TIDieR checklist

The highest score was 11 out of 12, which was given to two studies [12, 18], while the lowest was 6 out of 12 [17, 20] (Table 1). The majority of RCTs met the TIDieR criteria for item 1 (brief name of the intervention) and item 2 (rationale of the intervention). In contrast, most of the RCTs did not satisfy item 9 (tailoring of the intervention to each individual) and item 10 (modifications made to the intervention) (Fig. 2).

Fig. 2
figure 2

Percentage of RCTs (n = 10) which reported each TIDieR checklist item (see Appendix 2: item descriptions)

Full size image

CERT checklist

The highest score was 16 out of 19 [11], while the lowest score was 6 out of 19 [20] (Table 1). Most RCTs satisfied these items: item 1 (necessary exercise equipment), item 3 (exercise performed individually or in a group), and item 7A (way in which to progress through the exercise program). Most RCTs did not satisfy these items: item 6 (motivation strategies), item 8 (exercise description), item 9 (at home program component), item 10 (non-exercise components), item 11 (adverse events) and item 15 (decision rule for starting the level of the exercise) (Fig. 3).

Fig. 3
figure 3

Percentage of RCTs (n = 10) which reported each CERT checklist item (see Appendix 2: item descriptions)

Full size image

CONTENT scale

The highest score was 9 out of 9 [12] while the lowest score was 4 out of 9 [15] (Table 1). Of the nine items from the CONTENT scale, most RCTs reported item 1 (how patients were selected), item 2 (whether the selection of patients was adequate), and item 4 (a priori aims and intentions of the program). Most of the RCTs did not satisfy item 8 (whether therapeutic exercises are personalized or contextualized) (Fig. 4).

Fig. 4
figure 4

Percentage of RCTs (n = 10) which reported each CONTENT scale item (see Appendix 2: item descriptions)

Full size image

Shared and different elements between the three standardized assessment tools

None of the checklists had a perfect overlap of items (Appendix 3). The shared elements between the three standardized assessment tools were: (1) who provided the intervention along with their qualification; (2) where was the intervention taking place (setting); (3) when was the intervention held and how frequently (intensity); (4) personalization of the intervention to a given participant; (5) any modifications to the intervention; and (6) the adherence to the intervention. An element only required by the TIDieR checklist was a name or phrase that describes the intervention (brief name). Elements only required by the CERT checklist were: motivational strategies used, a detailed description to enable replication (including additional resources for researchers); a description of at home components; and the types and number of adverse events. Elements only required by the CONTENT scale were a description of patient selection and a description of the adequacy of patient selection.

Discussion

Overall, the quality of reporting was moderate for the PA programs [11,12,13,14,15,16,17,18,19,20] in 10 moderate- to high-quality RCTs for the management of JIA, based on three standardized assessment tools. Scores varied among the three tools. Six elements were shared among the three tools: who provided the intervention; the location of the intervention; when and how often the intervention was delivered; personalization of the intervention for participants; modifications made to the intervention; and overall adherence to the program. Our findings of moderate reporting quality of PA programs in RCTs for JIA management are consistent with a study on knee osteoarthritis management when using the CERT checklist and the American College of Sports Medicine guideline [34]. In addition, studies in fibromyalgia management and stroke rehabilitation had consistent results of moderate reporting quality of PA programs in RCTs when using the TIDieR checklist, CERT checklist, and CONTENT scale [29, 30].

The moderate reporting quality of PA programs in RCTs for JIA management may be explained by the lack of requirements by journals for authors to use reporting guidelines, and journal restrictions on length of manuscripts and supplementary materials [22, 35]. Concerning the use of reporting guidelines, Turner et al. [36] compared the reporting quality of RCTs published in journals which endorsed the CONSORT statement (a general reporting tool for RCTs) with those which did not, and found that journals which endorsed the CONSORT statement had overall greater likelihood of more complete reporting. This suggests that reporting quality of RCTs across various disciplines could be improved through the endorsement of reporting tools by journals [35]. Concerning the restrictions on length of manuscripts and supplementary material, our results showed that RCTs with the highest reporting quality generally included more figures, tables, flow-charts and/or lists [11, 12, 16]. Also, two of these RCTs were similarly scored between the three standardized assessment tools [11, 16]. Including further detail through concise means (e.g. figures, tables) allowed authors to meet the word count and page limit while including important reporting details. Supplementary material may be useful, but these should be easily accessible, which was not the case in our search for information. In fact, Abell et al. [37] noted that the publication of supplemental material increases reporting completeness of exercise interventions in RCTs for cardiac rehabilitation from 8 to 43% [37]. Through the guidance of reporting tools, the use of more concise reporting means, and the publication of easily accessible supplemental material, such as instructional videos, images, tables and protocol papers, authors may overcome manuscript length restrictions and allow for adequate reporting.

Concerning the mean total reporting scores for the three standardized assessment tools, all three were of moderate quality, with the CERT checklist having the lowest score (53.2%) compared to the TIDieR checklist (70.8%) and the CONTENT scale (70.0%). The moderate overall reporting quality for the PA programs may be explained by the fact that the three tools share six key elements, which indicate a level of similarity in some of the core reporting requirements. In general, elements such as the dosage of the exercise or PA program, and the material used were better reported than information on the intervention progression or tailoring, the adherence, any noted adverse events or the motivational strategies used.

Two elements which were shared between the three tools and were under-reported were: (1) qualification level of those who lead the intervention and whether the exercises were supervised or unsupervised; and (2) modifications (or lack thereof) made to the intervention. These elements were also under-reported in hypertension management, physiotherapy, and educational studies [38,39,40,41]. Particular importance should be given to the lack of information about modification and fidelity of PA programs (Items 10–12 of the TIDieR checklist). Reporting on modification and fidelity ensures the adequate assessment by knowledge-users of the interventions’ limitations and feasibility of implementation in clinical practice [42].

The low score for the CERT may be explained by the fact that items which were the least reported (with 50% or less RCTs meeting these reporting requirements) were unique to the CERT. These unique elements with low scores include: description to enable replication (must include resources), description of at home components, motivational strategies used and the type and number of adverse events. Similar results of incomplete reporting of these elements were seen in other studies which assessed the reporting quality of PA programs using CERT in RCTs for cerebral palsy and hypertension [38, 43]. This may be explained by the fact that the CERT checklist contains a greater level of detail and more items describing elements related to the procedure and execution of exercise interventions than the other standardized tools. It is important to note that a number of elements were included in the CERT checklist since it was developed specifically to enhance the reporting quality of exercise programs, and acts as an extension of the TIDieR checklist applicable to any intervention type [44, 45]. The elements unique to the CERT checklist are essential to assess the reporting quality of PA programs in trials, according to experts involved in a rigorous process [24]. In particular, the details of adherence of the participant (item 5) and the service provider (item 16a), allow an explicit description of patient adherence to the agreed intervention plan, as well as fidelity of delivering and performing the intervention as planned by the developer [24, 38]. Also, motivational strategies increase the effectiveness of exercise [24]. Unlike the CERT, the TIDieR only identifies potential personal motivating factors helping to respond to the individual’s context without assessing comprehensive solutions [23]. These elements provide much needed information to better understand the limitations in service provision and implementation. Further, these findings highlight the importance of considering the different levels of specificity and comprehensiveness of these tools (i.e., CERT for exercise programs vs. TIDieR for any type of intervention).

Other elements that are of interest include those focusing on the selection of participants which are unique to the CONTENT scale. Interestingly, these elements are also part of the CONSORT statement, which is recommended in addition to the TIDieR and CERT checklists when assessing RCT quality.

Overall, the CERT checklist is the most comprehensive to evaluate the reporting quality of a wide range of PA programs in RCTs. Since its total reporting quality score for RCTs was relatively low, efforts should be made to improve reporting of its various elements, especially the description of the PA programs to enable replication (with resources such as accessible instructional videos, images, tables and protocol papers), description of at home components, motivational strategies used and the type and number of adverse events.

Limitations

Selection and information bias are possible in this study due to a small sample size (n = 10) and the possibility of missing relevant studies (e.g., published in other languages). RCTs were selected through a systematic search of three online databases and the criteria of being moderate- to high-quality trials based on PEDro standards [46]. Including lower quality trials may have resulted in lower quality results and possibly overall lower quality reporting in RCTs. In addition, a larger sample size would allow for the analysis of other trends (e.g., publication date).

Inclusion of supplemental information from authors, during the process of assessing content reporting, may have increased the overall reporting quality in the given sample [37]. Although this process may help to improve completeness of the information, it remains lengthy and difficult since this information is not always easily accessible. In addition, as this study aimed to diminish inter-rater variation, consensus of scores was gained between reviewers, without the help of a senior reviewer.

Conclusions

In summary, results showed that reporting of PA programs in 10 moderate- to high-quality RCTs for JIA management remains incomplete. Despite some overlap, the three standardized assessment tools (TIDieR, CERT, CONTENT) included different elements resulting in different scores, which highlights the need to choose the most suitable standardized tool to report PA programs in RCTs. Using the most comprehensive standardized tool (i.e., the CERT) and providing accessible supplemental information on PA programs may improve the reporting quality of PA programs in RCTs and help reproduce PA programs in research and clinical practice.

Recommendations for future RCTs reporting PA programs for the management of JIA

Future studies may improve the reporting quality of PA programs in RCTs by: (1) using the most comprehensive standardized tool to report PA programs; and (2) providing accessible supplemental information for clinicians to help reproduce PA programs in research and clinical practice.

Clinical messages

  • Reporting of PA programs in moderate-to high-quality RCTs for JIA management remains incomplete.

  • The three reporting tools included different elements and gave different scores, which highlights the need to choose the most comprehensive standardized tool to report PA programs in RCTs.

  • Accessible instructional videos, images, tables and protocol papers, as well as the use of reporting tools may help improve information completeness and subsequent reporting quality which could possibly improve clinical implementation.

Availability of data and materials

Not applicable.

Abbreviations

CERT:

Consensus on Exercise Reporting Template

CONSORT:

Consolidated Standards of Reporting Trials

CONTENT:

Consensus on Therapeutic Exercise Training

EQUATOR network:

Enhancing the QUAlity and Transparency Of health Research

JIA:

Juvenile idiopathic arthritis

PA:

Physical activity

PEDro:

Physiotherapy Evidence Database

RCTs:

Randomized controlled trials

SD:

Standard deviation

TIDieR:

Template for Intervention Description and Replication

References

  1. Gabriel SE, Michaud K. Epidemiological studies in incidence, prevalence, mortality, and comorbidity of the rheumatic diseases. Arthritis Res Ther. 2009;11(3):229.

    Article  PubMed  PubMed Central  Google Scholar 

  2. Consolaro A, Giancane G, Schiappapietra B, Davi S, Calandra S, Lanni S, et al. Clinical outcome measures in juvenile idiopathic arthritis. Pediatr Rheumatol Online J. 2016;14(1):23.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Schanberg LE, Anthony KK, Gil KM, Maurin EC. Daily pain and symptoms in children with polyarticular arthritis. Arthritis Rheum. 2003;48(5):1390–7.

    Article  PubMed  Google Scholar 

  4. Petty R, Laxer R, Lindsley C, Wedderburn L. Textbook of Pediatric Rheumatology. 7th ed. Philadelphia: Saunders; 2015.

  5. Philpott J, Houghton K, Luke A. Physical activity recommendations for children with specific chronic health conditions: juvenile idiopathic arthritis, hemophilia, asthma and cystic fibrosis. Paediatr Child Health. 2010;15(4):213–25.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  6. Stinson JN, Luca NJ, Jibb LA. Assessment and management of pain in juvenile idiopathic arthritis. Pain Res Manag. 2012;17(6):391–6.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Cavallo S, Brosseau L, Toupin-April K, Wells GA, Smith CA, Pugh AG, et al. Ottawa panel evidence-based clinical practice guidelines for structured physical activity in the management of juvenile idiopathic arthritis. Arch Phys Med Rehabil. 2017;98(5):1018–41.

    Article  PubMed  Google Scholar 

  8. Cavallo S, April KT, Grandpierre V, Majnemer A, Feldman DE. Leisure in children and adolescents with juvenile idiopathic arthritis: a systematic review. PLoS One. 2014;9(10):e104642.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  9. Stinson JN, Toomey PC, Stevens BJ, Kagan S, Duffy CM, Huber A, et al. Asking the experts: exploring the self-management needs of adolescents with arthritis. Arthritis Rheum. 2008;59(1):65–72.

    Article  PubMed  Google Scholar 

  10. Pasanen T, Tolvanen S, Heinonen A, Kujala UM. Exercise therapy for functional capacity in chronic diseases: an overview of meta-analyses of randomised controlled trials. Br J Sports Med. 2017;51(20):1459–65.

    Article  PubMed  Google Scholar 

  11. Mendonca TM, Terreri MT, Silva CH, Neto MB, Pinto RM, Natour J, et al. Effects of Pilates exercises on health-related quality of life in individuals with juvenile idiopathic arthritis. Arch Phys Med Rehabil. 2013;94(11):2093–102.

    Article  PubMed  Google Scholar 

  12. Tarakci E, Yeldan I, Baydogan SN, Olgar S, Kasapcopur O. Efficacy of a land-based home exercise programme for patients with juvenile idiopathic arthritis: a randomized, controlled, single-blind study. J Rehabil Med. 2012;44(11):962–7.

    Article  PubMed  Google Scholar 

  13. Takken T, Van der NJ, Kuis W, Helders PJ. Aquatic fitness training for children with juvenile idiopathic arthritis. Rheumatology (Oxford). 2003;42(11):1408–14.

    Article  CAS  Google Scholar 

  14. Singh-Grewal D, Schneiderman-Walker J, Wright V, Bar-Or O, Beyene J, Selvadurai H, et al. The effects of vigorous exercise training on physical function in children with arthritis: a randomized, controlled, single-blinded trial. Arthritis Rheum. 2007;57(7):1202–10.

    Article  PubMed  Google Scholar 

  15. Sandstedt E, Fasth A, Eek MN, Beckung E. Muscle strength, physical fitness and well-being in children and adolescents with juvenile idiopathic arthritis and the effect of an exercise programme: a randomized controlled trial. Pediatr Rheumatol Online J. 2013;11(1):7.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Baydogan SN, Tarakci E, Kasapcopur O. Effect of strengthening versus balance-proprioceptive exercises on lower extremity function in patients with juvenile idiopathic arthritis: a randomized, single-blind clinical trial. Am J Phys Med Rehabil. 2015;94(6):417–24 quiz.

    Article  PubMed  Google Scholar 

  17. El Aziz G, Hamada H, and El Khatib A. Impact of backward treadmill training on balance in children with juvenile rheumatoid arthritis: a randomized controlled study. Updated: 2017,.

    Google Scholar 

  18. Bayraktar D, Savci S, tug-Gucenmez O, Manci E, Makay B, Ilcin N, et al. The effects of 8-week water-running program on exercise capacity in children with juvenile idiopathic arthritis: a controlled trial. Rheumatol Int. 2019;39(1):59–65.

    Article  PubMed  Google Scholar 

  19. Elnaggar RK, Elshafey MA. Effects of combined resistive underwater exercises and interferential current therapy in patients with juvenile idiopathic arthritis: a randomized controlled trial. Am J Phys Med Rehabil. 2016;95(2):96–102.

    Article  PubMed  Google Scholar 

  20. Eid MA, Aly SM, El-Shamy SM. Effect of Electromyographic biofeedback training on pain, quadriceps muscle strength, and functional ability in juvenile rheumatoid arthritis. Am J Phys Med Rehabil. 2016;95(12):921–30.

    Article  PubMed  Google Scholar 

  21. Hoffmann TC, Walker MF. TIDieR-ing up’ the reporting of interventions in stroke research: the importance of knowing what is in the ‘black box’. Int J Stroke. 2015;10(5):657–8.

    Article  PubMed  Google Scholar 

  22. Hoffmann T, English T, Glasziou P. Reporting of interventions in randomised trials: an audit of journal instructions to authors. Trials. 2014;15:20.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Hoffmann TC, Glasziou PP, Boutron I, Milne R, Perera R, Moher D, et al. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ. 2014;348:g1687.

    Article  PubMed  Google Scholar 

  24. Slade SC, Dionne CE, Underwood M, Buchbinder R. Consensus on exercise reporting template (CERT): explanation and elaboration statement. Br J Sports Med. 2016;50(23):1428–37.

    Article  PubMed  Google Scholar 

  25. Hoogeboom TJ, Oosting E, Vriezekolk JE, Veenhof C, Siemonsma PC, de Bie RA, et al. Therapeutic validity and effectiveness of preoperative exercise on functional recovery after joint replacement: a systematic review and meta-analysis. PLoS One. 2012;7(5):e38031.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  26. The EQUATOR Network. Enhancing the quality and transparency of health research. 2020, https://www.equator-network.org/, Accessed 26 Feb 2020.

    Google Scholar 

  27. Moher D, Hopewell S, Schulz KF, Montori V, Gøtzsche PC, Devereaux PJ, et al. CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomzed trials. BMJ. 2010;340:1687.

    Article  Google Scholar 

  28. Chan AW, Tetzlaff JM, Altman DG, Laupacis A, Gotzsche PC, Krleza-Jeric K, et al. SPIRIT 2013 statement: defining standard protocol items for clinical trials. Ann Intern Med. 2013;158(3):200–7.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Jo D, Del Bel MJ, McEwen D, O'Neil J, Mac Kiddie OS. Varez-Gallardo IC et al. a study of the description of exercise programs evaluated in randomized controlled trials involving people with fibromyalgia using different reporting tools, and validity of the tools related to pain relief. Clin Rehabil. 2019;33(3):557–63.

    Article  PubMed  Google Scholar 

  30. McEwen D, O'Neil J, Miron-Celis M, Brosseau L. Content reporting in post-stroke therapeutic circuit-class exercise programs in randomized control trials. Top Stroke Rehabil. 2019;26(4):281–7.

    Article  PubMed  Google Scholar 

  31. Carson JW, Carson KM, Jones KD, Bennett RM, Wright CL, Mist SD. A pilot randomized controlled trial of the yoga of awareness program in the management of fibromyalgia. Pain. 2010;151(2):530–9.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Kayo AH, Peccin MS, Sanches CM, Trevisani VF. Effectiveness of physical activity in reducing pain in patients with fibromyalgia: a blinded randomized clinical trial. Rheumatol Int. 2012;32(8):2285–92.

    Article  PubMed  Google Scholar 

  33. Mack DE, Wilson PM, Santos E, Brooks K. Standards of reporting: the use of CONSORT PRO and CERT in individuals living with osteoporosis. Osteoporos Int. 2018;29(2):305–13.

    Article  CAS  PubMed  Google Scholar 

  34. O'Neil J, McEwen D, Del Bel MJ, Jo D, Thevenot O, MacKiddie OS, et al. Assessment of the content reporting for therapeutic exercise interventions among existing randomized controlled trials on knee osteoarthritis. Clin Rehabil. 2018;32(7):980–4.

    Article  PubMed  Google Scholar 

  35. Candy B, Vickerstaff V, Jones L, King M. Description of complex interventions: analysis of changes in reporting in randomised trials since 2002. Trials. 2018;19(1):110.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Turner L, Shamseer L, Altman DG, Schulz KF, Moher D. Does use of the CONSORT statement impact the completeness of reporting of randomised controlled trials published in medical journals? A Cochrane review. Syst Rev. 2012;1:60.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Abell B, Glasziou P, Hoffmann T. Reporting and replicating trials of exercise-based cardiac rehabilitation: do we know what the researchers actually did? Circ Cardiovasc Qual Outcomes. 2015;8(2):187–94.

    Article  PubMed  Google Scholar 

  38. Hacke C, Nunan D, Weisser B. Do exercise trials for hypertension adequately report interventions? A reporting quality study. Int J Sports Med. 2018;39(12):902–8.

    Article  PubMed  Google Scholar 

  39. Bruder AM, Shields N, Dodd KJ, Taylor NF. Prescribed exercise programs may not be effective in reducing impairments and improving activity during upper limb fracture rehabilitation: a systematic review. J Physiother. 2017;63(4):205–20.

    Article  PubMed  Google Scholar 

  40. Albarqouni L, Glasziou P, Hoffmann T. Completeness of the reporting of evidence-based practice educational interventions: a review. Med Educ. 2018;52(2):161–70.

    Article  PubMed  Google Scholar 

  41. Yamato TP, Maher CG, Saragiotto BT, Hoffmann TC, Moseley AM. How completely are physiotherapy interventions described in reports of randomised trials? Physiotherapy. 2016;102(2):121–6.

    Article  PubMed  Google Scholar 

  42. Wells M, Williams B, Treweek S, Coyle J, Taylor J. Intervention description is not enough: evidence from an in-depth multiple case study on the untold role and impact of context in randomized controlled trials of seven complex interventions. Trials. 2012;13:95.

    Article  PubMed  PubMed Central  Google Scholar 

  43. Sakzewski L, Reedman S, Hoffmann T. Do we really know what they were testing? Incomplete reporting of interventions in randomised trials of upper limb therapies in unilateral cerebral palsy. Res Dev Disabil. 2016;59:417–27.

    Article  PubMed  Google Scholar 

  44. Kent P, O'Sullivan PB, Keating J, Slade SC. Evidence-based exercise prescription is facilitated by the consensus on exercise reporting template (CERT). Br J Sports Med. 2018;52(3):147–8.

    Article  PubMed  Google Scholar 

  45. Page P, Hoogenboom B, Voight M. Improving the reporting of therapeutic exercise interventions in rehabilitation research. Int J Sports Phys Ther. 2017;12(2):297–304.

    PubMed  PubMed Central  Google Scholar 

  46. de Morton NA. The PEDro scale is a valid measure of the methodological quality of clinical trials: a demographic study. Aust J Physiother. 2009;55(2):129–33.

    Article  PubMed  Google Scholar 

Download references

Acknowledgments

We would like to thank The Ottawa Panel members who provided their systematic search and shared RCT results. We would also like to thank Andrea Boyd for helping to format this paper.

Funding

The author(s) received no financial support for the research, authorship, and/or publication of this article.

Author information

Authors and Affiliations

  1. Faculty of Scienceskk, University of Ottawa, Ottawa, Ontario, Canada

    Teresa-Rose Kattackal

  2. School of Rehabilitation, Université de Montréal, Montréal, Québec, Canada

    Sabrina Cavallo

  3. School of Rehabilitation Sciences, Faculty of Health Sciences, University of Ottawa, Ottawa, Ontario, Canada

    Lucie Brosseau, Michael J. Del Bel, Michelle Dorion & Karine Toupin-April

  4. Children’s Hospital of Eastern Ontario Research Institute, room L1147, 401 Smyth Road, Ottawa, ON, K1H 8L1, Canada

    Aditi Sivakumar, Erin Ueffing & Karine Toupin-April

  5. Department of Pediatrics, Faculty of Medicine, University of Ottawa, Ottawa, Ontario, Canada

    Karine Toupin-April

Authors
  1. Teresa-Rose Kattackal
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sabrina Cavallo
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Lucie Brosseau
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Aditi Sivakumar
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Michael J. Del Bel
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Michelle Dorion
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Erin Ueffing
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Karine Toupin-April
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

TK was involved in developing the protocol, performed data collection, conducted analyses, interpreted the data and was a major contributor in writing the manuscript. SC was involved in developing the protocol, interpreted the data and was a major contributor in writing the manuscript. LB was involved in developing the protocol, performed data collection, conducted analyses, interpreted the data and was a major contributor in writing the manuscript. AS was involved in developing the protocol, performed data collection and reviewed the manuscript. MDB was involved in developing the protocol, trained the evaluators, interpreted the data and reviewed the manuscript. MD was involved in interpreting the data and reviewed the manuscript. EU was involved in interpreting the data and was a major contributor in writing the manuscript. KTA was involved in developing the protocol, performed data collection, conducted analyses, interpreted the data and was a major contributor in writing the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Karine Toupin-April.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article. Dr. Lucie Brosseau was an author on the publication describing the development of the CERT checklist.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendices

Appendix 1

MEDLINE (OVID) search strategy

1. arthritis, juvenile/

2. arthritis, psoriatic/

3. 1 or 2

4. (juvenile adj2 arthritis).tw.

5. 3 or 4

6. clinical trial.pt.

7. randomized controlled trial.pt.

8. random$.tw.

9. (double adj blind$).tw.

10. placebo$.tw.

11. meta-analysis.pt.,sh.

12. (meta-anal: or metaanal:).tw.

13. (quantitativ: review: or quantitativ: overview:).tw.

14. (methodologic: review: or systematic: overview:).tw.

15. (systematic: review: or systematic: overview:).tw.

16. review.pt. and medline.tw.

17. exp. cohort studies/

18. (cohort or longitudinal or prospective).tw.

19. exp. case-control studies/

20. (retrospective or case-control).tw.

21. Controlled Clinical Trial/

22. (controlled adj2 trial$).tw.

23. or/6–22.

24. therap$ exercise$.tw.

25. exp. exercise therapy/

26. (passive adj2 exercis$).tw.

27. mobilizing exercis$.tw.

28. ((strength$ or resistance or aerobic) adj exercis$).tw.

29. (continuous passive motion or movement device).tw.

30. exp. exercise/

31. exp. sports/

32. exp. exercise movement techniques/

33. (sport* or aqua* or swim*).tw.

34. (Taichi or “tai chi” or taiji or “tai ji” or yoga or pilates).tw.

35. or/24–34

36. plyometric exercise/ or plyometric.tw.

37. 35 not 36

38. manual therap$.tw.

39. exp. manipulation orthopedic/

40. (manipulation adj (therap$ or joint)).tw.

41. mobilization.tw.

42. or/38–41

43. 5 and 23

44. 37 or 42

45. 43 and 44

46. (2015 05* or 2015 06* or 2015 07* or 2015 08* or 2015 09* or 2015 10* or 2015 11* or 2015 12*).dt.

47. (2016* or 2017* or 2018* or 2019*).dt.

48. 46 or 47

49. 45 and 48

Appendix 2

Table 2 Individual RCT TIDieR checklist scores based on reviewer consensus
Full size table
Table 3 Individual RCT CERT checklist scores based on reviewer consensus
Full size table
Table 4 Individual RCT CONTENT scale scores based on reviewer consensus
Full size table

Appendix 3

Fig. 5
figure 5

Overlap of items between the CERT and TIDieR checklists (see Appendix 2 for item descriptions). Legend: Black (overlap); Grey (uncertain overlap); White (no overlap)

Full size image
Fig. 6
figure 6

Overlap of items between CONTENT scale and TIDieR checklist (see Appendix 2 for item descriptions). Legend: Black (overlap); Grey (uncertain overlap); White (no overlap)

Full size image
Fig. 7
figure 7

Overlap of items between CERT checklist and CONTENT scale (see Appendix 2 for item descriptions). Legend: Black (overlap); Grey (uncertain overlap); White (no overlap)

Full size image

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kattackal, TR., Cavallo, S., Brosseau, L. et al. Assessing the reporting quality of physical activity programs in randomized controlled trials for the management of juvenile idiopathic arthritis using three standardized assessment tools. Pediatr Rheumatol 18, 41 (2020). https://doi.org/10.1186/s12969-020-00434-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12969-020-00434-9

Keywords

Pediatric Rheumatology

ISSN: 1546-0096