AJTCVM

(Adapted for the AJTCVM from the CONSORT and REFLECT Checklists)^1,2

PURPOSE OF THE REPORTING GUIDELINES

• To improve the quality of experimental designs, execution and reporting of clinical trials and other studies described in articles published by the American Journal of Traditional Chinese Veterinary Medicine (AJTCVM)
• To provide a standard format and checklist for authors to follow, when composing reports of clinical trial findings
• To achieve complete and transparent reporting so all study findings can be critically appraised and accurately interpreted
• To support the use of evidence-based Traditional Chinese Veterinary Medical (TCVM) principles and treatments

USE OF REPORTING THE GUIDELINES

• The reporting guidelines will be used as a checklist for editors and reviewers evaluating manuscripts submitted to AJTCVM.
• Authors will be asked to comment on the items in the checklist not present in a manuscript, during the editing and reviewing processes.
• The long-term goal of the AJTCVM is to primarily publish reports of randomized controlled clinical trials that conform to these guidelines to ensure the highest quality of TCVM evidence-based medicine.

CHECKLIST FOR REPORTING GUIDELINES

TITLE AND ABSTRACT

1. Title and Abstract

• If there was randomized assignment of subjects in the study, state “randomized” in the title and abstract.
• If the study was controlled, state “controlled” in the title and abstract.
• If the study was blinded, state “blinded” in the title and abstract.
• Clearly state whether the problem occurred naturally or was induced by an agent e.g. “A Randomized, Controlled, Blinded Clinical Trial of the Effects of Electroacupuncture for the Treatment of Naturally Occurring Back Pain in Sport Horses”.
• No new information should be presented in the abstract, only information found in the paper.
• The abstract should contain a brief summary of the problem, experimental design, pertinent findings, statistical analysis, adverse effects and conclusions.

INTRODUCTION

2. Background Information and Objectives

• Begin with a brief description and importance of the problem to be studied.
• Provide the scientific background of the problem with references to previous pertinent studies and an explanation of study rationale.
• Include an explanation of the benefits and possible adverse reactions of the interventions proposed.
• The introduction should end with a clear statement of the objectives of the study and the research hypothesis.
• Objectives are what the research trial was designed to determine e.g. “In the current study, sport horses with thoracolumbar pain were treated with electro-acupuncture and rest for three weeks to determine: 1. If pain was reduced significantly compared to a common non-steroidal anti-inflammatory drug and rest alone, 2. If recovery time for potential return to function was shortened, 3. If adverse reactions occurred from the electro-acupuncture treatment compared with the other treatments”.
• Hypotheses can be stated as specific questions being tested to meet the objectives e.g. “Will three electro-acupuncture treatments and rest reduce thoracolumbar pain in sport horses more than a non-steroidal anti-inflammatory drug and rest or rest alone?”
• A null hypothesis can be provided instead e.g. “Electroacupuncture and rest will not reduce thoracolumbar pain in sport horses as well as a non-steroidal anti-inflammatory drug and rest or rest alone”; the investigator usually would like to disprove the null hypothesis.

METHODS

3. Trial design

• Indicate the type of trial e.g. double blind, placebo controlled prospective study.

4. Participants- Study setting

• Provide species, age, sex and breed of animals.
• Provide use of animals and color (if important) e.g. sport horses, agility dogs.
• Clearly explain inclusion and exclusion criteria for case selection.
• Explain where the study took place, how the animals were housed, type of caregivers and if housed in a facility indicate the standard of care (according to the standards of a specific group) e.g. “The trial was performed at the University of Florida College of Veterinary Medicine (UFCVM) small animal clinic, on client owned dogs, housed with the respective client. The study was approved by the UFCVM Clinical Care and Use committee and consent to study forms were signed by the client for each dog included in the study.

5. Interventions

• Describe each intervention thoroughly including control interventions.
• A clinician reading a trial report should know exactly how to perform the intervention, if they choose to use it on a patient.
• A researcher reading the report should know exactly how to repeat the study using the same methods as reported.


• Acupuncture:
  

  • List all acupoints used and their indications and actions and depth of needle insertion (usually in a Table form).

  • Provide needle gauge, length and type (indicate manufacturer as a foot note).
  • Indicate the technique used e.g. dry needles non-manipulated, dry needles manipulated, electro-acupuncture, aqua-acupuncture, moxibustion, laser and others.
  • If dry needles were manipulated, provide a detailed description of the manipulation technique so others can accurately repeat.
  • If electro-acupuncture was used, provide equipment information (indicate manufacturer as a foot note) and the frequencies used including duration of treatment at each frequency.
  • If aqua-acupuncture was used, provide details of the hypodermic needle size, depth inserted, primary substance (indicate manufacturer as a foot note), substance concentration, dilution substance (indicate manufacturer as a foot note) and amount injected at each site; if different amounts were used for different acupoints, then list in Table form.
  • If moxibustion was used, provide a complete description of the herb (indicate manufacturer as a foot note), technique and duration at each acupoint; if different durations for different acupoints, then list in Table form.
  • If a laser was used provide equipment information (indicate manufacturer as a foot note), the frequencies used, the duration of each frequency and total duration of each treatment; if different durations were used for different acupoints, then list in Table form.
  • If some other treatment of acupuncture points was used provide a detailed description of the technique.
  • Clearly indicate duration of each treatment, frequency of treatment, total numbers of treatments and total time period over which treatments were given; may list in a Table for clarity.

• Herbal medicine:

  • Provide details of all herbal formulas and individual herbs used in the study.

  • Indicate Pin-yin and English names.
  • Provide manufacturer as a superscript letter and a foot note.
  • State the dose in gm/kg body weight.
  • Indicate if given before, after or with meals.
  • Indicate form of herb: teapill, granule, capsule, etc.
  • Indicate the frequency of dosing per day.
  • Indicate total duration of treatment.
  • Indicate the ingredients in each formula in a Table form and include Pinyin and common names, percent in the formula and actions of each ingredient.

6. Outcomes

• Identify and completely define all primary (pre-specified) outcomes or end points by which groups will be compared.
• A description of secondary (originally unanticipated, unintended effects) outcomes is optional except when adverse (see 19. below).
• When available use previously developed and validated scales or consensus guidelines e.g. a previously published and accepted pain scale.
• Author generated unpublished scales can contain bias and should be avoided if possible.
• In some trials circumstances may require a change in the way an outcome is assessed or a switch to a different outcome; all changes must be described and a detailed explanation of the rationale for all changes provided.

7. Sample size, interim analyses and rules for early discontinuation

• A study should be large enough to have a high probability (power) of detecting, as statistically significant, a clinically important difference of a given size, if such a difference exists.
• Indicate how the sample size was determined (calculation of the statistical power of a study).
• A clear explanation should be provided, if the actual sample size differed from the originally intended sample size.
• Describe the rationale for other data collection points besides the end point.
• Outline the rules for early discontinuation of the study e.g. un-anticipated untoward effects.
• Clearly explain the rationale for early discontinuation of a study, in the event this occurs.

8. Randomization

Randomization has three major advantages:

1. Eliminates selection bias by balancing both known and unknown prognostic factors, in the assignment of treatments. Without randomization, treatment comparisons may be prejudiced, whether consciously or not, by selection of participants of a particular kind to receive a particular treatment.
2. Permits the use of probability theory to express the likelihood that any difference in outcome between intervention groups merely reflects chance.
3. May facilitate blinding the identity of treatments to the investigators, participants, and evaluators, possibly by use of a placebo, which reduces bias after assignment of treatments.

• Successful randomization in practice depends upon adequate generation of an unpredictable allocation sequence and concealment of that sequence until assignment occurs.
• Randomized assignment of subjects into groups has three steps: sequence generation (see 8. below), allocation concealment (see 9. below) and implementation (see 10. below).

9. Randomization- sequence generation and type

• Describe the technique used for random assignment to test and control groups e.g. random number table, computerized generated randomized name or number list.

10. Randomization- mechanism of allocation concealment

• Provide a statement of how the allocation method was concealed from the investigator, project coordinator and client.
• Concealment of the allocated intervention at the time of enrollment reduces bias.
• Blindedness (see 11. below) is different as it is concealing group assignment - not method of assignment.

11. Randomization-implementation

• Provide a statement of who generated the allocation sequence, enrolled participants and assigned participants to interventions.
• It is best to have an uninvolved party generate the group assignment, which remains unknown to the investigators or project coordinators until time of admission into the group.
• Examples: animal numbered and randomly assigned by a technician not involved in the study using a computer generated program; assignment concealed in a sealed envelope with the animal number on the front and opened only by the investigator when the intervention is to be performed.

12. Blinding (masking)

• Blinding is an important safeguard against bias, particularly when assessing subjective outcomes.
• Blinding is the withholding of information about the assigned interventions from people involved in the trial such as investigators and clients who may potentially be influenced by this knowledge.
• Provide a statement of whether or not those administering the interventions, investigators and caretakers evaluating the outcomes were knowledgeable about which intervention an animal received.
• Obviously those administering acupuncture and sham acupuncture treatments cannot be blinded, so the outcome of the intervention needs to be accessed by a blinded investigator and caretaker- “single blinded”.
• Report how the success of blinding was evaluated e.g. ask the clients or evaluators whether they think a patient received the experimental or placebo or sham treatment and compare with actual treatment.
• Report any known compromises in blinding.
• State the similarity of characteristics of the interventions e.g. appearance, taste, smell and method of administration; easier to make herbal medicine, placebo and conventional medication have a similar appearance than acupuncture and sham treatment.
• Herbal medicine must be compared with an inert substance of similar appearance in the same capsule at the same dosing frequency or with a conventional standard of care medication (compounded in a form to appear similar to the herbal medicine); then can be “double blinded” from investigators, evaluators and clients.
• In studies utilizing client feedback, investigators may have to separate the client from the animal during acupuncture or sham treatments, so they will not know which was performed.
• If a study was not blinded, provide a justification for not blinding.

13. Statistical methods and additional analyses

• Specify which statistical procedure was used for each analysis; further clarification may be necessary in the results section of the report.
• Study findings are often assessed in terms of their statistical significance, using a p-value.
• The p-value represents the probability that the observed data (or a more extreme result) could have arisen by chance when the interventions did not truly differ.
• A p<0.01 is considered even stronger evidence of significance than a p<0.05.
• The mean plus or minus standard deviation with specific p-values should be supplied on all data where indicated and are best clearly displayed in Table form.
• Data analyses should be based on counting each participant once for any given outcome.
• Authors should provide a confidence interval for the estimated effect, which may be interpreted as the range of values for the treatment effect that is compatible with the observed data.
• A 95% confidence interval is customary, which gives the range expected to include the true value in 95 of 100 similar studies.
• Subgroup analyses are discouraged.
• If additional analyses were performed between subgroups, authors should clarify the choice of variables that were adjusted for, how continuous variables were handled and whether the analysis was planned or suggested by the data.

RESULTS

14. Participants- flow, losses and exclusions

• Indicate the number of animals that were assessed for eligibility and not included in the study, did not receive the intervention as allocated, did not complete treatment or were not included in the final analysis.
• This information permits the reader to assess to what extent the estimated efficacy of therapy might be under estimated in comparison with ideal circumstances.
• State the reasons for lack of inclusion in the study, complete treatment, follow-up or inclusion in the analysis.

15. Recruitment and reason for discontinuation of a study

• Provide dates defining recruitment and follow-up periods.
• If follow-up times were determined by a specific outcome, then indicate the minimum, maximum and median duration of follow-up periods.
• If the study was discontinued before originally planned, the reasons should be fully disclosed, including intrinsic and extrinsic factors and who made the decision to stop the trial.
• Indicate the role the funding agency played in the deliberations and decision to stop the study.

16. Baseline data

• Include baseline data such as clinicopathologic test results of study animals before the test or control interventions (see 4. above).
• Baseline data can include other differences in study animals not previously described (above in section 4.).
• Baseline data is often put in Table form in a column before the data collected during and after test or control interventions.
• Comparisons at baseline should be based on consideration of the prognostic strength of the variables measured and the size of any chance imbalances that have occurred.

17. Numbers analyzed

• The number of participants per group should be given for all analyses.
• Give exact numbers of animals with a specific outcome out of the total number of animals evaluated with the percent in parentheses e.g. 87/100 (87%).

18. Outcomes and estimations

• Trial results are often more clearly displayed in a table rather than in the text.
• Study results should be reported as a summary of the outcome in each group.
• The number of animals with or without the outcome out of the total or the mean and standard deviation of measurements, together with the difference between the groups is known as the effect size.
• The estimated effect size and its precision (such as 95% confidence interval) should be stated.
• Results should be reported for all planned primary and secondary end points, not just for analyses that were statistically significant or “interesting”.
• Selective reporting within a study is a widespread and serious problem.
• Interpretation should focus on the final results at the close of the trial, not the interim results.

19. Ancillary analyses

• Multiple analyses of the same data create a risk for false positive findings and should be avoided.
• Report all analyses performed and clarify which were originally planned (see 12. above) and which were not planned.
• Analyses that were pre-specified in the trial protocol are much more reliable than those suggested by the data.
• Adjustment for variables because they differ significantly at baseline is likely to bias the estimated treatment effect.
• If an adjustment was made for baseline variables, both unadjusted and adjusted analyses should be reported.

20. Adverse events

• Report all adverse events or side effects observed in all groups.
• Randomized trials offer the best approach for providing safety data as well as efficacy data.

DISCUSSION

21. Limitations

• The discussion should include:

  • a brief synopsis of the key findings

  • consideration of possible mechanisms and explanations
  • comparison with relevant findings from other published studies (whenever possible including a systematic review combining the results of the current study with the results of all previous relevant studies)
  • limitations of the present study (and methods used to minimize and compensate for those limitations)
  • a brief section that summarizes the clinical and research implications
  • a concluding paragraph to summarize findings and recommendations based on the results


• Trial limitations should be discussed and include sources of potential bias, imprecision and multiplicity of analysis, if relevant.
• Internal validity is the extent to which the design and conduct of the study eliminate the possibility of bias.

22. Generalization of study results

• External validity is the extent to which the results of a study can be generalized to other patients and circumstances.
• If internal validity of the study is poor there can be no external validity.
• Applicability of the study findings to similar and other problems should be clearly stated.
• Although some variation in treatment response between an individual patient and the patients in a trial or systematic review is to be expected, the differences tend to be in magnitude rather than direction.

23. Interpretation- overall evidence

• Interpretation of findings should be consistent with results, balancing benefit and risks and considering other relevant evidence.
• Interpret the results in the context of current evidence.
• Bayesian methods can be used to statistically combine the trial data with previous evidence.

OTHER INFORMATION

24. Registration

• If a trial is registered, provide the number.

25. Protocol

• If the complete study protocol is available, provide the web location for interested readers.

26. Funding source

• State the source of funding e.g. “This study was supported by a grant from the American Association of Traditional Chinese Veterinary Medicine Research Foundation”.

 

REFERENCES

1. Schulz KF, Altman DG, Moher D, for the CONSORT Group. CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials. Ann Int Med 2010 ;152. Epub 24 March. CONSORT statement; http://www.consort-statement.org/consort-statement/2---introduction0/

2. O’Connor AM, Sargeant JM, Gardner JS et al. The REFLECT statement: Methods and processes of creating reporting guidelines for randomized controlled trials for livestock and food safety. J Vet Intern Med 2010; 24:57-64.