Criteria

ROUND 1 SUBMISSION EVALUATION CRITERIA

Round 1 Submissions of proposals for ResearchKit studies will first be evaluated by a Review Panel, then a subset will be scored by judges based on the quality of each submission according to the criteria below:

  1. Innovation. Novelty of the hypotheses and correlations proposed in the entrant’s submission. Degree to which the submission considers the unique opportunities of mobile device-based research.
  2. Scientific Plausibility. Extent to which interpretations and correlations of signals to mood are grounded in reasonable scientific theory.
  3. Feasibility. Likelihood that the proposal can be translated into a ResearchKit study design within the Challenge timeline, particularly around the development of testable ResearchKit tasks as described in the submission.
  4. Impact. Extent to which the submission could contribute to ResearchKit’s open source community and to our current understanding of mood and the ways in which it is measured.
  5. Entrant Potential. Ability of entrant to translate the proposal into a ResearchKit study design and develop it over the course of the Challenge.

ROUND 2  SUBMISSION EVALUATION CRITERIA

Round 2 Submissions will be scored by the judges based on the quality of each entry according to the criteria below:

  1. Innovation. Novelty of the tools and data streams used in the submission to better our understanding of mood.
  2. User Experience. Degree to which the submission understands the target audience. Extent to which the submission incorporates principles of human-centered design and shares meaningful and actionable information back to participants and authorized third parties. Strong consideration should be given to management, transmission, and privacy of participant data.
  3. Feasibility.
    • Round 2 Judging: Likelihood that the design can be developed into a prototype that can be piloted, tested, and preliminarily validated with Apple’s TestFlight.
    • Round 3 Judging: Likelihood that the prototype can be developed into a deployable ResearchKit study after the Challenge.
  4. Impact. Extent to which the submission could contribute to ResearchKit’s open source community and to our current understanding of mood and the ways in which it is measured.
  5. Entrant Potential. Ability of submitting team or individual to fully develop and validate the study and sustain it beyond the Challenge timeline.

ROUND 3 SUBMISSION EVALUATION CRITERIA

Round 3 Submissions will be evaluated based on the criteria above and the two additional criteria below:

  1. Demonstration of the finalist’s ability to effectively iterate and improve their submission over the course of the Virtual Accelerator and Finalist Incubation and Testing.
  2. Perceived ability of the finalist and their submission to:
    • Potentially impact the scientific understanding of mood, its correlates, and how actionable information can be provided to users.
    • Contribute to the ResearchKit’s open source community to benefit future studies.