Home / Source Analysis / Detail Report
Source Analysis Report

Relevant Topic, Wrong Population

By Dr. Sarah Jenkins 2026-08-01 Status: Evaluated
Relevant Topic, Wrong Population

Case Context & Scope

During systematic reviews, researchers frequently encounter papers that target the exact clinical or technical topic under investigation but feature a completely different study cohort. This mismatch complicates the literature synthesis, as variables, response patterns, and confounding factors vary wildly between demographic segments. Identifying these population shifts early prevents invalid extrapolations.

Key Focus

Evaluating source reliability requires deep comparison of target cohorts against studied samples to check for population shifts and methodology deviations.

Analysis of Evidence

Our analysis focused on the participant inclusion criteria of the selected literature source. The study investigated the efficacy of digital interface adaptations but tested them exclusively on undergraduate students aged 18 to 22. When evaluated against our target review population of elderly users with mild cognitive impairments, the research showed substantial variance in baseline cognitive loads and motor coordination.

  • Statistical relevance verified across peer benchmarks.
  • Identified potential risk factors in cohort selection criteria.
  • Verified control factors and double-blind configurations.

Structured Literature Decision

The final inclusion score reflects that while the study contains valuable theoretical context, it cannot be safely integrated into the quantitative meta-analysis due to demographic bias. We categorized this source as a qualitative reference only, ensuring the statistical integrity of the primary decision file is maintained.

8.4 / 10
Inclusion Index Score
Low Risk
Methodology Warning Status

Detailed Source Review

A major challenge in conducting evidence-based literature reviews is the temptation to include every study that touches upon the research question. The paper analyzed here provides high-quality data and robust methodology. However, the chosen research subjects differ fundamentally from our target group. For instance, testing a mobile health application on tech-savvy young adults does not provide valid data for a project focused on rural elderly patients. The physiological, social, and technological gaps between these two groups are too wide to span with simple statistical adjustments.

Extrapolating findings from a highly specific cohort to an entirely different demographic segment is one of the most common sources of bias in literature reviews, often leading to flawed decision-making outcomes.

To prevent this bias, researchers must establish strict demographic and clinical criteria during the initial stages of a literature search. If a study falls outside these boundaries, it must be filtered out or flagged for qualitative discussion only. Keeping these files separated protects the mathematical model from outlier distortion. When exporting these results to reference managers like EndNote, marking these differences in custom fields guarantees that later steps in the synthesis do not accidentally re-integrate the mismatching data.

Potential Discrepancies & Limitations

Although the study reports high statistical significance and robust internal validity, the external validity in relation to our target group is close to zero. We must also note differences in environment, as the source study was conducted in a controlled lab setting, whereas our project evaluates real-world clinical application. This environmental deviation further compounds the population mismatch, making the numerical outcomes inapplicable for our current analytical needs.

Evaluate Inclusion Parameters

Adjust the criteria sliders and switches below to test potential literature-review outcomes dynamically.

Sample Size Confidence 500
Statistical Power (β) 80%
Double-Blind Methodology
Conflicts of Interest Disclosed
Verdict: INCLUDE WITH QUALIFICATIONS
7.8 / 10 Decision Score

Community Discussion

No comments yet

This could be your first comment.

Add Your Analysis

Source Parameters

  • Category Source Analysis
  • Field of Study Methodology Review
  • Export Format XML / EndNote
  • Complexity Advanced

Request Case Review

Submit details of conflicting literature sources for structured inclusion modeling.