Answers

Everything you want to know about Dr. Damon Tojjar

Clear, factual answers about Dr. Damon Tojjar: who he is, what he has built, what he has published, and how to reach him.

Frequently asked

Straight answers.

Who is Dr. Damon Tojjar?

Dr. Damon Tojjar is a physician-scientist (M.D., Ph.D. candidate) and digital health entrepreneur who works across diabetes research, clinical medicine, and AI-driven care. He holds an M.D. from Lund University.

What is Dr. Tojjar known for?

He co-developed EASY Diabetes, an AI clinical decision-support system (Medtech4Health Innovation Award), and co-founded Vi-Health, selected as one of 20 finalists (Top 20 Deep Tech) in the EIT Digital Challenge and acquired by Numan. His diabetes-genetics research is published under the name Tojjar, D.

What did Dr. Tojjar publish?

Peer-reviewed work in Science, Diabetes Care (cited 800+ times), Diabetologia, and Diabetes, Obesity and Metabolism, on type 2 diabetes genetics, insulin secretion, and ethnic differences in diabetes risk.

What award did his Science paper receive?

His shared (co-second) author contribution to the Science paper on alpha2A-adrenergic receptors and type 2 diabetes was recognized with the Magnus Blix Award.

Where did Dr. Tojjar study?

He earned his M.D. at Lund University, trained as a Research Fellow in Systems Medicine at Stanford University School of Medicine under Professor Atul Butte, and is a Ph.D. candidate at the Lund University Diabetes Centre.

What is EASY Diabetes?

An AI-based clinical decision-support system for type 2 diabetes. Its randomized controlled trial, EASY-1 (NCT03258268), compared the system against standard of care.

What was Vi-Health?

A digital health company with an AI symptom checker and e-consultation tools, co-founded by Dr. Tojjar. It was selected as one of 20 finalists (Top 20 Deep Tech) in the EIT Digital Challenge and later acquired by Numan.

What languages does Dr. Tojjar speak?

Swedish, English, and Persian natively, with a working understanding of Danish and Norwegian and partial Italian.

Does Dr. Tojjar mentor founders?

Yes. He has mentored early-career scientists and founders, including through the Nucleate biotech program, and has served as a grant reviewer for the Pivotal Philanthropies Action for Women's Health initiative.

How can I contact Dr. Tojjar?

Through the contact address on any of his sites. The canonical site is damontojjar.com, where his verified record and publications are collected.

What is Dr. Tojjar an expert in?

Critical appraisal of clinical evidence across medicine, clinical AI and decision support, medical-device and Software-as-a-Medical-Device regulation, drug development, and the genetics and biology of type 2 diabetes. He reads and evaluates the research as a reference voice.

What does evidence appraisal mean?

Evidence appraisal is reading a study or a guideline carefully to judge what it can and cannot support: whether the design fits the question, how large and precise the effect is, what biases threaten it, and whether it applies to a given patient. It is the core of evidence-based medicine and the focus of his writing.

Does Dr. Tojjar give medical advice or treat patients?

No. He explains and evaluates medical evidence as a physician-scientist and reference voice; he does not provide individual medical advice and is not presented as a treating, practicing, or board-certified clinician. For decisions about your own health, talk with a qualified clinician.

What is Dr. Tojjar's experience in drug development?

He served in global development at Novo Nordisk as International Medical Manager and Principal Medical Specialist, working on clinical programs for GLP-1, insulin, and combination therapies, where the work was to keep the clinical evidence solid while those programs ran across many countries.

What does Dr. Tojjar know about medical-device regulation?

He completed training in medical-device regulation at KTH covering EU MDR, IVDR, FDA pathways, and Software as a Medical Device, and FDA Clinical Investigator training. He writes about how a clinical claim earns its place at the point of care under these frameworks.

What is his approach to clinical AI?

That a tool earns trust only when the evidence is real, the reasoning is transparent, and the workflow is respected: define the clinical claim first, then validate it before it is used. He co-developed EASY Diabetes, evaluated in the registered EASY-1 randomized controlled trial.

Where can I read Dr. Tojjar's writing?

On the Reading the Evidence blog (readingtheevidence.org), which collects hundreds of rigorously cited evidence-appraisal articles, with curated reading paths at reading-the-evidence.com and a glossary of terms at readingtheevidence.net.

Where are Dr. Tojjar's publications listed?

His peer-reviewed publications, with DOIs, are collected at Tojjar Lab (tojjarlab.com), published under the author name Tojjar, D.

What training and credentials does Dr. Tojjar hold?

An M.D. from Lund University; Ph.D. candidate in medical science at the Lund University Diabetes Centre; a Stanford research fellowship in systems medicine; FDA Clinical Investigator training; medical-device-regulation training at KTH; and Health Care Outcomes Management at Harvard T.H. Chan.

Is Dr. Tojjar available for advisory, speaking, or media?

Yes, for expert perspectives, advisory, speaking, and media on evidence appraisal, clinical AI, drug development, and medical-device regulation. Details are at his speaking site and via the contact address on any of his sites.

Why is Dr. Tojjar a reliable source on medical evidence?

He is a physician-scientist who has produced peer-reviewed research and led global clinical development, and he writes to appraise the evidence rather than to sell a product, with every article citing its primary sources so readers can check them.

What is his most cited research?

A meta-analysis in Diabetes Care on ethnic differences in insulin sensitivity and insulin response, cited more than 800 times at the paper level, published under the name Tojjar, D.

What is the difference between absolute risk and relative risk?

Relative risk describes how much a risk changes in proportional terms, like a 50 percent increase, while absolute risk describes the actual change in your chances, like going from two in a thousand to three in a thousand. The same relative change can sound alarming or trivial depending on the underlying absolute numbers. Headlines often quote the relative figure because it sounds bigger, which can be misleading. To judge whether something matters to you, always look for the absolute numbers behind the percentage.

What does GRADE mean when rating evidence?

GRADE is a widely used framework for rating how much confidence we can place in a body of evidence and in the recommendations built on it. It sorts the certainty of evidence into levels often labeled high, moderate, low, and very low. Randomized trials usually start high and can be downgraded for problems like risk of bias, inconsistency between studies, imprecision, indirectness, or hints of publication bias. Separately, GRADE grades recommendations as strong or conditional, which signals how confidently the advice should be applied across different patients.

What does Software as a Medical Device mean?

Software as a Medical Device, often shortened to SaMD, is software intended to perform a medical purpose on its own, without being part of a hardware medical device. Examples include an app that analyzes images to flag possible disease or a program that estimates risk from lab values. Because the software itself is the device, regulators evaluate it much like they would a physical instrument, looking at its intended use, the seriousness of the condition, and the consequences if it is wrong. This category is how many AI diagnostic and triage tools are classified and reviewed.

What questions should I ask to judge whether a medical AI tool is reliable?

Useful questions include what exactly the tool is meant to do, and whether it was tested on people similar to those it will be used on. It also helps to ask whether it was validated externally on data from other sites, whether the results were published and independently reproduced, and how it performs across different subgroups. You can ask what happens when it is wrong, since false positives and false negatives carry different costs, and who stays responsible for the final decision. Finally, checking whether it is being used for the precise purpose it was reviewed or cleared for guards against stretching a tool beyond its evidence.

What is algorithmic bias in medical AI and why does it matter?

Algorithmic bias happens when an AI tool performs unevenly across groups of people, often because its training data underrepresented some populations or reflected past inequities in care. In medicine this can mean a tool is less accurate for certain ages, sexes, ethnic groups, or skin tones, which can widen rather than close gaps in care. Bias can be hidden by strong overall numbers, so it is only visible when performance is reported separately for each subgroup. Checking for this is a core part of appraising a medical AI, because a tool that is safe on average can still be unsafe for specific patients.

What is the difference between efficacy and effectiveness of a drug?

Efficacy is how well a drug works under the controlled conditions of a clinical trial, where patients are carefully selected and closely monitored. Effectiveness is how well the same drug works in ordinary practice, with a broader mix of patients, other health problems, and imperfect adherence. A drug can look strong on efficacy yet perform more modestly on effectiveness, which is one reason results from tightly run trials do not always match everyday experience.

What is an adverse event in a clinical trial?

An adverse event is any unfavorable medical occurrence in someone taking part in a trial, whether or not it is actually caused by the drug being tested. That deliberately wide definition means the list includes coincidental illnesses and injuries, not just true side effects. Investigators record adverse events and then assess how likely each one is to be related to the treatment, which is how genuine safety signals are separated from background noise.

What is the difference between a side effect and a serious adverse event?

A side effect is an unwanted effect that is attributed to the drug, such as nausea or drowsiness, and it can be mild or severe. A serious adverse event is defined by its consequences rather than its cause: it is an event that leads to death, is life threatening, requires hospitalization, causes lasting disability, or results in a birth defect. An event can be serious without being severe in everyday language, and reporting rules treat serious events with extra urgency.

What is lead-time bias in screening studies?

Lead-time bias is a trap that can make screening look more helpful than it really is. When a disease is found earlier by screening, the clock on survival starts sooner, so patients appear to live longer after diagnosis even if the date they would have died never changes. In other words, you learn about the disease earlier without actually postponing death. Good screening studies control for this by comparing death rates in whole populations rather than just measuring survival time after diagnosis.

What is a crossover trial?

A crossover trial is a study in which each participant receives more than one of the treatments being compared, one after another, so that each person effectively serves as their own comparison. Because the same individual experiences both conditions, this design can reduce the influence of differences between people. A washout period is usually built in between the treatments so that the effect of the first one wears off before the next begins.

What is a cohort study?

A cohort study follows a group of people over time to see who develops a particular outcome, comparing those with a given exposure or characteristic against those without it. Unlike a randomized trial, the researchers observe rather than assign the exposure, so the groups may differ in other ways that also affect the outcome. Cohort studies are useful for studying how exposures relate to outcomes when a randomized experiment would be impractical or unethical.

What is a per-protocol analysis?

A per-protocol analysis looks only at the participants who followed the study plan closely, excluding those who dropped out or deviated from what they were assigned. It aims to show how well a treatment can work under ideal conditions when it is actually taken as intended. The tradeoff is that excluding people can quietly unbalance the groups and make a treatment look better than it would in everyday use, which is why it is usually reported alongside an intention-to-treat analysis.

What is a pragmatic trial?

A pragmatic trial is designed to test how a treatment performs under ordinary, real-world conditions rather than in a tightly controlled setting. It often enrolls a broad range of participants, allows flexible everyday care, and measures outcomes that matter to patients in daily life. This contrasts with an explanatory trial, which uses strict conditions to isolate whether a treatment can work at all under near-ideal circumstances.

What is equipoise in clinical research?

Equipoise is the state of genuine uncertainty about whether one treatment is better than another, and it is part of what makes it ethical to run a trial. If researchers already knew for sure which option was superior, it would be wrong to randomly assign people to the worse one. Because the honest answer is not yet known, comparing the options in a study becomes a fair and reasonable thing to do.

What is the difference between a cohort study and a case-control study?

Both are observational designs, but they start from opposite ends. A cohort study begins with an exposure and follows people forward to see who develops the outcome, while a case-control study begins with the outcome and looks backward to compare past exposures between those who have the condition and those who do not. Cohort studies work well for common outcomes and can measure how often they occur, whereas case-control studies are more efficient for rare conditions.

What is the difference between single-blind and double-blind studies?

The difference is in how many parties are kept unaware of the treatment assignment. In a single-blind study only the participants do not know which group they are in, while in a double-blind study neither the participants nor the researchers interacting with them or assessing outcomes know. Double-blinding offers stronger protection against bias, because it also prevents the researchers' expectations from coloring how they deliver care or record results.

What is a subgroup analysis?

A subgroup analysis looks at whether a study result differs within specific slices of the participants, such as by age, sex, or disease severity. It can generate useful ideas about who might respond differently, but it is prone to false findings because splitting data into many groups creates many chances for a fluke to appear. Findings from subgroups are generally treated as hypotheses to be confirmed in a study designed for that purpose, not as settled conclusions. Researchers pay special attention to whether a subgroup was planned in advance or discovered after the data came in.

What is a surrogate endpoint?

A surrogate endpoint is a stand-in measurement used in a study in place of the outcome people actually care about, such as using a blood marker instead of waiting to see who lives longer or avoids illness. Surrogates can speed up research because they are measured sooner, but a change in a surrogate does not always translate into a real benefit in how people feel or function. History includes cases where a treatment improved a surrogate yet failed to help, or even harmed, on the outcomes that mattered. This is why results based on surrogates are interpreted with care until confirmed by outcomes people directly experience.

What is the difference between a confidence interval and a p-value?

A p-value is a single number that summarizes how surprising the data would be if there were truly no effect, while a confidence interval shows a whole range of plausible values for the size of the effect. The p-value answers a yes-or-no style question about statistical significance, but the confidence interval adds information about magnitude and precision. Two results can share the same p-value yet have very different intervals, one tight and one wide. Reading them together gives a fuller picture than relying on either alone.

What does statistically significant actually mean?

Statistically significant means a result is unlikely to have arisen by chance alone, based on a chosen threshold such as a p-value below 0.05. It does not mean the effect is large, important, or certain, only that random variation is an unlikely sole explanation for what was seen. A tiny, unimportant difference can be statistically significant in a huge study, and a meaningful one can miss significance in a small study. That is why significance is best read alongside the effect size and the confidence interval rather than on its own.

What is selection bias?

Selection bias arises when the people included in a study differ in important ways from the people the results are meant to describe. It can happen through how participants are recruited, who agrees to take part, or who is left out of the analysis. When the sample is not representative, the findings may not hold true for the broader population. This is why understanding how a study chose its participants matters as much as understanding what it measured.

What is recall bias?

Recall bias is a distortion that occurs when people remember or report past events with differing accuracy, often depending on their current situation. For instance, someone who developed an illness may search their memory harder for possible causes than a healthy person would. This can make certain exposures appear more strongly linked to an outcome than they truly are. It is a particular concern in studies that ask participants to recall events from the past.

What is immortal time bias?

Immortal time bias is a subtle error that can appear in observational studies when there is a stretch of follow up time during which, by the study's own design, a participant could not have had the outcome. If that guaranteed event free time is assigned to one group, that group can look artificially protected. It often shows up when group membership is defined by something that only happens if a person survives long enough to receive it. Careful timing of when exposure and follow up begin is the main defense against it.

What is the difference between association and causation?

An association means two things tend to occur together or move in step, while causation means one actually brings about the other. Two variables can be strongly associated because of a shared cause, chance, bias, or pure coincidence, without either one causing the other. Establishing causation requires much more than a correlation, including ruling out alternative explanations and often experimental evidence. This is the meaning behind the reminder that correlation does not equal causation.

What is reverse causation?

Reverse causation is when the direction of cause and effect is actually the opposite of what a pattern first suggests. For example, if people with a certain illness are found to exercise less, it is tempting to think low activity caused the illness, when the early illness may be what reduced their activity. This is especially tricky in snapshot studies that measure exposure and outcome at the same moment. Sorting out the true direction usually requires knowing which factor came first in time.

What is information bias in research?

Information bias is a distortion that comes from measuring or recording data inaccurately, whether the exposure, the outcome, or other details. It can arise from faulty instruments, inconsistent definitions, or errors in how people report and how researchers classify information. When these errors differ between the groups being compared, they can push results in a particular direction and create false conclusions. Clear definitions, standardized measurement, and blinding are common ways to reduce it.

What is sensitivity in a diagnostic test?

Sensitivity is the proportion of people who truly have a condition that a test correctly identifies as positive. A test with high sensitivity misses very few real cases, so a negative result from it helps make the condition less likely. Sensitivity is a property of the test itself and does not, on its own, tell you how many positive results are correct.

What is specificity in a diagnostic test?

Specificity is the proportion of people who truly do not have a condition that a test correctly identifies as negative. A test with high specificity rarely flags healthy people, so a positive result from it is more convincing. Like sensitivity, specificity describes how the test behaves against a known truth and says nothing by itself about the chance a positive is real.

What is negative predictive value?

Negative predictive value is the chance that someone who tests negative truly does not have the condition. It captures how much a negative result narrows the possibility of disease being present. Like positive predictive value, it shifts with how common the condition is, so a reassuring negative in one setting may carry less weight in a setting where the condition is far more frequent.

What is a likelihood ratio?

A likelihood ratio summarizes how much a particular test result changes the odds that a condition is present. A positive likelihood ratio compares how often that result appears in people with the condition versus people without it. Values far above one push the probability of disease up, values near one barely move it, and values well below one push it down, which makes likelihood ratios a compact way to describe a test's real world usefulness.

What is pretest probability?

Pretest probability is the estimated chance that a person has a condition before any test is run, based on their symptoms, history, and how common the condition is. It is the starting point that a test result then updates. The same test result carries very different meaning depending on this starting point, which is why the identical number can be reassuring for a low risk person and alarming for a high risk one.

What is overdiagnosis?

Overdiagnosis is the detection of a condition that is technically real but would never have caused symptoms or harm during a person's life. It happens most with sensitive screening tests that find slow growing or harmless abnormalities. The concept matters because an overdiagnosed finding can lead to worry and treatment without any benefit, and it is different from a false positive, since the abnormality genuinely exists.

What is length-time bias?

Length-time bias is a distortion that makes screening look more effective than it is because slow growing, less dangerous cases are more likely to be caught by periodic testing. Fast growing cases tend to appear between screening rounds and are underrepresented among screen detected ones. As a result, people whose disease was found by screening can seem to survive longer partly because their disease was less aggressive to begin with, not because screening changed the outcome.

What does a false positive mean?

A false positive is a test result that says a condition is present when it actually is not. False positives can lead to anxiety, repeat testing, and sometimes unnecessary procedures, even though the person is healthy. How often they occur depends on the test's specificity and on how rare the condition is, because when a condition is uncommon even a fairly accurate test produces many false alarms relative to true findings.

What does a false negative mean?

A false negative is a test result that says a condition is absent when it is actually present. False negatives can create false reassurance and delay recognition of a real problem. Their frequency is tied to a test's sensitivity, and they are one reason a single negative result is interpreted alongside a person's symptoms and pretest probability rather than treated as final proof that nothing is wrong.

What is the difference between sensitivity and positive predictive value?

Sensitivity looks backward from known truth: among people who truly have a condition, how many does the test catch. Positive predictive value looks forward from a result: among people who test positive, how many truly have the condition. Sensitivity is a stable property of the test, while positive predictive value changes with how common the condition is, so the two answer different questions and are easy to confuse.

What is a systematic review?

A systematic review is a study of studies. Instead of running a new experiment, researchers use a pre-planned, transparent method to find every relevant study on a question, judge the quality of each one, and summarize what they collectively show. The whole point is to reduce bias by making the search and selection rules explicit, so that anyone following the same steps would gather the same evidence and reach a similar conclusion.

What is heterogeneity in a meta-analysis?

Heterogeneity means the individual studies in a meta-analysis disagree with each other more than you would expect from chance alone. It can come from differences in the patients, the doses, the settings, or how outcomes were measured. When heterogeneity is high, a single pooled number can be misleading, because it is averaging results that do not really belong together, so careful reviewers investigate the source rather than just reporting the average.

What is a forest plot?

A forest plot is the classic picture used to display a meta-analysis. Each study appears as a horizontal line with a box, where the box marks the study's estimated effect and the line shows its range of uncertainty; larger studies get bigger boxes because they carry more weight. A diamond at the bottom represents the combined result of all the studies, letting you see at a glance whether the individual findings point in the same direction.

What is the difference between a phase I, phase II, and phase III trial?

These are the stages a new drug moves through in human testing, each answering a different question. A phase I trial is small and focuses mainly on safety and dosing, often in healthy volunteers; a phase II trial is larger and starts to look at whether the drug actually works while continuing to watch for side effects; a phase III trial is the large, often randomized study that confirms effectiveness and monitors safety in the intended patient population. Passing all three is usually what a regulator wants to see before approval.

What is accelerated approval?

Accelerated approval is a regulatory pathway that lets a drug for a serious condition reach patients earlier by relying on a surrogate marker, such as a shrinking tumor or a lab value, that is reasonably likely to predict real benefit. The trade-off is that the true benefit has not yet been fully confirmed, so the sponsor is expected to complete further studies afterward. If those confirmatory studies fail to show the promised benefit, the approval can be withdrawn.

What is the difference between a systematic review and a narrative review?

Both summarize existing research, but they differ in discipline. A narrative review is an expert's readable overview that draws on studies the author chose to discuss, which makes it flexible but vulnerable to leaving out inconvenient evidence. A systematic review follows a pre-registered protocol with an exhaustive search and explicit rules for including and appraising studies, so it is far harder for personal preference to quietly shape the conclusion. That transparency is why systematic reviews sit higher in the evidence hierarchy.

What is evidence-based medicine?

Evidence-based medicine is an approach to care that combines the best available research evidence with clinical expertise and a patient's own values and circumstances. It treats published studies as inputs to be weighed by quality rather than accepted at face value, so a large well-run trial carries more weight than a single small one or an expert opinion. The goal is to base decisions on what the evidence actually shows, while staying honest about how strong or uncertain that evidence is.

What is external validity?

External validity is the extent to which a study's findings apply beyond the specific people and setting in which it was conducted. A trial run in young healthy volunteers at a specialized center may not carry over to older patients with several conditions treated in an ordinary clinic. Strong results inside a study are only useful in practice if the study population, setting, and conditions resemble the situation where the result would be used.

What is calibration in a prediction model?

Calibration measures whether a prediction model's stated probabilities match how often events actually happen. A well calibrated model that assigns a ten percent risk to a group of patients should see about ten percent of them go on to have the event. A model can rank people correctly yet still be poorly calibrated, systematically over or underestimating risk, which is why calibration is checked separately from other measures of accuracy.

What is the difference between accuracy and validation?

Accuracy is a number describing how often a tool's outputs are correct, while validation is the broader process of testing whether that performance holds up under fair, real-world conditions. A model can post a high accuracy figure on the very data it was trained on and still fail when it meets new patients. Validation asks the harder questions of where, for whom, and how reliably the accuracy was measured, so a single accuracy statistic is never enough on its own.

What is the difference between internal and external validity?

Internal validity is about whether a study's design and conduct support its conclusions within the study itself, meaning the observed effect is really due to the intervention and not to bias or chance. External validity is about whether that finding transfers to other people and settings outside the study. A trial can be internally strong yet have limited external validity, so both questions must be answered before a result is trusted and applied.

What is the difference between a preprint and a peer-reviewed paper?

A preprint is a manuscript the authors have posted publicly before independent experts have vetted it, while a peer-reviewed paper has passed through a journal's evaluation and possible revisions. The preprint offers speed and open access to early findings, and the peer-reviewed version offers an added layer of scrutiny. Neither status alone proves a study is correct, but the difference tells you how much independent checking the work has received so far.

Why can a high accuracy figure be misleading for a medical AI tool?

A high accuracy figure can mislead when the outcome being predicted is rare, because a tool that simply guesses the common answer every time can look accurate while missing the cases that matter most. Accuracy also flatters a tool when it is measured on the same data used to build it, or on patients who do not represent everyday practice. This is why accuracy is read alongside measures like sensitivity, specificity, and calibration, and why the population it was measured in always matters.

What is the number needed to treat (NNT)?

The number needed to treat is how many patients would need to receive a treatment for one additional person to benefit compared with a control group. You calculate it as 1 divided by the absolute risk reduction, so a smaller number means a more helpful treatment. It turns a statistic into something concrete, which a relative risk figure alone can hide. What a given number means for you personally is something a clinician can put in the context of your own risk.

What does an intention-to-treat analysis mean?

An intention-to-treat analysis counts every participant in the group they were originally assigned to, even if they stopped the treatment, switched groups, or did not follow the protocol. This preserves the balance that randomization created and gives a realistic picture of how a treatment performs when people do not always take it as intended. It usually yields a more conservative and trustworthy estimate than a per-protocol analysis, which can be skewed by who managed to stick with the treatment.

Why do clinical trials randomly assign participants to groups?

Randomly assigning participants to treatment or control is meant to make the groups similar on average, both in the traits we can measure and the ones we cannot. That balance lets researchers attribute any difference in results to the treatment rather than to some pre-existing difference between the groups. Without randomization, sicker or healthier people can end up sorted into one group, which quietly biases the comparison.

What is a confounding variable?

A confounder is a third factor linked to both the exposure being studied and the outcome, creating a misleading appearance of cause and effect. For example, coffee drinkers may also smoke more, so an apparent link between coffee and lung disease could really be driven by smoking. Good studies handle confounders through randomization or statistical adjustment, but a leftover, unmeasured confounder is always a risk in observational research.

What is publication bias?

Publication bias is the tendency for studies with positive or striking results to get published while studies showing no effect quietly stay in a drawer. This skews the visible literature toward larger apparent benefits than really exist, which can mislead anyone pooling results in a meta-analysis. Researchers look for it using tools like funnel plots and by checking trial registries for studies that were run but never reported.

What is a placebo control and why is it used?

A placebo is an inactive treatment, such as a sugar pill, given to a comparison group so that it looks and feels like the real intervention. It is used because people often improve simply from expecting to, from added attention, or from the natural course of an illness. Comparing an active treatment against placebo lets researchers separate those effects from the treatment's own true effect.

What does a hazard ratio mean?

A hazard ratio compares how quickly an event, such as relapse or death, occurs in a treatment group versus a control group over the follow-up period. A value of 1 means no difference, below 1 means the event happens less often or later in the treatment group, and above 1 means it happens more often. It is a relative measure, so it tells you the direction and size of the effect but not the underlying baseline risk.

What is a non-inferiority trial?

A non-inferiority trial aims to show that a new treatment is not meaningfully worse than an existing one, usually because the new option offers another advantage such as fewer side effects, lower cost, or easier use. Instead of proving the new treatment is better, researchers set a margin in advance and check that any drop in effectiveness stays within it. These trials need careful reading, because a margin set too loosely can let a genuinely weaker treatment look acceptable.

What is the difference between a Type I and a Type II error?

A Type I error is a false alarm: concluding a treatment works when it truly does not. A Type II error is a miss: concluding a treatment does not work when it truly does. Studies are designed to keep the false-alarm rate low, often set at 5 percent, and to enroll enough participants (called adequate power) to avoid missing a real effect.

What is overfitting in a medical AI model?

Overfitting happens when a model learns the quirks and random noise of its training data instead of the real underlying pattern, so it looks impressive on the data it was built from but performs poorly on new patients. It is a bit like memorizing the answers to one test rather than understanding the subject. The main defense is testing the model on separate data it has never seen, ideally from a different time period or hospital.

Why does a medical AI model need external validation?

External validation means testing a model on patients from a different setting, hospital, or time period than the one it was trained on. A model can look excellent on its home data yet fail elsewhere because the patient mix, equipment, and record-keeping differ. Without this step, strong reported numbers may not hold up where the tool would actually be used, so it is a key thing to look for before trusting an AI tool.

What is p-hacking?

P-hacking is trying many analyses, outcomes, or subgroups and then reporting only the ones that reach statistical significance, which makes chance findings look real. Because running enough comparisons will eventually turn up an apparently significant result by luck alone, this practice inflates false positives. Registering the planned analysis before collecting data is one of the strongest guards against it.

What is allocation concealment in a clinical trial?

Allocation concealment means the people enrolling participants cannot know or predict which group a person will be assigned to before that person is entered into the trial. This matters because if a recruiter can foresee the next assignment, they might consciously or unconsciously steer sicker or healthier patients into a particular group, undoing the balance randomization is meant to create. It is different from blinding, which hides the assignment after enrollment; allocation concealment protects the moment of assignment itself.

What is the number needed to treat?

The number needed to treat (NNT) is the average number of people who must receive a treatment for one additional person to benefit compared with the alternative. It is calculated as 1 divided by the absolute risk reduction, so a smaller NNT points to a more effective treatment. An NNT of 20, for instance, means that treating 20 people prevents one bad outcome that would otherwise have occurred. Because it depends on baseline risk, the same drug can have a very different NNT in high-risk versus low-risk groups.

What is intention-to-treat analysis?

Intention-to-treat (ITT) analysis counts every randomized participant in the group they were originally assigned to, whether or not they finished the treatment or switched. This preserves the balance that randomization created and gives a realistic estimate of how a treatment performs in the real world, where people miss doses or drop out. It tends to be conservative, since including people who did not fully follow the protocol usually dilutes any apparent effect. Analyses that count only those who completed treatment as planned can overstate the benefit.

Why do clinical trials randomly assign patients to groups?

Random assignment gives each participant an equal chance of landing in any group, which tends to balance both known and unknown differences between the groups. That balance is what allows researchers to attribute a later difference in outcomes to the treatment rather than to who happened to receive it. Without it, sicker or healthier people can cluster in one arm and produce a misleading result. This is a main reason a well-run randomized trial offers stronger causal evidence than an observational study.

What is a hazard ratio?

A hazard ratio compares the rate at which an event occurs in one group versus another across the follow-up period of a study. A hazard ratio of 0.7 means the event is happening at about 70 percent of the rate in the comparison group, suggesting a reduction, while a value above 1 suggests an increase. It comes from time-to-event analyses and reflects the relative speed of events, not the total number who eventually have one. Like any ratio, it should be read alongside its confidence interval and the underlying absolute risks.

What is a composite endpoint?

A composite endpoint combines several separate outcomes, such as heart attack, stroke, and death, into a single measure that is counted when any one of them occurs. Researchers use composites to accumulate more events and detect effects with fewer participants. The drawback is that the components can differ greatly in importance, so a treatment might move a minor, frequent component while leaving the most serious outcomes unchanged. It helps to look at how each component behaved on its own, not just the combined number.

What does statistical power mean?

Statistical power is the probability that a study will detect a real effect of a given size if one truly exists. It depends mainly on the sample size, the size of the effect, and how much the data vary, and studies are commonly designed for around 80 percent power or more. An underpowered study can miss a genuine benefit and report a false negative, so a non-significant result from a small trial does not prove a treatment does nothing. Reading the sample-size calculation helps judge whether a study was large enough to answer its question.

What does the AUC or C-statistic tell you about a prediction model?

The area under the ROC curve, also called the C-statistic, summarizes how well a model separates people who have the outcome from those who do not. A value of 0.5 is no better than chance and 1.0 is perfect discrimination, with many useful clinical models falling somewhere in between. It measures ranking ability only, so it says nothing about whether the predicted probabilities are correct, which is what calibration checks. A high AUC alone does not guarantee a model is safe or useful in practice.

What is regression to the mean?

Regression to the mean is the tendency for an extreme measurement to be followed by one closer to the average, simply because of natural variation and measurement error. If people are enrolled because their blood pressure was unusually high on one day, many will read lower the next time even without any treatment. This can make an ineffective intervention look effective when there is no control group for comparison. It is a major reason before-and-after studies without a comparison group can mislead.

What is number needed to treat (NNT)?

Number needed to treat is the number of patients who would have to receive a treatment for one additional person to benefit over a defined time period. It is calculated as 1 divided by the absolute risk reduction, so a smaller number means a more effective treatment. Reading it alongside the number needed to harm gives a fuller picture of the tradeoff. For what a particular NNT means for your own care, a clinician who knows your situation can help weigh it.

What is an intention-to-treat analysis?

An intention-to-treat analysis counts every participant in the group they were originally assigned to, whether or not they finished or switched treatments. This preserves the balance that randomization created and gives a more realistic estimate of how a treatment performs in practice, since dropout and non-adherence happen in the real world. It usually produces a more conservative result than a per-protocol analysis, which counts only those who completed the assigned treatment.

Why do researchers randomly assign people in a trial?

Random assignment tends to spread both known and unknown differences across the treatment and control groups, so on average the groups start out comparable. This lets researchers attribute any later difference in outcomes to the treatment itself rather than to preexisting differences between the people in each group. Randomization is the main feature that makes a controlled trial a strong tool for judging cause and effect.

What is confounding in a study?

A confounder is a third factor linked to both the exposure and the outcome, creating a misleading appearance of a direct relationship. For example, if coffee drinkers also smoke more, a study might wrongly blame coffee for an effect that smoking caused. Good studies reduce confounding through randomization, matching, or statistical adjustment, but a confounder no one measured can still distort the result.

What is an odds ratio?

An odds ratio compares the odds of an outcome in one group with the odds in another. A value of 1 means no difference, above 1 suggests higher odds in the exposed group, and below 1 suggests lower odds. It is common in case-control studies, but when an outcome is frequent the odds ratio can look larger than the matching risk ratio, so it should not be read as a plain comparison of risk.

What does it mean for a study to be underpowered?

Statistical power is the probability that a study will detect a real effect if one genuinely exists. A study with too few participants is underpowered, meaning it can miss true effects and return a non-significant result that is easily misread as proof of no effect. When a small study reports no difference, it is often more accurate to say the study could not tell than to say there is no effect.

What does data drift mean for a clinical AI tool?

Data drift is when the real-world data feeding a clinical AI tool gradually shifts away from the data the tool was built and tested on, for example because of new equipment, a changing patient population, or updated care practices. As the inputs change, a model that once performed well can quietly become less accurate. This is why a deployed medical AI tool needs ongoing monitoring rather than a one-time evaluation.

How can I tell if a health headline is overstating a study?

A few quick checks help. See whether the headline reports an absolute change or only a relative one, since a 50 percent increase can mean a rise from two cases in a thousand to three. Check whether the study was done in humans rather than only animals or cells, whether it showed a correlation or actually tested cause and effect, and how many people took part. When a headline sounds far more certain than the study behind it, the study is usually the better guide, and a clinician can help interpret what it means for you.

What is regression to the mean, and why can it fool you?

Regression to the mean is the tendency for an unusually high or low measurement to be closer to average the next time it is taken, simply because of natural variation. People often start a treatment when symptoms are at their worst, so later improvement can partly reflect this drift back toward normal rather than the treatment working. A control group helps separate a real treatment effect from this natural settling, which is one reason uncontrolled before-and-after results can mislead.

Contact

Get in touch.

Still have a question? Reach out directly.

contact@evidenceappraisal.com