# Warning Signs in Experimental Design and Interpretation

DevFeed: [Warning Signs in Experimental Design and Interpretation](<https://devfeed.tech/articles/warning-signs-in-experimental-design-and-interpretation-40562.md>)

Original publisher: [Read original article](<http://norvig.com/experiment-design.html>)

Published: 2007-07-09T00:00:00Z

Content type: opinion

Language: en

Sources: [Peter Norvig](<https://devfeed.tech/sources/peter-norvig.md>)

Topics: [test](<https://devfeed.tech/topics/test.md>)

Tags: [essay](<https://devfeed.tech/tags/essay.md>), [experiment](<https://devfeed.tech/tags/experiment.md>), [results](<https://devfeed.tech/tags/results.md>)

## AI overview

This essay explains why statistically significant experimental results do not necessarily establish that a treatment will work for an individual. It identifies warning signs in experimental design and interpretation that can reduce a study's credibility, while noting that one warning sign does not invalidate a study.

## Source excerpt

An update to my essay on experiment design; it now stresses warning signs rather than clear-cut mistakes and urges the reader to consider the factors that dilute the credibility of an experiment.