Sign on

SAO/NASA ADS Physics Abstract Service

· Find Similar Abstracts (with default settings below)
· Electronic Refereed Journal Article (HTML)
· Full Refereed Journal Article (PDF/Postscript)
· References in the article
· Citations to the Article (6) (Citation History)
· Refereed Citations to the Article
· Also-Read Articles (Reads History)
·
· Translate This Page
Title:
On “Field Significance” and the False Discovery Rate
Authors:
Wilks, D. S.
Publication:
Journal of Applied Meteorology and Climatology, vol. 45, Issue 9, p.1181-1189
Publication Date:
09/2006
Origin:
WEB
DOI:
10.1175/JAM2404.1
Bibliographic Code:
2006JApMC..45.1181W

Abstract

The conventional approach to evaluating the joint statistical significance of multiple hypothesis tests (i.e., “field,” or “global,” significance) in meteorology and climatology is to count the number of individual (or “local”) tests yielding nominally significant results and then to judge the unusualness of this integer value in the context of the distribution of such counts that would occur if all local null hypotheses were true. The sensitivity (i.e., statistical power) of this approach is potentially compromised both by the discrete nature of the test statistic and by the fact that the approach ignores the confidence with which locally significant tests reject their null hypotheses. An alternative global test statistic that has neither of these problems is the minimum <em>p</em> value among all of the local tests. Evaluation of field significance using the minimum local <em>p</em> value as the global test statistic, which is also known as the Walker test, has strong connections to the joint evaluation of multiple tests in a way that controls the “false discovery rate” (FDR, or the expected fraction of local null hypothesis rejections that are incorrect). In particular, using the minimum local <em>p</em> value to evaluate field significance at a level <em>α</em>global is nearly equivalent to the slightly more powerful global test based on the FDR criterion. An additional advantage shared by Walker’s test and the FDR approach is that both are robust to spatial dependence within the field of tests. The FDR method not only provides a more broadly applicable and generally more powerful field significance test than the conventional counting procedure but also allows better identification of locations with significant differences, because fewer than <em>α</em>global × 100% (on average) of apparently significant local tests will have resulted from local null hypotheses that are true.
Bibtex entry for this abstract   Preferred format for this abstract (see Preferences)
   

Find Similar Abstracts:

Use: Authors
Title
Abstract Text
Return: Query Results Return    items starting with number
Query Form
Database: Astronomy
Physics
arXiv e-prints