Power approximations for overall average effects in meta-analysis of dependent effect sizes
Meta-analytic models for dependent effect sizes have grown increasingly sophisticated over the last few decades, which has created challenges for a priori power calculations. We introduce power approximations for tests of average effect sizes based upon several common approaches for handling dependent effect sizes. In a Monte Carlo simulation, we show that the new power formulas can accurately approximate the true power of meta-analytic models for dependent effect sizes. Lastly, we investigate the Type I error rate and power for several common models, finding that tests using robust variance estimation provide better Type I error calibration than tests with model-based variance estimation. We consider implications for practice with respect to selecting a working model and an inferential approach.
Back to topCitation
@article{vembye2022,
author = {Vembye, Mikkel H. and Pustejovsky, James E. and Pigott,
Terri D.},
title = {Power Approximations for Overall Average Effects in
Meta-Analysis of Dependent Effect Sizes},
journal = {Journal of Educational and Behavioral Statistics},
volume = {48},
number = {1},
pages = {70-102},
date = {2022-10-17},
url = {https://doi.org/10.3102/10769986221127379},
doi = {10.1016/j.jsp.2018.02.003},
langid = {en}
}