Power approximations for overall average effects in meta-analysis of dependent effect sizes

Authors

Mikkel H. Vembye

James E. Pustejovsky

Terri D. Pigott

Published

October 17, 2022

Meta-analytic models for dependent effect sizes have grown increasingly sophisticated over the last few decades, which has created challenges for a priori power calculations. We introduce power approximations for tests of average effect sizes based upon several common approaches for handling dependent effect sizes. In a Monte Carlo simulation, we show that the new power formulas can accurately approximate the true power of meta-analytic models for dependent effect sizes. Lastly, we investigate the Type I error rate and power for several common models, finding that tests using robust variance estimation provide better Type I error calibration than tests with model-based variance estimation. We consider implications for practice with respect to selecting a working model and an inferential approach.

Back to top

Citation

BibTeX citation:
@article{vembye2022,
  author = {Vembye, Mikkel H. and Pustejovsky, James E. and Pigott,
    Terri D.},
  title = {Power Approximations for Overall Average Effects in
    Meta-Analysis of Dependent Effect Sizes},
  journal = {Journal of Educational and Behavioral Statistics},
  volume = {48},
  number = {1},
  pages = {70-102},
  date = {2022-10-17},
  url = {https://doi.org/10.3102/10769986221127379},
  doi = {10.1016/j.jsp.2018.02.003},
  langid = {en}
}
For attribution, please cite this work as:
Vembye, M. H., Pustejovsky, J. E., & Pigott, T. D. (2022). Power approximations for overall average effects in meta-analysis of dependent effect sizes. Journal of Educational and Behavioral Statistics, 48(1), 70–102. https://doi.org/10.1016/j.jsp.2018.02.003