Estimating variance functions in developmental toxicity studies
The presence of intralitter correlation is a well known issue for analysis of the developmental toxicology data. The intralitter correlation coefficients observed in developmental toxicology data are generally different across dose groups. In this paper we use a generalized estimating equation procedure to model jointly the mean parameters and the intralitter correlation coefficients as functions of dose levels. Our procedure is similar to that used by Prentice and Zhao (1991, Biometrics 47, 825 839) for estimating the mean and variance parameters.
Bowman, D., Chen, J., & George, E. (1995). Estimating variance functions in developmental toxicity studies. Biometrics, 51 (4), 1523-1528. https://doi.org/10.2307/2533282