Marginal genetic effects estimation in family and twin studies using random-effects models

Random-effects models are often used in family-based genetic association studies to properly capture the within families relationships. In such models, the regression parameters have a conditional on the random effects interpretation and they measure, e.g., genetic effects for each family. Estimating parameters that can be used to make inferences at the population level is often more relevant than the family-specific effects, but not straightforward. This is mainly for two reasons: First the analysis of family data often requires high-dimensional random-effects vectors to properly model the familial relationships, for instance when members with a different degree of relationship are considered, such as trios, mix of monozygotic and dizygotic twins, etc. The second complication is the biased sampling design, such as the multiple cases families design, which is often employed to enrich the sample with genetic information. For these reasons deriving parameters with the desired marginal interpretation can be challenging. In this work we consider the marginalized mixed-effects models, we discuss challenges in applying them in ascertained family data and propose penalized maximum likelihood methodology to stabilize the parameter estimation by using external information on the disease prevalence or heritability. The performance of our methodology is evaluated via simulation and is illustrated on data from Rheumatoid Arthritis patients, where we estimate the marginal effect of HLA-DRB1*13 and shared epitope alleles across three different study designs and combine them using meta-analysis