lmm_animal() offers five multivariate covariance
structures:
- unstructured
G, unstructuredE(the default); - unstructured
G, diagonalE; - factor
G, unstructuredE; - factor
G, diagonalE; - factor
G, shared-factorE: the same latent factors driveGandE.
This vignette simulates five traits from a two-factor G
and a diagonal E (so model 4 is the true one) and fits all
five. It scores each fit twice: by its error against the simulated
truth, which only a simulation can give, and by held-out predictive
density with fit_loo(), which is the question a user can
ask of real data.
Simulation
The first factor loads on traits 1 to 3, the second on traits 3 to 5.
set.seed(1234)
n_traits <- 5L
n_factors <- 2L
traits <- paste0("t", seq_len(n_traits))
Lambda <- matrix(c(0.90, 0.00,
0.85, 0.00,
0.70, 0.30,
0.00, 0.80,
0.00, -0.70), n_traits, n_factors, byrow = TRUE)
Psi <- c(0.35, 0.40, 0.30, 0.45, 0.50)
G <- Lambda %*% t(Lambda) + diag(Psi)
E <- diag(c(0.80, 0.90, 0.75, 0.85, 0.95))
dimnames(G) <- dimnames(E) <- list(traits, traits)
n_gen <- 5; n_breed <- 100
ped <- data.frame(id = seq_len(n_gen * n_breed),
sire = NA_integer_, dam = NA_integer_,
sex = NA_character_)
ped$sex[seq_len(n_breed)] <- sample(rep(c("M", "F"), each = n_breed / 2))
for (g in 2:n_gen) {
kids <- ((g - 1) * n_breed + 1):(g * n_breed)
pool <- ped[ped$id < min(kids), ]
ped$sire[kids] <- sample(pool$id[pool$sex == "M"], n_breed, TRUE)
ped$dam[kids] <- sample(pool$id[pool$sex == "F"], n_breed, TRUE)
ped$sex[kids] <- sample(c("M", "F"), n_breed, TRUE)
}
A <- makeA(ped)
n <- nrow(A)
X <- cbind(Intercept = 1, sex = rbinom(n, 1, 0.5),
age = round(rnorm(n, 3, 0.5), 2))
B <- rbind(rep(10, n_traits), rep(1.5, n_traits), rep(0.4, n_traits))
Y <- X %*% B +
t(chol(A)) %*% matrix(rnorm(n * n_traits), n) %*% chol(G) +
matrix(rnorm(n * n_traits), n) %*% chol(E)
colnames(Y) <- traitsFitting the five structures
Every fit uses the same chain settings, the unstructured parts the
same LKJ prior and the factor parts the same horseshoe, so differences
reflect the structure. A is decomposed once and passed to
every fit as eigen_A.
e <- eigen(A, symmetric = TRUE)
eigen_A <- list(Q = e$vectors, lambda = e$values)
fit_one <- function(...) {
elapsed <- system.time(
fit <- lmm_animal(Y, X, A, eigen_A = eigen_A,
iter = 2000, warmup = 1000, chains = 4, cores = 4,
refresh = 0, seed = 1, ...))[["elapsed"]]
attr(fit, "elapsed") <- elapsed
fit
}
factor_args <- list(genetic_structure = "factor", n_factors = n_factors,
hs_global_scale = 2, hs_slab_scale = 2)
fits <- list(
"G us, E us" = fit_one(),
"G us, E diag" = fit_one(residual_structure = "diagonal"),
"G factor, E us" = do.call(fit_one, factor_args),
"G factor, E diag" = do.call(fit_one, c(factor_args,
residual_structure = "diagonal")),
"G factor, E shared" = do.call(fit_one, c(factor_args,
residual_structure = "shared_factor"))
)
#> Running MCMC with 4 parallel chains...
#> Chain 3 finished in 18.0 seconds.
#> Chain 2 finished in 19.1 seconds.
#> Chain 4 finished in 19.1 seconds.
#> Chain 1 finished in 20.4 seconds.
#>
#> All 4 chains finished successfully.
#> Mean chain execution time: 19.1 seconds.
#> Total execution time: 20.6 seconds.
#>
#> Running MCMC with 4 parallel chains...
#> Chain 1 finished in 12.2 seconds.
#> Chain 2 finished in 13.0 seconds.
#> Chain 4 finished in 13.1 seconds.
#> Chain 3 finished in 13.5 seconds.
#>
#> All 4 chains finished successfully.
#> Mean chain execution time: 12.9 seconds.
#> Total execution time: 13.6 seconds.
#>
#> Running MCMC with 4 parallel chains...
#> Chain 1 finished in 29.7 seconds.
#> Chain 4 finished in 29.7 seconds.
#> Chain 3 finished in 31.1 seconds.
#> Chain 2 finished in 34.9 seconds.
#>
#> All 4 chains finished successfully.
#> Mean chain execution time: 31.4 seconds.
#> Total execution time: 35.0 seconds.
#>
#> Running MCMC with 4 parallel chains...
#> Chain 3 finished in 28.6 seconds.
#> Chain 4 finished in 28.9 seconds.
#> Chain 1 finished in 29.2 seconds.
#> Chain 2 finished in 30.2 seconds.
#>
#> All 4 chains finished successfully.
#> Mean chain execution time: 29.2 seconds.
#> Total execution time: 30.4 seconds.
#>
#> Running MCMC with 4 parallel chains...
#> Chain 3 finished in 105.3 seconds.
#> Chain 2 finished in 105.7 seconds.
#> Chain 4 finished in 107.5 seconds.
#> Chain 1 finished in 136.9 seconds.
#>
#> All 4 chains finished successfully.
#> Mean chain execution time: 113.9 seconds.
#> Total execution time: 137.1 seconds.Against the truth
Relative MSE divides each elementwise mean squared error by the mean
squared truth, so errors on quantities with different scales can be
compared. The correlation comparison uses the upper triangle, since the
diagonal is always 1. min_ess is the smallest bulk
effective sample size across the unique elements of G.
relative_mse <- function(estimate, truth)
mean((estimate - truth)^2) / mean(truth^2)
upper <- function(S) cov2cor(S)[upper.tri(S)]
score <- function(fit) {
G_hat <- draws_mean(fit, "G")
E_hat <- draws_mean(fit, "E")
G_draws <- fit_draws(fit)$G
keep <- which(lower.tri(G), arr.ind = TRUE)
keep <- rbind(keep, cbind(seq_len(n_traits), seq_len(n_traits)))
ess <- apply(keep, 1, function(ij)
posterior::ess_bulk(G_draws[ij[1], ij[2], ]))
c(G = relative_mse(G_hat, G),
E = relative_mse(E_hat, E),
h2 = relative_mse(diag(G_hat) / diag(G_hat + E_hat),
diag(G) / diag(G + E)),
corrG = relative_mse(upper(G_hat), upper(G)),
min_ess = min(ess),
divergences = sum(fit$diagnostic_summary(quiet = TRUE)$num_divergent),
time_s = attr(fit, "elapsed"))
}
round(t(sapply(fits, score)), 3)
#> G E h2 corrG min_ess divergences time_s
#> G us, E us 0.038 0.037 0.010 0.069 2679.637 0 21.967
#> G us, E diag 0.029 0.011 0.006 0.052 3872.619 0 14.850
#> G factor, E us 0.043 0.040 0.010 0.072 1790.653 0 35.924
#> G factor, E diag 0.027 0.009 0.005 0.050 2154.065 0 31.207
#> G factor, E shared 0.026 0.019 0.006 0.050 2859.964 0 138.000Held-out predictive density
fit_loo() leaves out one individual at a time. Relatives
share breeding values, so the term for an animal is the density of its
traits given every other animal, computed after the fit from the draws
(non-factorized LOO). Every fit is to the same response, so the constant
the standardization contributes cancels in the comparison.
loos <- lapply(fits, fit_loo, eigen_A = eigen_A)
sapply(loos, function(l) sum(l$diagnostics$pareto_k > 0.7))
#> G us, E us G us, E diag G factor, E us G factor, E diag
#> 0 0 0 0
#> G factor, E shared
#> 0
loo::loo_compare(loos)
#> model elpd_diff se_diff p_worse diag_diff diag_elpd
#> G factor, E diag 0.0 0.0 NA
#> G us, E diag -1.1 0.9 0.89 |elpd_diff| < 4
#> G factor, E shared -4.1 1.5 1.00
#> G factor, E us -10.7 3.2 1.00
#> G us, E us -12.0 3.1 1.00
#>
#> Diagnostic flags present.
#> See ?`loo-glossary` (sections `diag_diff` and `diag_elpd`)
#> or https://mc-stan.org/loo/reference/loo-glossary.html.Every model is compared with the best one: elpd_diff is
its loss relative to that model and se_diff the standard
error of the difference. A difference smaller than about twice its
standard error is not an ordering.
Here the ranking separates the residual structure clearly. Both
unstructured-E models lose more than three standard errors
against the best fit, so the data prefer a diagonal E,
which is what generated them. The shared-factor model sits between the
two: it forces the factors that drive G to drive
E too, which a diagonal E does not have. The
genetic structure is not separated: with a diagonal E, the
factor and unstructured G are about one standard error
apart. That matches the table against the truth, where those two fits
have nearly the same error. With five traits a factor G
saves few parameters; its advantage, in accuracy and in sampling time,
grows with the number of traits, where an unstructured G
becomes expensive.
Timings are single runs of the lmm_animal() call. The
shared-factor model is the slowest to sample.
