A Flexible Bayesian Model for Studying Gene–Environment Interaction
An important followup step after genetic markers are found to be associated with a disease outcome is a more detailed analysis investigating how the implicated gene or chromosomal region and an established environment risk factor interact to influence the disease risk. The standard approach to this study of gene–environment interaction considers one genetic marker at a time and therefore could misrepresent and underestimate the genetic contribution to the joint effect when one or more functional loci, some of which might not be genotyped, exist in the region and interact with the environment risk factor in a complex way. We develop a more global approach based on a Bayesian model that uses a latent genetic profile variable to capture all of the genetic variation in the entire targeted region and allows the environment effect to vary across different genetic profile categories. We also propose a resamplingbased test derived from the developed Bayesian model for the detection of gene–environment interaction. Using data collected in the Environment and Genetics in Lung Cancer Etiology (EAGLE) study, we apply the Bayesian model to evaluate the joint effect of smoking intensity and genetic variants in the 15q25.1 region, which contains a cluster of nicotinic acetylcholine receptor genes and has been shown to be associated with both lung cancer and smoking behavior. We find evidence for gene–environment interaction (Pvalue = 0.016), with the smoking effect appearing to be stronger in subjects with a genetic profile associated with a higher lung cancer risk; the conventional test of gene–environment interaction based on the singlemarker approach is far from significant.
Published in the journal:
. PLoS Genet 8(1): e32767. doi:10.1371/journal.pgen.1002482
Category:
Research Article
doi: 10.1371/journal.pgen.1002482
Summary
An important followup step after genetic markers are found to be associated with a disease outcome is a more detailed analysis investigating how the implicated gene or chromosomal region and an established environment risk factor interact to influence the disease risk. The standard approach to this study of gene–environment interaction considers one genetic marker at a time and therefore could misrepresent and underestimate the genetic contribution to the joint effect when one or more functional loci, some of which might not be genotyped, exist in the region and interact with the environment risk factor in a complex way. We develop a more global approach based on a Bayesian model that uses a latent genetic profile variable to capture all of the genetic variation in the entire targeted region and allows the environment effect to vary across different genetic profile categories. We also propose a resamplingbased test derived from the developed Bayesian model for the detection of gene–environment interaction. Using data collected in the Environment and Genetics in Lung Cancer Etiology (EAGLE) study, we apply the Bayesian model to evaluate the joint effect of smoking intensity and genetic variants in the 15q25.1 region, which contains a cluster of nicotinic acetylcholine receptor genes and has been shown to be associated with both lung cancer and smoking behavior. We find evidence for gene–environment interaction (Pvalue = 0.016), with the smoking effect appearing to be stronger in subjects with a genetic profile associated with a higher lung cancer risk; the conventional test of gene–environment interaction based on the singlemarker approach is far from significant.
Introduction
Genomewide association studies that focus on detecting the main effect from individual single nucleotide polymorphisms (SNPs) have successfully identified more than 4,000 SNPs associated with different diseases [1]. To achieve a better understanding of the mechanisms underlying disease development, it is of great interest to follow up those genetic findings with more detailed analyses investigating how the gene and environment interact in their influence on disease risk. One popular approach aims at detecting SNPenvironment interaction between individual SNPs and established environmental risk factors [2], [3], [4]. One of the few successes for this approach is the interaction detected between cigarette smoking and two genetic variants, a NAT2 tagging SNP and a GSTM1 deletion, in a multistage genomewide association study (GWAS) of bladder cancer [3].
The standard approach to the study of gene–environment joint effect inspects one marker at a time, assuming that a single marker is the functional unit in the gene and environment interplay. This singlemarker approach could misrepresent and underestimate the genetic contribution to the joint effect when one or more functional loci, some of which might not be genotyped, exist in the region, and interact with the environment risk factor in a complex way. A more global approach that simultaneously considers all genetic markers might capture more of the genetic variation within the entire targeted region, and provides a better opportunity to reveal complicated gene–environment interactions [5]. The global approach would be more informative if it has the capability showing how an environmental effect varies according to a subject's genetic profile.
We provide a flexible Bayesian modeling framework for the study of gene–environment joint effects. We consider a casecontrol study with genotypes G at a set of SNPs within a given region and a measurement for the environment exposure E available for each subject. We seek to identify a latent genetic profile variable L that classifies the multilocus genotype G into different categories (clusters) such that subjects with their genotype assigned to the same genetic profile category share the same disease risk model, which is a standard logistic regression model with its own intercept term and slope. The intercept term represents the baseline log odds, common for subjects sharing the same genetic profile. The slope represents the effect (i.e., log odds ratio) of the environment risk factor for subjects with the given genetic profile. The model that we try to build and make inferences from is essentially the logistic regression model consisting of L and E as main effects and their product as an interaction term; the unusual aspect is that the definition of the latent genetic profile L is a priori unknown. To account for the uncertainty in the cluster assignment underlying the definition of L, we adopt an idea from the hidden Markov model originally developed for modeling the spatial heterogeneity of the disease event rate, observed on a predefined set of areas [6]. In this Bayesian model approach, Green and Richardson tried to allocate areas into a number of clusters and assumed a common disease rate for areas assigned to the same cluster. The mechanism for the area allocation was modeled through the Potts model [7], which favors probabilistically those allocation patterns where “neighboring” areas are assigned to the same cluster. Note that the spatial dependence assumption is generally appropriate in situations where the event rate is expected to take on similar values in neighboring areas. To draw the connection, we can think of each type of observed multilocus genotype G as an “area”. We would like to use the Potts model to guide the cluster assignment through a certain level of “spatial” dependence, i.e., similar genotypes (nearby areas) tend to be assigned to the same cluster, as in other applications in genetics studies, including the study of haplotype association [8], [9].
We use the Markov chain Monte Carlo (MCMC) sampling method (e.g., [10], [11]) to fit the proposed model, incorporating several recent advances in the MCMC methodology. We adopt a recently developed algorithm [12] to update the regulating parameter in the Potts model, which has an intractable normalizing constant, and cannot be handled by the standard Metropolis Hastings algorithm. This algorithm allows us to consider the parameter of interest on its original continuous scale and obviates the need for a finite number of selected grids with their normalizing constants precalculated, a strategy taken by Green and Richardson [6]. To identify the optimal genetic profile assignment, we use an ensemble averaging method that aggregates different cluster assignments generated by the MCMC samplers into a consensual one. We find that this cluster algorithm works quite well in simulation studies. A similar idea has been used by Liang [13] and Molitor et al [14] in different contexts. We also propose a resamplingbased test based on the fitted Bayesian model that can be used to formally test for the existence of gene–environment interaction.
We apply the proposed method to study the joint effect of cigarette smoking intensity and genetic variants in chromosome region 15q25.1 using data from EAGLE, a populationbased casecontrol study conducted in Italy [15]. Cigarette smoking is an established major risk factor for lung cancer. Besides environmental exposures, recent GWAS identified a few chromosome regions (e.g., chromosomes 15q25.1, 5p15, and 6p21) harboring genetic variants underlying a susceptibility for lung cancer [15], [16], [17]. In particular, the chromosome 15q25.1 region, which includes the CHRNA5CHRNA3CHRNB4 cluster of cholinergic nicotinic receptor subunit genes, has been shown to be associated with both lung cancer and smoking behaviors, such as cigarette smoking intensity [18], [19], [20], [21], [22]. Although there is no evidence suggesting the existence of multiple loci in this region independently contributing to lung cancer susceptibility in populations of European ancestry [16], it does appear that there are multiple independent loci within 15q25.1 affecting smoking intensity [19]. The main goal of our analysis is to evaluate whether the effect of smoking intensity varies with genetic variants in 15q25.1. Our analysis finds evidence for gene–environment interaction, with the relative risk for smoking appearing to be stronger in subjects with a genetic profile associated with a higher lung cancer risk. The proposed resamplingbased test derived from the fitted Bayesian model also detects significant gene–environment interaction (Pvalue = 0.016). On the other hand, the standard singlemarker approach that aims at detecting the interaction between a SNP and smoking intensity fails to reveal any evidence of interaction, with the smallest observed nominal Pvalue being 0.021 among the 32 testing SNPs, and the adjusted Pvalue based on the permutation test being 0.29.
Materials and Methods
We first introduce the Bayesian model and describe the MCMC algorithm for fitting this model. Next we provide procedures for posterior inference using samples generated by the MCMC sampler, including a method for deciding the number of clusters and a method for identifying the optimal cluster assignment once the number of clusters is determined. We validate the proposed method using simulated data. We then apply the method to study the gene–environment joint effect using data generated from the EAGLE lung cancer casecontrol study.
The Bayesian Model Setup
Assume we have data collected from a casecontrol study, with cases, controls. Let be the total number of subjects in the study. For the ith subject, we denote its observation by , where for a case, 0 for a control; is the observed exposure for the environment risk factor of interest; represents measures on a set of covariates; and represents multilocus genotypes observed on a set of SNPs in a prespecified region. In the following discussion, we use the term genotype to refer to the multilocus genotype observed on all considered SNPs within the targeted region. We intend to develop a model for the GE joint effect that permits GE interaction. More specifically, we assume the true underlying risk model has the following form:(1)where clusters 1 to K represent a partition of the genotype space; is the intercept term representing the common baseline log odds for subjects with their genotypes in cluster k; is the effect of E (in term of log odds ratio) in the disease model for cluster k, ; and is the vector of coefficients for the set of covariates X and is constant regardless of a subject's genotype. Notice that if the partition of the joint genotype space is known a priori, we can derive the corresponding Kcategory genetic profile variable L based on the cluster assignment. The above model (1) is then essentially the standard logistic regression model consisting of L and E as main effects and their product as the interaction term, with adjustment for X, and has the following form:Thus it is clear that there is no GE interaction if , and the interaction exists if otherwise.
In real applications, we do not know a priori the partition of the genotype space. If G consists of just one SNP, the goal can be achieved easily by using a saturated logistic regression including both E and G (as a threelevel categorical variable) as the main effects and their product as the interaction term. For situations where G consists of multiple SNPs (e.g., more than 10), as in the case of the EAGLE lung cancer study, we propose the following Bayesian model that simultaneously searches for the optimal partition of the genotype space and estimates the unknown parameters in the corresponding risk model (1).
The Bayesian model is built up in a hierarchic framework. We first describe our model by assuming K, the total number of clusters, is known. We will describe how to choose K later. Suppose there are H types of genotype configurations observed in the sample, labeled as genotype 1, 2, …, H. We define the latent genotype allocation vector , with , being the cluster assignment for genotype h, . For subject i, we denote its genotype id by . Given the allocation vector and the set of coefficients for the disease model (1), the probability of subject i having the disease outcome is(2)
In the above model specification, we use the prospective likelihood function (2) for observed casecontrol data, which were collected under a retrospective sampling scheme given the disease outcome. The use of the prospective likelihood function can be partially justified by the general results from Staicu [23] and Seaman and Richardson [24]. They showed the equivalence of prospective and retrospective analysis in the Bayesian framework in the sense that both approaches could yield the identical marginal posterior distribution of the log odds ratio under analyses with properly specified priors. In model (2), the effect of E varies with G. Thus we call it the Bayesian risk model allowing for GE interaction. As a comparison in the analysis, we also consider a model assuming a homogeneous effect from E, which is defined as(3)We call this model the Bayesian risk model without GE interaction. In what follows, we will describe methods for fitting model (2), the one allowing for GE interaction. Similar procedures can be applied to model (3).
To model the distribution of the allocation vector z, we first choose a similarity metric to define the spatial contiguity between any two genotypes. Let J denote the total number of considered SNPs within the region, with the genotype at a given SNP being coded as 0, 1, or 2 according to the number of copies of the minor allele. Let genotypes h and have the configurations and , where is the genotype at the jth SNP for the multilocus genotype h. We first define the distance between them aswhere is the variance for the genotype at SNP j observed in the sample, with being the genotype at SNP j for subject i, and . Then we define if is among the 4 (distinctive) genotypes closest to genotype h, and is among the 4 genotypes closest to genotype ; if (or h) is among the 4 genotypes closest to genotype h (or ) but this is not true in both cases; and for all other cases.
We model z with the Potts model, which has a regulating parameter governing the level of spatial dependency in the cluster assignment. The Potts model has the following form:where , with being the indictor function, i.e., if and 0 otherwise, and whereis the log normalizing constant. Under the Potts model with , the cluster assignments are allocated independently for different genotypes. When , the cluster assignments for two neighboring genotypes h and (i.e., two genotypes with ) are correlated. The level of correlation (spatial dependence) increases with . For example, under the genotype configuration observed in the EAGLE study and , the average probability that any two neighboring genotypes are allocated to the same cluster is 0.5 when . It increases to 0.83, and 0.97 for and 1.2, respectively. More discussions of the Potts model can be found in [6].
We need to specify our prior models for and . In this paper, we consider the normal distribution with a mean of 0 and a variance of 4 or the uniform distribution on the interval of as the prior for each parameter in . We describe the appropriateness of those priors for the prospective likelihood model in the Discussion Section. Both priors are very uninformative and generate similar conclusions on the EAGLE study and simulated datasets. Therefore we present only results based on the normal prior in the following discussions. Following Green and Richardson [6], the prior distribution for is set to be a uniform distribution on the interval , which covers an appropriate region of such that the resulting class of Potts models are flexible enough to capture a wide range of spatial dependence. We note that cannot be too large. If is over a critical point, the corresponding Potts model would essentially force almost all elements into the same cluster, a well known phenomenon for the Potts model called phase transition property [25], and in this situation, the MCMC simulation tends to get stuck. We did some experiments to explore the setting of for the Potts model based on the neighborhood configuration observed in the EAGLE study. We found the value induces a high level of spatial dependence, with the average probability that any two neighboring genotypes are allocated to the same cluster being 0.97 at ; and when , the average probability goes to 0.99, which indicates an extremely high level of spatial dependence for the Potts model. Based on these observations, we decided to set in our EAGLE study application, as well as in simulation studies that assume the same neighborhood structure as the EAGLE study. We consider only a uniform prior for since in practice we usually do not know which level of spatial dependence is more likely than the others. But the algorithm described below can certainly be used with other prior functions if necessary.
Putting all the foregoing models together, we can express the joint distribution of all variables aswhere . The inference (for a fixed total number of clusters K) on , and z can be based on the following MCMC algorithm.
The MCMC Algorithm
Updating coefficients
The full conditional function for coefficients in the risk model can be written as(4)We can use the standard MetropolisHastings (MH) steps to update , conditioned on the current values of other parameters. The detailed algorithm is given in Text S1.
Updating the allocation vector
Following Green and Richardson [6], we can update the allocations z using a Gibbs kernel; that is, for the genotype h, its cluster assignment is updated by drawing from the following full conditional distribution,(5)where is the sum of similarity scores between the genotype h and other genotypes currently assigned to cluster k.
Since the sampling space for z is discrete, the standard Gibbs sampler can be improved by the Metropolized Gibbs sampler [26]. Thus we choose this sampler for updating the allocation vector. A summary of the algorithm is given in Text S1.
Updating the regulating parameter
The regulating parameter has the following full conditional distribution:(6)If the standard MH algorithm is used, updating would involve the evaluation of the normalizing constant for the Potts model, which is prohibitive when the dimension of z is large. Green and Richardson [6] chose to restrict to a prespecified finite set of values; they used the thermodynamic integration approach [27] to estimate for a given value of K. Those estimates were then used in the MCMC sampler. The estimate of at prespecified grid points might lead to biased Monte Carlo estimates of and other parameters.
Here we propose to use the recently developed Monte Carlo MetropolisHastings algorithm (MCMH) [12] to sample from . This new algorithm replaces the ratio of normalizing constants at any two values of by a Monte Carlo estimate, which is obtained through a set of m auxiliary samples, in the MCMC iterations, thus allowing us to consider on its original continuous scale instead of on a finite number of prespecified points. As shown in [12], this algorithm ensures that the Monte Carlo estimate of the parameter will converge to its posterior mean. In our numeric experiments, we find it is appropriate to choose the number of auxiliary samples m to be between 50 and 100. A summary of the algorithm for updating is given in Text S1.
Posterior Inference
In our simulation studies and the real data application, we find the MCMC algorithm generally converges after 100.000 iterations. Below we describe a procedure for determining the number of clusters, and an ensemble averaging method for the identification of the cluster assignment based on the MCMC samples.
Determining the number of clusters
We choose to use the deviance information criterion (DIC) proposed by Spiegelhalter et al [28] for determining the number of clusters. For a given number of clusters K, define the deviance asWe can calculate the posterior expected deviance by averaging the deviance calculated at samples of generated by MCMC output. We calculate the deviance at the posterior mean of the parameters aswhere and are the posterior means of the coefficients assigned to subject i; is the posterior mean for . The for the model with K clusters is then calculated as
To determine the number of clusters, we run the algorithm with different values of K (e.g., , with ) and compute their DIC values. The DIC criterion favors models with small DIC values. To take the Monte Carlo variation into the consideration, instead of choosing the K with the smallest DIC, we adopt the +1 standard error (SE) rule originally proposed for the tree model selection [29]. To use this rule, we run the MCMC algorithm 20 times, with different random seeds for each considered value of K, and then pick the optimal number of clusters as the smallest one such that(7)where is the average of the values of DIC measured at K over 20 runs, , and is the Monte Carlo standard error estimated for based on 20 runs.
Based on our numerical experiments, we found that the Monte Carlo standard error usually is less than 1 if the MCMC chain converges. So, if there is only one run for each K, we recommend picking as the smallest one such that(8)We use this rule, hereafter called the +1 rule, to select the optimal number of clusters in simulation studies.
Identifying the cluster assignment
After the determination of the number of clusters , it is usually helpful to identify the consensual cluster assignment rule that assigns each genotype to one of the clusters. We can also use this partition to assign each subject to one of the clusters based on his or her genotype's assignment. Here we adopt the ideas from Liang [13] and Molitor et al [14] to find such a partition. Based on the samples generated from MCMC runs under the model, we let be the proportion of times that the genotypes h and are assigned to the same cluster. We then use as the dissimilarity metric and apply the PAM (partitioning around medoids) method [30] to partition genotypes into clusters. Simulation studies presented later show this clustering algorithm works quite well in identifying the appropriate clusters.
A ResamplingBased Test for Gene–Environment Interaction
It is usually desirable to have a formal statistical test or decision rule for inference regarding the presence of an interaction. Here we propose a resamplingbased test for this purpose. First we fit model (2), the Bayesian risk model allowing for GE interaction, under various numbers of clusters. Then we use the +1 rule to identify , the optimal number of clusters that is not less than 2, and the corresponding consensual cluster assignment L. We require for this interaction test because the interaction test is not defined for . We use the maximum likelihood estimate (MLE) to establish the following logistic regression model,(9)where is the cluster assignment for subject , given by the consensual cluster assignment L. This model includes the main effects of L and E, as well as their interactions. We can conduct a likelihood ratio test comparing model (9) with the similar model without the interaction terms and obtain the corresponding “Pvalue”, denoted by , based on the Chisquared distribution with degrees of freedom (df). Clearly, this “Pvalue” tends to overestimate the significance level of the interaction, as the variable is datadriven, but a small value for provides evidence against the null. We can use as the test statistic and apply the following resamplingbased procedure to evaluate its significance level.

Apply the MCMC procedure to fit model (3), the Bayesian risk model without GE interaction, on the observed data and identify , the optimal number of clusters, using the +1 rule, as well as the corresponding consensual cluster assignment.

Use MLE to fit the following logistic regression model based on the observed data,(10)where is the cluster assignment for subject , given by the consensual cluster assignment identified in Step 1, and , , and are the estimated coefficients.

Use the model given by (10) to generate B sets of bootstrap null datasets. Each null dataset is a copy of the observed dataset, except the outcome for every subject is regenerated according to the probability model given by (10).

For the bth null dataset, , obtain the test statistic using the same procedure used above for obtaining .

The estimated Pvalue for is given by
In Steps 1 and 2 we establish the Bayesian risk model under the null hypothesis that there is no GE interaction and the corresponding logistic regression model. We use the fitted logistic regression model (10) to generate multiple null datasets in Step 3 based on the parametric bootstrap procedure [31]. In Step 4, for the bth generated null dataset, we first apply the MCMC procedure to establish the Bayesian model given by (2) and next identify the optimal number of clusters with the +1 rule, as well as the corresponding consensual cluster assignment. Then we fit the corresponding logistic regression model with GE interaction and obtain the test statistic from the likelihood ratio test.
Results
The EAGLE Study
We used data generated by the lung cancer GWAS in the EAGLE study [15] with 1920 lung cancer cases and 1979 population controls as the basis for our simulation studies and real data applications. We focused on the chromosome region 15q25.1 between 76.5 Mb and 76.72 Mb, with the boundary defined by loci where the recombination rate is relatively high. This region covers all replicated loci relating to smoking behavior or lung cancer risk. We have genotypes on 32 SNPs in the region that have a minor allele frequency (MAF) larger than 4% (estimated in 1979 EAGLE control samples). We removed 17 redundant SNPs, leaving a minimal set of 15 SNPs where the pairwise was always less than 0.8. We used genotypes on these 15 tagging SNPs to represent each subject's genetic variation pattern in the region. The reason for removing redundant SNPs is to ensure that the similarity measure between any two types of multilocus genotypes is not dominated by a set of SNPs in high linkage disequilibrium. The summary of the 15 chosen tagging SNPs is given in Table 1.
Simulation Studies: Performance of the Bayesian Model
We conducted simulation studies to evaluate the performance of the proposed method for fitting the Bayesian model allowing for GE interaction. In the simulation study we were interested in studying the interaction between a binary environment risk factor ( or 1) and genetic variants (G) within a candidate region. We used genotypes at 15 tagging SNPs (Table 1) in 15q25.1 observed in the EAGLE study to represent the joint genotype distribution for the simulated population, which consisted of 766 distinct multilocus genotypes. We chose the 2^{nd}, 6^{th}, and 10^{th} SNPs listed in the Table 1 as the functional SNPs, and divided the genotype space into the following three regions according to the total number of risk alleles (assuming the minor allele to be the highrisk allele) among the 3 functional SNPs: region I, consisting of genotypes with ; regions II, consisting of genotypes with ; and region III, including genotypes with . We conducted a principal component (PC) analysis on subjects from the EAGLE study with genotypes at the 15 SNPs as their coordinates. Figure 1 shows how genotypes (subjects) in each of the three regions were distributed in the first 2PC space, with regions I, II, and III in green, blue, and red, respectively.
The disease risk models we considered had the form given by (1). Their definitions are given in Table 2. Under Model there was no genetic effect and no interaction between G and E, and thus there was no risk heterogeneity in the genotype space. Under and , coefficients and had the same clustering pattern. Under models , the risk heterogeneity patterns for and were not matched, unlike those under model and . In model , the two clusters defined by were region I, and regions II and III combined, while the two clusters defined by the effect of were regions I and II combined, and region III.
We assumed that the environmental exposure status E (0 or 1) and G were correlated in the general population. The distribution of E depended on G in the following way: for a subject with genotype in region I, the probabilities of being unexposed () or exposed () were 0.7 and 0.3; for a subject with genotype in one of the other two regions, those probabilities were 0.4 and 0.6 for and . Thus the distribution of E was quite different for subjects with different genotypes.
Under each model, we simulated 50 datasets representing a casecontrol study with 1500 cases and 1500 controls. We ran the MCMC algorithm with 2,000,000 iterations with the first 1,000,000 iterations being discarded. We used an algorithm similar to that described in [32] to simulate the casecontrol study. Note that under the casecontrol sampling scheme, we do not need to specify a value for . Instead, we just need to know the values of , , in order to simulate datasets from a casecontrol study.
For each simulated dataset, we applied our method with auxiliary samples, with the number of clusters K ranging from 1 to 8. We used the +1 rule defined by (8) to identify , the optimal number of clusters. Table 3 provides a summary of the number of clusters identified over 50 simulated datasets under each risk model. We can see from the table that the +1 rule performs quite well in identifying the right number of clusters, even in situations where there is no clustering structure (i.e., the true number of clusters, , is 1).
We evaluated the performance of the algorithm for cluster assignment by comparing the cluster assignment estimated at with the true underlying cluster assignment chosen by the simulation design. For model , the clustering patterns for and were not matched. In this case we treated the finer partitioning (given by Figure 1) that accommodates the clustering patterns of both and as the true one. The accuracy of the estimated cluster assignment was measured as the proportion of subjects being assigned to the same cluster by both assignments (the estimated one and the true one). The accuracy summary over 50 replications under various considered models (except , the model with no clustering structure) is given in Table 4. It indicates that the cluster assignment algorithm appears to be able to partition the subjects (and genotypes) into the proper subgroups, provided that the correct number of clusters can be identified.
We also evaluated the accuracy of the estimated coefficients ( and ). Based on the true risk model (1), subject i with genotype was assigned to one of the risk models. We considered coefficients and in that risk model to be the true coefficient values for this subject. Thus, subjects with their genotypes belonging to the same cluster would share the same true coefficient values. We used , the posterior median of assigned to subject i based on MCMC samples generated under , as the estimates for the underlying coefficients. The number of clusters was estimated by the +1 rule, as described previously. Since the odds for the genetic effect is not identifiable under the casecontrol design, we were interested only in the difference in between two groups. To present the result for each experiment, we shifted the value of , the posterior median of for subject i, by a constant value, which was chosen as , the median of among subjects in true cluster 1. As a result, the median level of the shifted posterior median (we still represent it as ) among subjects in cluster 1 is 0. In Figure 2, Figure 3, Figure 4, and Figure 5, we present summaries of and for each of the 50 experiments under models and . Summarized results for model are given in Figures S1 and S2. Each boxplot is a summary of or among subjects in a true underlying cluster. From those figures, we can see that the estimates align with their true values quite well. Notice that these estimates were obtained under the model with the number of clusters estimated by the +1 rule.
We inspected the algorithm's convergence using the Gelman and Rubin's diagnostic plot [33], as implemented in the CODA R package [34]. For each model, we checked the convergence on the first 5 simulated datasets used in the above simulation studies, with 5 independent runs on each dataset. We found that the proposed algorithm can converge within 100,000 iterations, with the estimated shrinkage factor falling below the recommended threshold of 1.1. We also show in Figures S3 and S4 the posterior distributions for , resulting from each of 5 independent runs on the first simulated dataset under models , and . It is evident from these plots that we can obtain very consistent posterior distributions for parameters of interest among different runs on the same data.
Simulation Studies: Performance of the ResamplingBased Test
We conducted a simulation study to evaluate whether the proposed resamplingbased test can maintain the proper type I error rate. We considered a disease risk model that had the main effects from G (with OR = 4 for genotypes falling into regions II and III vs. those in region I) and E (with a common OR of 4 for vs. ), with no interaction between G and E. Regions are defined in Figure 1. We assumed a study sample size of 600 cases and 600 controls, and simulated 1000 datasets under the considered risk model as did before. For each dataset, we ran the resamplingbased test with 1000 bootstrap steps for the estimation of the Pvalue, allowing the number of clusters to vary from 2 to 5. To reduce the computing time further, we ran the MCMC algorithm for 300,000 iterations with the burnin period consisting of the first 200,000 iterations for each bootstrapped sample (as 200,000 iterations appear to be enough to ensure the convergence of the MCMC algorithm). We found that the proposed resamplingbased test can maintain the proper type I error in the considered scenario, with estimated false positive rates of 0.055 and 0.097 under nominal levels of 0.05 and 0.10, respectively.
We compared the power of the proposed resamplingbased test with two other standard interaction tests, the minPSNP and minPPC tests. Both test statistics are based on the minimum Pvalue observed on a set of univariate GE interaction tests, with their significant levels being evaluated through a resamplingbased procedure. The minPSNP test is based on the set of single SNPenvironment interaction tests, with each SNPenvironment interaction test statistic being derived from the standard likelihood ratio test comparing two logistic regression models with and without the SNPenvironment interaction term. The SNP effect is modeled with a categorical variable with three levels so each SNPenvironment interaction test considered in the minPSNP test is a 2 df test. The minPPC is based on a set of tests that evaluate the interaction between a single principal component (PC) and the environment variable. PCs are derived from the principal component analysis of genotypes on all considered SNPs. Similar to the minPSNP test, each PCenvironment interaction test is derived from the likelihood ratio test comparing two logistic regression models with and without the interaction term. The PC effect is model as a continuous variable. Both minPSNP and minPPC were based on 15 univariate tests in the simulation study as there were a total of 15 SNPs in the considered chromosome region.
We evaluated the power under six different disease risk models, including , , and defined in Table 2, and the three additional models , , and . Model and had just one functional SNP (the 10^{th} SNP in Table 1). Model had 2 clusters, with coefficients in the formula (1) being for genotypes satisfying the condition (cluster 1), and for , or 2 (cluster 2). Model had 3 clusters, with coefficients for (cluster 1), for (cluster 2), and for (cluster 3). Model adopted a 2cluster pattern observed in the analysis of the EAGLE study described later, with clusters 1 and 2 consisting of genotypes in red and blue colors, respectively (Figure 6), and with for cluster 1, and for cluster 2. The correlation between E and G was defined similarly as before. For a subject with genotype in cluster 1, the probabilities of being unexposed () or exposed () were 0.7 and 0.3; for a subject with genotype not in cluster 1, those probabilities were 0.4 and 0.6.
Under each disease model, we simulated 500 datasets, with each consisting of 600 cases and 600 controls. The summary for the power comparison results is given in Table 5. It can be seen from the table that the proposed test has a clear advantage over two other standard interaction tests, especially when the underlying clustering pattern in the disease risk cannot be properly approximated by a single SNP or PC (e.g., under the model ). Even under the model where the single SNPenvironment interaction test based on the 10^{th} SNP is most optimal, due to the multiple comparison adjustment, the minPSNP test is only slightly more powerful than the proposed test. Under the model where the functional SNP (the 10^{th} SNP) has a dominant effect in its interaction with E, the minPSNP test compares less favorably with the proposed test since each of single SNPenvironment interaction test considered in the minPSNP global test spends one more df than necessary (as there are only two cluster in the model ). The minPPC test has the worst overall performance as it is very sensitive to its underlying assumption that the genetic effect is linearly correlated with one of the PC direction.
Application in the EAGLE Study
We applied the proposed method to study the joint effect of cigarette smoking intensity (number of packs per day) and genetic variants in chromosome region 15q25.1 on lung cancer risk, using data generated by the EAGLE study. We focused on former and current smokers who had been genotyped on the 15 tagging SNPs. We also removed, as outliers, 8 subjects who had smoked more than 3 packs of cigarette per day. The final dataset for our analysis consisted of 1326 controls and 1720 cases. In the analysis we treated smoking intensity as a continuous variable and adjusted for the effects of gender and of age at diagnosis (categorized as: < = 60, 61–70, >70). We used a Bayesian model that allowed for GE interaction, unless specified otherwise.
To determine the number of clusters, we ran the MCMC algorithm 20 times with different random seeds for each K, , in order to estimate the Monte Carlo standard error for DIC. Figure 7 shows the DIC values for each K over 20 replications. Based on the 1 SE rule given by (7), the optimal number of clusters was found to be 2, with its averaged DIC value being 3810.5. The partitioning of subjects into 2 clusters based on our proposed clustering algorithm is very consistent among 20 replications. The discrepancy rate between assignments from any two runs, defined as the proportion of subjects being assigned to two different clusters, is less than 1.4% under .
Below we present the posterior summary based on a single run of our algorithm. To present the summary result, we first conducted a PC analysis on the casecontrol samples using genotypes at the 15 tagging SNPs as coordinates. In Figure 6, we plotted subjects by their first 2 PCs, with different colors representing their cluster assignments under . The cluster assignment was performed with the ensemble averaging method described above. Since subjects with the same genotype were represented by one point in the first 2PC space, we can think of each point as either a unique genotype or a group of subjects sharing that genotype. There are 2240 subjects with 410 unique genotypes grouped into one cluster (shown in red in Figure 6) and 806 subjects with 252 unique genotypes grouped into another cluster (shown in blue in Figure 6). Notice that the two clusters are defined in term of estimated risk coefficient values (), but not in term of genotypes distribution in the PC space. That is why these two clusters do not appear to be well separated in the PC space.
To summarize the effect of smoking on a subject with genotype h, , we focused on , the posterior median of , with being the coefficient for smoking in the risk model assigned for a subject with genotype h. We can interpret as the posterior median of the OR associated with one more pack of cigarettes per day for a subject with genotype h. To summarize the genetic effect of genotype h, we used , the ratio of the posterior median of versus the posterior median of , with being the intercept for the risk model assigned for a subject with genotype h and being the chosen reference genotype. We chose the reference genotype as the one having the lowest posterior median of . We can interpret as the posterior median OR between genotype h and the reference genotype .
In Figure 8, we show a smoothed surface plot for the smoking effect measured by , and the genetic effect measured by for each genotype in the first 2PC space, based on models run under . The smooth surface was estimated by the kriging method with each genotype's top 5 PCs (which account for over 85% of the total variation) as predictors. The plots were generated using the functions provided in the R package called “fields” [35]. It is evident from Figure 8 that neither the smoking effect nor the genetic effect is uniformly distributed over the genotype space. The smoking effect on a subject depends on his or her genotype. It is considerably lower on subjects who have their genotypes projected on the lower part of the PC space than on subjects with their genotypes projected elsewhere.
Some understanding of the 2^{nd} PC is helpful for interpreting the patterns observed in Figure 8. From Table 1, we can see that the 2^{nd} PC is driven mainly by the 8 SNPs with absolute loading values larger than 0.18, with the remaining having loading values less than 0.07. These 8 SNPs also turn out to be the ones that are most significantly associated with lung cancer risk (Table 1). We point out the fact that the loading value for each of the 8 SNPs is negative if the SNP's major allele is the highrisk allele, positive if its minor allele is the highrisk allele. As a result, a genotype's 2^{nd} PC coordinate is positively correlated with its total number of risk alleles among the 8 SNPs (see Figure S5). Genotypes with smaller 2^{nd} PC coordinates tend to have fewer highrisk alleles and are expected to have smaller ORs than genotypes having larger 2^{nd} PC coordinates.
As a comparison, we also fit model (3), the Bayesian model without GE interaction. The optimal model based on the 1 SE rule was again achieved at , with its averaged DIC value being 3817.5 over 20 runs (Figure S6). The DIC is noticeably higher than that obtained under the Bayesian model allowing for GE interaction (DIC = 3810.5). This suggests that the model allowing for GE interaction fits the data better than the model without the GE interaction.
Finally, to demonstrate the existence of GE interaction further, we applied the resamplingbased test described in the Methods section. The observed test statistic was . We applied the resamplingbased test by allowing the number of clusters to vary from 2 to 5. The estimated Pvalue based on 2000 bootstrap steps was 0.016, suggesting that there is a significant GE interaction. On the other hand, for each of the 32 relatively common SNPs (MAF>0.04) in this considered 15q25.1 region, we conducted the standard SNPsmoking interaction test (2 df) based on the logistic regression model by treating the genotype as a threelevel categorical variable. The smallest nominal Pvalue we observed was 0.021. The global minPSNP test had a Pvalue of 0.29, which was well above the 0.05 level. We also conducted the PCsmoking interaction test by modeling each PC as a continuous variable. The smallest nominal Pvalue was 0.058. The Pvalue from the global minPPC test was 0.62.
Discussion
Our new method can evaluate gene–environment interaction at the gene/region level by integrating information observed on multiple SNPs in the considered gene/region with measures of environmental exposure. This method reduces the impact of loss of efficiency and bias from the misclassification error inherent in the singlemarker approach that studies the environmental risk factor and one SNP at a time. The method provides a coherent inference framework that allows us to evaluate the environmental effect on different strata defined by the multilocus genotype. A heterogeneous environmental effect across different strata would signal the presence of gene–environment interaction. We also propose a resamplingbased test to formally test for the existence of gene–environment interaction.
Genetic variations within the 15q25.1 region have been shown to be associated with both lung cancer risk and smoking behaviors, such as the smoking intensity. Our analysis based on the EAGLE casecontrol study indicates that the smoking effect varies according to the subject's genetic makeup in the 15q25.1 region. The proposed resamplingbased test also supports the existence of gene–environment interaction (Pvalue = 0.016). On the other hand, two conventional tests of gene–environment interaction based on the singlemarker and singlePC approaches are far from significant. This highlights the advantage of our proposed method over standard approaches.
Accurate assessment of the environment risk exposure in the evaluation of gene–environment interaction is as important as identification of functional genetic variants or their proper surrogates [36]. In the EAGLE populationbased casecontrol study, the information on smoking collected near the time of diagnosis is likely to provide a more accurate measure of risk exposure than information collected in other prospective cohort studies, such as the Prostate, Lung, Colorectal, and Ovarian (PLCO) Screening Trial [37], which does not reflect subsequent changes in smoking behavior like quitting. For example, we observed a much larger OR for smoking one more pack of cigarette per day (3.7, z statistic = 15.58) in the EAGLE study than in a lung cancer casecontrol study nested within the PLCO cohort (1.84, z statistic = 8.87), which includes 1390 lung cancer cases and 1924 controls. We also could not find evidence for smoking15q25.1 interaction in this PLCO nested casecontrol study by using our proposed method. The difference in the smoking OR estimates and the absence of gene–environment interaction evidence using our method in the PLCO study may be a consequence of greater misclassification error in the smoking information assessment in the cohort study (PLCO) than in the casecontrol study (the EAGLE study).
In our method, we adopted the Potts model for the latent allocation vector for cluster assignment, as did Green and Richardson [6]. We used the MCMH algorithm [12] for simulating the regulating parameter of the Potts model. The MCMH algorithm overcomes the intractable normalizing constant problem that cannot be handled by the standard MH algorithm, while ensuring the consistency of the Monte Carlo estimates. Furthermore, this MCMH algorithm can readily be used for Potts models with certain restrictions on the sampling space by modifying the MH step to generate allocation vectors accordingly.
We proposed to use the +1 SE rule (or the +1 rule) based on DIC to identify the optimal number of clusters. We found through simulation studies that this approach works quite well. An alternative approach would be to treat the number of clusters as a random variable and integrate it into a Bayesian model [6]. A reversible jump MCMC algorithm [38] could be used to facilitate the move between sampling spaces with different dimensions. It would be interesting to compare the performance of these approaches, especially in term of their abilities to identify the proper number of clusters.
The proposed procedure relies upon a userspecified similarity metric to define the neighborhood among different genotypes in the Potts model. This neighborhood structure is used to induce the spatial dependency in the cluster assignment. In this paper, for a given genotype, we chose its 4 nearest genotypes as its neighbors. We found that the analysis result was not very sensitive to how the neighborhood is defined as long as the chosen Markov structure can generate an appropriate spatial dependence. For example, we reanalyzed the EAGLE study with two other types of Markov structures: one using the 3 nearest genotypes as neighbors, and the other one using the 5 nearest genotypes as neighbors. We show in Figure S7 the comparison of the posterior medians of the genetic effect () and the smoking effect () estimated for each subject between each of the new runs and the original runs under . It is clear that results from these three analyses are quite similar.
We used the prospective likelihood model in the Bayesian framework for casecontrol studies, even though the data were collected retrospectively according to a subject's disease status. According to [23], [39], given certain priors for parameters in the retrospective model, we can derive corresponding priors for the prospective model parameters that yield the same marginal posterior distributions as their retrospective counterparts. In this paper we consider both normal and uniform distributions as priors for the prospective model parameters. Although we cannot derive explicitly their corresponding priors for the retrospective model, our simulation studies demonstrated that the proposed prospective approach indeed had the desired performance when applying to data generated from casecontrol studies. The normal prior has also been used with the prospective likelihood model on casecontrol studies in other contexts (e.g., [40], [41]).
We have created an R package called BaDGE (Bayesian model for Detecting Gene Environment interaction) implementing the proposed Bayesian model and the associated postprocessing procedures. The package is freely available from the website http://dceg.cancer.gov/bb/tools/badge. Currently, we consider only binary or continuous environmental exposure variable. It is straightforward to expand the algorithm to deal with a categorical (with more than 2 levels) environmental variable. To use the program, the user needs to specify priors (normal or uniform distribution) for parameters in the risk model and a prior (a uniform distribution) for the regulating parameter in the Potts model. The program will be expanded further to incorporate other prior functions. The running time for 200,000 iterations using 50 auxiliary samples in the MCMH algorithm on a dataset of 1000 cases and 1000 controls, with approximate 450 unique genotypes, is about 14 minutes on a Linux machine with the 2.8 GHz AMD Opteron processor. For a dataset with a large number of genotypes (e.g., over 1000), we can reduce the computing time by first dividing the whole genotype space into a few hundreds of subgroups through the PAM clustering algorithm [30] and then treating subgroups as genotypes in the proposed MCMC procedure. For example, the running time on the same testing example mentioned above decreases to 8 minutes if we regroup the genotypes into 250 unique subgroups. Another way to reduce the total number of genotypes is to limit tagging SNPs to those with a relatively large minor allele frequency. The resamplingbased test could be computationally intensive for a dataset like the EAGLE study. We are still investigating whether it is possible to replace the computationally intensive resamplingbased procedure with a onestep multiple comparison adjustment approach, similar to one used in [42], for the assessment of the statistical significance level.
Comparing to the standard singlemarker or principal component based approaches, our proposed method is more computationally intensive, but it has several important advantages. First, it offers a more flexible way to model gene–environment interaction, especially complicated ones that cannot be depicted properly by the singlemarker or PC based approaches, such as in situations where genetic variants (might or might not be directly genotyped) in multiple loci within the considered region interplay with the environment risk factor. Second, it provides an estimate of the environmental effect on subjects with a given joint genotype profile. This could be potentially useful to generate new hypotheses on how the gene and environment risk factor interacts. Third, as shown in the simulation studies and real application, the proposed resamplingbased test derived from the Bayesian model has a more robust performance than the standard singlemarker, or PC based testing procedures. For example, in situation where the single marker test is most appropriate, i.e., there is only one functional locus in the considered region, the proposed test is only slightly less powerful than the singlemarker test. But it has a considerable power advantage over the standard tests when the underlying disease risk pattern cannot be properly approximated by a single SNP or PC.
Although our method is described in the context of gene–environment interaction detection, it is in fact quite general. It provides a general strategy for studying the interaction between an observed risk factor and a latent categorical variable not directly observed or clearly defined, but one that can be derived from a set of observed relevant covariates. For example, our method can be used with some minor modifications to evaluate the interaction between smoking behavior (e.g., smoking intensity) and a latent dietary pattern that can be derived from food frequency questionnaires. Also, it is possible to extend our method to study genegene interaction by introducing two latent factors to capture the effect of both genes, as was done in [43].
Supporting Information
Zdroje
1. HindorffLAJunkinsHAHallPNMehtaJPManolioTA 2011 A catalog of published genomewide association studies. Available at: www.genome.gov/gwastudies. Accessed August, 2011
2. LindstromSSchumacherFSiddiqATravisRCCampaD 2011 Characterizing associations and SNPenvironment interactions for GWASidentified prostate cancer risk markersResults from BPC3. PLoS ONE 6 e17142 doi:10.1371/journal.pone.0017142
3. RothmanNGarciaClosasMChatterjeeNMalatsNWuX 2010 A multistage genomewide association study of bladder cancer identifies multiple susceptibility loci. Nat Genet 42 978 984
4. SpitzMRAmosCIDongQLinJWuX 2008 The CHRNA5A3 region on chromosome 15q24–25.1 is a risk factor both for nicotine dependence and for lung cancer. J Natl Cancer Inst 100 1552 1556
5. MooreJHAsselbergsFWWilliamsSM 2010 Bioinformatics challenges for genomewide association studies. Bioinformatics 26 445 455
6. GreenPRichardsonS 2002 Hidden Markov models and disease mapping. J Am Stat Assoc 97 1055 1070
7. PottsRB 1952 Some generalized orderdisorder transformations. Cambridge Philos Soc Math Proc 48 106 109
8. ThomasDCStramDOContiDMolitorJMarjoramP 2003 Bayesian spatial modeling of haplotype associations. Hum Hered 56 32 40
9. MoltchanovaEVPitkaniemiJHaapalaL 2005 Potts model for haplotype associations. BMC Genet 6 Suppl 1 S64
10. LiuJS 2002 Monte Carlo Strategies in Scientific Computing New York Springer
11. RobertCPCasellaG 1999 Monte Carlo Statistical Methods New York Springer
12. LiangFLiuCCarrollRJ 2010 Advanced Markov Chain Monte Carlo Methods: Learning from Past Samples Wiley
13. LiangF 2008 Clustering gene expression profiles using mixture model ensemble averaging approach. JP J Biostat 2 57 80
14. MolitorJParathomasMJerrettMRichardsonS 2010 Bayesian profile regrression with an application to the national survey of children's health. Biostatistics 11 484 498
15. LandiMTChatterjeeNYuKGoldinLRGoldsteinAM 2009 A genomewide association study of lung cancer identifies a region of chromosome 5p15 associated with risk for adenocarcinoma. Am J Hum Genet 85 679 691
16. AmosCIWuXBroderickPGorlovIPGuJ 2008 Genomewide association scan of tag SNPs identifies a susceptibility locus for lung cancer at 15q25.1. Nat Genet 40 616 622
17. ThorgeirssonTEGellerFSulemPRafnarTWisteA 2008 A variant associated with nicotine dependence, lung cancer and peripheral arterial disease. Nature 452 638 642
18. ThorgeirssonTEGudbjartssonDFSurakkaIVinkJMAminN 2010 Sequence variants at CHRNB3CHRNA6 and CYP2A6 affect smoking behavior. Nat Genet 42 448 453
19. SacconeNLCulverhouseRCSchwantesAnTHCannonDSChenX 2010 Multiple independent loci at chromosome 15q25.1 affect smoking quantity: a metaanalysis and comparison with lung cancer and COPD. PLoS Genet 6 e1001053 doi:10.1371/journal.pgen.1001053
20. LiuJZTozziFWaterworthDMPillaiSGMugliaP 2010 Metaanalysis and imputation refines the association of 15q25 with smoking quantity. Nat Genet 42 436 440
21. ConsortiumTaG 2010 Genomewide metaanalyses identify multiple loci associated with smoking behavior. Nat Genet 42 441 447
22. CaporasoNGuFChatterjeeNShengChihJYuK 2009 Genomewide and candidate gene association study of cigarette smoking behaviors. PLoS ONE 4 e4653 doi:10.1371/journal.pone.0004653
23. StaicuA 2010 On the equivalence of prospective and retrospective likelihood methods in casecontrol studies. Biometrika 97 990 996
24. SeamanSRRichardsonS 2001 Bayesian analysis of casecontrol studies with categorical covariates. Biometrika 88 1073 1088
25. BorgsCChayesJTFriezeAKimJHTetaliP Torpid mixing of some Monte Carlo Markov chain algorithms in statistical physics; 1999; Washington, DC
26. MillerP 1993 Alternative to the Gibbs sampling scheme. Tech. Report, Institute of Statistics and Decision Science
27. OgataYTanemuraM 1984 Likelihood analysis of spatial point patterns. J Royal Stat Soc, Ser B 46 496 518
28. SpiegelhalterDJBestNGCarlinBPvan der LindeA 2002 Bayesian measures of model complexity and fit (with discussion). J R Stat Soc Ser B 64 583 639
29. BreimanLFriedmanJHOlshenRAStoneCJ 1984 Classification and Regression Trees Monterey Wadsworth and Brooks/Cole
30. KaufmanLRousseeuwPJ 2005 Finding Groups in Data: An Introduction to Cluster Analysis Hoboken, NJ WileyInterscience
31. EfronBTibshiraniRJ 1993 An Introduction to the Bootstrap New York Chapman & Hall
32. YuKLiQBergenAWPfeifferRMRosenbergPS 2009 Pathway analysis by adaptive combination of Pvalues. Genet Epidemiol 33 700 709
33. GelmanARubinDB 1992 Inference from iterative simulation using multiple sequences. Stat Sci 7 457 511
34. PlummerMBestNCowlesKVinesK 2006 CODA: Convergence diagnosis and output analysis for MCMC. R News 6 7 11
35. Fields Development Team 2006 Fields: Tools for Spatial Data. National Center for Atmospheric Research. Boulder, CO
36. GarciaClosasMRothmanNLubinJ 1999 Misclassification in casecontrol studies of gene–environment interactions: assessment of bias and sample size. Cancer Epidemiol Biomarkers Prev 8 1043 1050
37. HayesRBSigurdsonAMooreLPetersUHuangWY 2005 Methods for etiologic and early marker investigations in the PLCO trial. Mutat Res 592 147 154
38. GreenP 1995 Reversible jump Markov chain Monte Carlo computation and Bayesian model determination. Biometrika 82 711 732
39. SeamanSRRichardsonS 2004 Equivalence of prospective and restrospective models in the Bayesian analysis of casecontrol studies. Biometrika 91 15 25
40. CostainDA 2009 Bayesian partitioning for modeling and mapping spatial casecontrol data. Biometrics 65 1123 1132
41. RafteryAERichardsonS 1996 Model selection for generalized linear models via GLIB, with application to epidemiology. BerryDAStanglDK Bayesian Biostatistics New York Marcel Dekker 321 354
42. TangWWuXJiangRLiY 2009 Epistatic module detection for casecontrol studies: a Bayesian model with a Gibbs sampling strategy. PLoS Genet 5 e1000464 doi:10.1371/journal.pgen.1000464
43. ChatterjeeNKalayliogluZMoslehiRPetersUWacholderS 2006 Powerful multilocus tests of genetic association in the presence of genegene and gene–environment interactions. Am J Hum Genet 79 1002 1016
Štítky
Genetika Reprodukční medicínaČlánek vyšel v časopise
PLOS Genetics
2012 Číslo 1
Nejčtenější v tomto čísle
Tomuto tématu se dále věnují…
 Parallel Mapping and Simultaneous Sequencing Reveals Deletions in and Associated with Discrete Inherited Disorders in a Domestic Dog Breed
 GenomeWide Assessment of AURich Elements by the ARE Algorithm
 An siRNA Screen in Pancreatic Beta Cells Reveals a Role for in Insulin Production
 Nucleolar Association and Transcriptional Inhibition through 5S rDNA in Mammals
Zvyšte si kvalifikaci online z pohodlí domova
Kurz originály vs. generika
nový kurzVšechny kurzy