Skip to main content
  • Technical advance
  • Open access
  • Published:

Design considerations in a sib-pair study of linkage for susceptibility loci in cancer

Abstract

Background

Modern approaches to identifying new genes associated with disease allow very fine analysis of associaton and can be performed in population based case-control studies. However, the sibpair design is still valuable because it requires few assumptions other than acceptably high penetrance to identify genetic loci.

Methods

We conducted simulation studies to assess the impact of design factors on relative efficiency for a linkage study of colorectal cancer. We considered two test statistics, one comparing the mean IBD probability in affected pairs to its null value of 0.5, and one comparing the mean IBD probabilities between affected and discordant pairs. We varied numbers of parents available, numbers of affected and unaffected siblings, reconstructing the genotype of an unavailable affected sibling by a spouse and offspring, and elimination of sibships where the proband carries a mutation at another locus.

Results

Power and efficiency were most affected by the number of affected sibs, the number of sib pairs genotyped, and the risk attributable to linked and unlinked loci. Genotyping unaffected siblings added little power for low penetrance models, but improved validity of tests when there was genetic heterogeneity and for multipoint testing. The efficiency of the concordant-only test was nearly always better than the concordant-discordant test. Replacement of an unavailable affected sibling by a spouse and offspring recovered some linkage information, particularly if several offspring were available. In multipoint analysis, the concordant-only test was showed a small anticonservative bias at 5 cM, while the multipoint concordant-discordant test was generally the most powerful test, and was not biased away from the null at 5 cM.

Conclusion

Genotyping parents and unaffected siblings is useful for detecting genotyping errors and if allele frequencies are uncertain. If adequate allele frequency data are available, we suggest a single-point affecteds-only analysis for an initial scan, followed by a multipoint analysis of affected and unaffected members of all available sibships with additional markers around initial hits.

Peer Review reports

Background

The sib pair design has been widely used in human studies for mapping genes that affect both quantitative and dichotomous traits. The objective of sibling studies is to determine whether the siblings (or other close relatives) tend to express the same disease phenotype (or similar values of a quantitative trait) when they share a commonly inherited genomic segment measured by genetic markers. Because two loci located close together on the same chromosome tend to be inherited together, sibs who have inherited an allele predisposing them to disease will also inherit a variety of other genetic characteristics located in the same genomic segment as the gene responsible for disease susceptibility. By examining, in a set of pairs of affected sibs, the degree of sharing of genetic marker alleles located throughout the genome, researchers can identify regions that are shared more often than would be expected by chance. This excess allele sharing constitutes the statistical evidence for linkage between the shared markers and putative disease susceptibility loci.

The popularity of the sib-pair and related small-family study designs reflects several attractive characteristics. For highly penetrant alleles, extended families can often be recruited and so provide a powerful source of information for disease localization and fine mapping. However, for complex diseases that result from interactions among loci or that result from both genetic and environmental effects, large pedigrees that include multiple affected individuals may be rare and may not reflect a single etiologically-related genetic factor. Since the pioneering work of Haseman and Elston [1] on quantitative trait mapping, many alternative approaches and extensions to the design have been developed to handle multilocus data [2], extended relative pairs [3–6], consideration of environmental risk factors [7–9], and other situations encountered in studies of complex diseases. In concept, for the study of complex diseases, the design and execution of a sib-pair study is simple. Straightforward power calculations (e.g. [10]) suggest that adequate power to detect linkage might be obtained with relatively modest sample sizes even for complex, low-penetrance susceptibility syndromes. Readily available software packages [11] obtain exact IBD sharing distributions and compute linkage tests using exact methods without requiring explicit specification of an inheritance model, penetrance function, or disease allele frequencies. Numerous authors have observed that nonparametric or model-free linkage statistics, in spite of their name, make hidden assumptions about mode of inheritance and penetrance (e.g., [12–14]) which determine the situations in which they become most powerful. Nevertheless, these methods have been highly popular because of the ease in implementing them and in interpreting the results, as well as the perception that they remain powerful across a broad spectrum of underlying genetic mechanisms.

The modern approaches to identifying new genes associated with disease allow very fine analysis of associaton and can be performed in population based case-control studies. However, the sibpair design is still valuable because it requires few assumptions other than acceptably high penetrance to identify genetic loci. There remains skepticism about relying solely on genome-wide-association studies [15], and sib-pair studies continue to be utilized and published in the literature [16–18]. While association based studies have provided many novel insights into the genetic architecture of complex diseases, they require that linkage disequilibrium is present between genetic markers and disease causing variants. Such a requirement might not be met for diseases that are due to susceptibility loci undergoing recurrent mutations [19] or for genomic regions that show copy number variation and so do not yield reliable SNP data without the implementation of specialized procedures because of deviations from Hardy-Weinberg disequilibrium [20].

Sibships and small families are relatively easy to identify and recruit (compared with designs that make use of large multiplex families). Moreover, a number of familial disease registries and high-risk clinics have been established and have enrolled substantial numbers of sib pairs and other groupings of affected relatives, so that in many cases recruitment has already occurred. In practice, however, the design of an effective small-family linkage study requires more care than is immediately apparent, particularly for complex diseases such as cancer, in which late onset, incomplete penetrance, large numbers of phenocopies, gene-environment interaction, and locus heterogeneity must be anticipated. The purpose of this paper is to evaluate the impact of choices of family sampling strategies in selecting the design of a study aimed at identifying novel genetic factors that predispose individuals to colon cancer. The study is a collaborative effort by two National Cancer Institute-sponsored consortia investigating the genetics of cancer: the Cancer Genetics Network (CGN) and Cooperative Family Registry for Colon Cancer Studies (CFRCCS).

All population based studies of colon cancer have documented its strong familiality [21–24]. Historical cohort studies show an approximately 2.5 fold increased risk for colorectal cancer in the first degree relatives of colorectal cancer cases compared to first degree relatives of unaffected controls [25–28]. Nongenetic factors specifically implicated as protecting individuals from risk for colon cancer include use of nonsteroidal anti-inflammatory drugs, a diet rich in leafy vegetables, and exercise [29–34]. Although these environmental risk factors have been identified as substantially affecting the risk for colon cancer they display only a weak correlation in family members, which is insufficient to explain the high familial risk [35]. Moreover, Khoury, et al. [36] point out that both the correlations of exposure among siblings and relative risks due to shared exposures need to be very large in order to produce observable increases in relative risk to siblings of cases. It seems unlikely that such a combination of highly correlated exposures and large relative risk exists for colorectal cancer.

Methods

The choice of sampling schemes for a colon sibpair study requires evaluation, as several different options exist simultaneously for the sampling plan (how many families and which relatives to sample), disease model (penetrance, allele frequency, etc), and statistical test of linkage. These aspects, in addition to the method of generating the data sets for the simulations comprise the methods of determining an optimal design strategy for a colon sibpair study. In our analysis of design issues we have pursued a deterministic simulation approach. The first step was to check that the tests we considered had appropriate size, using extensive simulations. For those tests that were valid, we then performed a moderate number of simulations of a large number of families, to obtain the noncentrality parameters describing the behavior of each design configuration and test. We were then able to compare the attributes of these studies across the different design configurations genetic models and tests by fitting regression models, as further described below.

Disease Model Parameter Choices

Genetic Heterogeneity

The genetic basis of many complex human diseases, including some common cancers, is known to include mutations in loci that confer a high penetrance to carriers. In order to minimize the impact that such genetic heterogeneity may have on the statistical efficiency to identify novel loci, gene-hunting studies are often restricted to those cases that have been determined not to be related to any known susceptibility locus. For example, the second susceptibility locus for breast cancer, BRCA2, was mapped by Wooster et al. [37] based on high-risk families for whom BRCA1 linkage was excluded. Genetic syndromes such as juvenile polyposis, Peutz-Jeghers syndrome and familial adenomatous polyposis can be readily eliminated prior to sample collection on the basis of phenotypic characteristics. However, mutations in mismatch repair (MMR) loci such as hMSH2 or hMLH1 cannot be excluded without performing molecular studies. (Measures of tumor microsatellite instability or immunohistochemistry can be helpful in identifying likely carriers, but are neither fully sensitive nor specific.) Estimating the proportion of affected families that might be excluded from analysis because they carry MMR mutations is difficult. Population-based estimates of the prevalence of germ-line MMR mutations among subjects diagnosed with colorectal cancer vary widely even within populations of European descent [38–41], and only a few estimates are available for other ethnic groups [42, 43]. Moreover, recruiting from high-risk clinics may lead to disproportionate over-representation of families who have MMR mutations. One large study in Finland [44] found that 12% of affected sib pairs (ASP) showed MMR defects.

The basic assumption for our studies was thus a two-locus non-interacting model, with a rare high-penetrance gene (e.g. hMSH2/hMLH1 for HNPCC in the case of colon cancer), unlinked to the search region for new loci and a more common but less penetrant gene being sought by the linkage analysis. We also evaluated the effect of experimental elimination of a previously-known predisposition syndrome such as HNPCC. We investigated both the power and the relative efficiency of different designs under a range of assumptions about the contribution of an additional unlinked locus. The single unlinked locus with varying allele frequency and penetrance that we simulated could also approximate the effects of a few unlinked noninteracting alleles. Although our efforts focused on a study of colorectal cancer, the general issues identified above are similar to considerations encountered in the design of genetic studies of other common conditions such as other cancers, diabetes, hypertension and many other chronic diseases that arise from both environmental and genetic causes.

Allele Frequency and Penetrance

Most of the models we studied include a two-locus noninteracting model for which neither locus had been molecularly determined and only one was linked to the markers under consideration. The unlinked locus varied in allele frequency and penetrance. In some simulations the unlinked locus had no effect on disease, but in others the penetrance and/or allele frequency were assumed to be greater than that of the linked locus. The two loci contributed multiplicatively in a logistic model for penetrance of the form

logit Pr(Y = 1|G 1, G 2) = α + β1Dom(G 1) + β2Dom(G 2)

where Dom(G) indicates a dominant coding of the genotype, i.e. presence of one or two copies of the deleterious allele identically increases the risk of the disease. We also simulated some situations in which only one autosomal dominant predisposition syndrome was present in the population.

In the U.S. population, lifetime risks for colorectal cancer are approximately 2.5–5 percent [45]. In the context of a high-risk cancer clinic, however, patients are frequently seen at younger ages, and hence the background risk of colorectal cancer among sibships ascertained through high-risk clinics is considerably less than 5%. We set the natural log of the background rate of colorectal cancer in our simulations to α = -4, so that the overall population prevalence of disease was approximately 2%. Objective estimates of allele frequencies and relative risks for unknown mutations are not available, so we chose values that were consistent both with frequencies of known mutations [46, 47] and with population attributable risk estimates for familial colorectal cancer [24, 48]. As an example, with an allele frequency of q 1 = 0.003 and a log relative risk of β1 = 3 (relative risk = 20.1), q 2 = 0.001 and β2 = 4.6 (relative risk = 99.5), the resulting penetrances are 0.018 for carriers of neither mutation, 0.268 for carriers of a mutation in the linked gene, 0.646 for carriers of a mutation in the unlinked gene, and 0.973 for carriers of both mutations. The linked locus accounts for approximately 7.2% of colorectal cancers and the unlinked locus accounts for approximately 6.0% of colorectal cancers. Table 1 lists the parameters that we used in combinatios for the simulations, along with the values we assigned in various simulations.

Table 1 Parameters employed in simulations

Sampling Plans

The primary concern in the design of CFRCCS-CGN colon cancer study is to maximize the relative efficiency per genotype, i.e., to find the combination of family structures and numbers of families that will produce the greatest power for a given number of genotypings. While the number of ASPs available for study will affect the power of the study, at the time when we were designing the study, approximately 425 ASPs (plus about 400 other relative pairs) were already available from the combined CFRCCS resources, and samples were already available from many of the potential subjects. An additional 500+ sib pairs were anticipated from the CGN sites. Thus, the primary constraint was the total cost of genotyping in a full genome scan, not the number of families. We therefore chose to concentrate on four main questions of efficiency: 1) whether (and how many) unaffected sibs should be genotyped, 2) how critical the absence of parental genotypes is to the efficiency of the analysis; 3) the relative loss in efficiency of genotyping spouses and offspring of a deceased affected sib, and 4) how different strategies for addressing genetic heterogeneity might affect these efficiency comparisons.

Although our primary interest was in the relative efficiency per genotype, we also wished to observe the effects on overall power and sample size requirements. We were particularly interested in the question of whether the total number of families that might be available for study in this large collaborative project would be adequate for the detection of linkage given a set of realistic assumptions concerning the genetics of colorectal cancer susceptibility.

Linkage Tests for Concordant and Discordant Sib Pairs

Model-free linkage analysis is usually based on a comparison of the observed number of alleles at a marker locus shared identical by descent (IBD, i.e., derived from a common ancestor) between pairs of relatives with given phenotypes with that expected simply on the basis of their relationships. However, IBD status can only be determined unambiguously when both parents are different heterozygotes. Since late-onset diseases such as colon cancer severely restrict the availability of parental genotypes, the first step is to estimate the IBD probabilities from the marker data on all available pedigree members, using statistical approaches such as those as implemented in such software as GENEHUNTER [49], GENIBD [50], Simwalk 2 [51], or Merlin [52]. The family structure to be analyzed can include parents, affected and unaffected sibs, as well as the spouse and offspring of an unavailable affected sib if they were sampled.

For the simulation studies reported here, we compared the power and efficiency of two tests: the classic "means test" for linkage [53], which compares the observed proportion of alleles shared IBD against the expected proportion of 0.5; and a modified means test which compares the observed proportion of alleles shared IBD among ASPs with the observed proportion shared IBD among discordant sib pairs. The latter test has been suggested to control for potential bias (as discussed below) as well as to improve power. For this analysis, we followed the general approach described by Guo and Elston [54] but with modifications. Since combinations of pairs of IBD values within a family are not independent [55], we constructed the test using the mean IBD sharing among pairs of each type (concordant affected and discordant) within each family. We allowed for the correlation in mean IBD values for the concordant affected and discordant sib pairs by constructing a paired t-test that allowed for the correlation in mean IBD values between the sets of concordant and discordant pairs. Specifically, letting p fjki denote the estimated probability that sib pair (j, k) in family f = 1,. . .,F shares i = 0,1,2 alleles IBD, we first computed the mean p cf of (p fjk1/2 + p fjk2) in all affected pairs in family f and the corresponding mean p df in discordant pairs in the same family. We then computed the means p c and p d and standard deviations s c and s d of these quantities across families, and conducted a standard one-sample t-test comparing p c to 1/2 and a two-sample t-test comparing p c to p d , where F is the total number of families in the sample:

Z c = √F (P c - 1/2)/S c

Z d = √F (P c - P d )/√(S c 2 + S d 2)

both of which are tested against a standard Normal distribution. Note Z d does not take account of the correlation in IBD status between the two types of pairs within a sibship, so we used a paired t-test to allow for this, i.e.,

Z p = √F (P cf - P df )/S w

where s w denotes the empirical standard deviation of p cf - p df across families.

Simulation Methods

For a given family structure and choice of parameters (described below), we simulated phenotype and marker data as follows. First, we generated genotypes G at the two disease loci by sampling from their respective population distributions (commonly called gene dropping). We then retained the simulated genotype vector with probability Pr(Y|G), where Y = (1,...,1,0,...,0) denotes the phenotype vector of the sibship under the design being considered (with D affected (Y i = 1) and U unaffected (Y i = 0) members). This process was continued until the total sample size of F families was ascertained. For each family structure, marker data were then simulated conditional on the genotypes at the linked locus. We assumed each marker locus had four alleles and that it was linked to the disease locus with two different recombination values of 5 and 10 centiMorgans between the disease and marker loci.

Regardless of the number of markers, marker alleles were simulated by dropping, for each parent, the parental allele corresponding to the chromosome of origin of the allele inherited at marker l - 1 with probability 1 - θ l , or the opposite chromosome with probability θ l , for marker loci l = 1 ... L, l = 0 at the disease locus, where θ l is the probability of recombination between loci l - 1 and l. All marker alleles were independent of the second (unlinked) disease locus, if one was employed in a given simulation.

We computed IBD probabilities for each marker locus by enumerating all possible alleles for each untyped founder and all possible segregation indicators for all nonfounders that are consistent with the observed marker data. We then accumulated the probabilities p fjki of each of these configurations into an array [56]. These probabilities depend upon the population marker allele frequencies, which we estimated in each replicate by a simple counting procedure from all the subjects available for study [57]. We did not adjust for correlations among family members as the estimates of allele frequencies so obtained are consistent [57] and are accurate for the large number of families we are here evaluating in each simulation.

In order to compare the test size of each linkage test we employed, we carried out 10,000 replicate simulations of F = 100 families under the null hypothesis of no linkage between the marker and either disease locus. For these analyses, we simulated families of two affected sibs, both genotyped, and two unaffected sibs, both genotyped.

We also considered the behavior of multipoint variants of the Z c and Z p statistics under the null. To calculate these, we initially simulated six markers with four alleles each spaced at 10 cM intervals, and obtained multipoint estimates of pairwise IBD sharing at 20 cM from the origin using the program Merlin [58], then calculated Z mc and Z mp using the formulas given above. The disease genes were unlinked to the six markers. We then repeated the simulations after reducing the marker distance by half. We did not go below 5 cM.

For each non-null simulation, we generated 20 replicate simulations of F = 500 families each. As a measure of cost efficiency per genotype, we divided the average Z c 2 (or Z p 2) scores across the 20 replicates by the number of genotypes required, and reported the ratio (times 100) of this value to that based on Z c 2 for families consisting only of two sampled affected sibs. We call this the asymptotic relative efficiency (ARE). We chose to generate 20 replicate observations for any given combination of parameter values because we wished to simulate a wide variety of non-null conditions, while producing an adequate number of replicate observations to obtain reliable estimates of noncentrality parameters.

The number of families F required for a desired level of power sample was calculated in the standard way [59] by solving

Z α + Z 1 − β F = Z s i m F s i m MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xI8qiVKYPFjYdHaVhbbf9v8qqaqFr0xc9vqFj0dXdbba91qpepeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaqcfa4aaSaaaeaacqWGAbGwdaWgaaqaaiabeg7aHbqabaGaey4kaSIaemOwaO1aaSbaaeaacqaIXaqmcqGHsislcqaHYoGyaeqaaaqaamaakaaabaGaemOrayeabeaaaaGccqGH9aqpjuaGdaWcaaqaaiabdQfaAnaaBaaabaGaem4CamNaemyAaKMaemyBa0gabeaaaeaadaGcaaqaaiabdAeagnaaBaaabaGaem4CamNaemyAaKMaemyBa0gabeaaaeqaaaaaaaa@434D@

for F, where Z α and Z 1-β are the quantiles of the standard normal distribution for selected values of α and β, and Z sim is the sample mean of the Z-scores (Z c or Z p ) based on the sample size F sim of the simulation run.

Comparison of Sampling Strategies

The relative efficiency and absolute power comparisons were evaluated over a range of assumptions about disease allele frequency, penetrance, and heterogeneity. Summaries are provided for the relative efficiency from the non-null simulations of each combination of parameters and sample sizes required to attain 80% power. Our simulations involved the manipulation of 16 parameters, with over 725,000 possible combinations arising just among the limited set of settings we chose for each parameter. In practice, we were able to simulate 20 replicates for 332 actual parameter combinations. In order to assess the impact of each variable parameter setting on the power and efficiency of each study design, and to facilitate generalization of our results to other similar situations that we did not specifically simulate, we constructed linear regression models of the square root of the per-family contribution to the noncentrality parameter (Z sim / F s i m MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaWaaOaaaeaacqWGgbGrdaWgaaWcbaGaem4CamNaemyAaKMaemyBa0gabeaaaeqaaaaa@3153@ ) and ARE estimates resulting from each simulation as a function of the simulation parameters. Residuals from the models were approximately normally distributed, and scale-location plots did not suggest the data were heteroscedastic. We evaluated the fit of alternative regression models with quadratic, inverse, or logarithmic transformations of both the predictor and outcome variables; none fit the observed data better than a simple linear multiple regression model. The proportion of variance in Z sim F s i m MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaWaaOaaaeaacqWGgbGrdaWgaaWcbaGaem4CamNaemyAaKMaemyBa0gabeaaaeqaaaaa@3153@ explained by the linear regression (R 2) ranged from 70–75%. The open source statistical package R [60] was used to perform all regression analyses.

In order to facilitate interpretation, the genetic effects (baseline disease prevalence, allele frequencies, and relative risks of the linked and unlinked loci) were collapsed into "attributable risks" (AR) for the linked and unlinked loci respectively. The attributable risk is the proportion of the total disease risk attributable to variation at each genetic locus. The fit of linear regression models employing the two AR values is as good as those employing the five original terms to fit the data, using the Akaike Information Criterion (not shown; [61]).

Results

Test Size

In Tables 2 and 3 we compare the performance of each linkage statistic under the null hypothesis of no linkage to its asymptotic expectation. The values in Tables 2 and 3 were obtained for 10,000 replicate observations of a design with two affected sibs (both sampled), and two unaffected sibs (both sampled), with no parents or offspring sampled. The observed mean and standard deviation of each statistic is reported, along with the probability of Type I error for assumed one-tailed test sizes ranging from 0.1 to 0.0005. Overall, the concordant test, Z c , and the paired test, Z p , most closely matched the nominal test size. Both the mean and standard deviation of Z c were close to theoretical expectations. The standard deviation of Z p was only slightly larger, and the mean was slightly less than zero (0.05 > p > 0.01). The standard deviation of Z d was about 9% larger than expected, so the significance of tests based on this statistic will be overstated unless adjustments are made. We therefore omit Z d from further consideration.

Table 2 Simulation results
Table 3 Simulation results under varied conditions of heterogeneity

The mean multipoint estimate of allele sharing was significantly below 0.5 for concordant pairs in these null simulations, leading to a conservative bias in Z mc . Z mp is also conservatively biased, but much less so, because the statistic compares estimated sharing between concordant pairs with estimated sharing between discordant pairs, which is also estimated to be significantly less than 0.5 by the multipoint algorithm. Schork and Greenwood, Cordell, and others [62, 63] recently demonstrated the bias toward the null that occurs when using an NPL statistic with an incompletely informative marker unless an adjustment is made for incomplete marker informativity. Since marker informativity decreases with increasing marker intervals, the increasing conservativism of the Z mc with increasing marker intervals is not surprising.

When we ran null simulations in the presence of heterogeneity of marker alleles, disease alleles, or both, we observed that Z c and Z p behaved differently depending on the heterogeneity model we simulated. Although Z p was conservatively biased when disease allele frequencies differed between populations, regardless of whether marker allele frequencies differed, its small conservative bias was not significantly different from that observed in the homogeneous population of Table 2. In contrast, Z c exhibited an anticonservative bias when marker allele frequencies differed between populations, regardless of whether disease allele frequencies differed.

Alternative Model Simulation Results

A subset of results from alternative model simulations in which there were linkages are given in Table 4, based on 20 replicate simulations for each combination of parameters. The numbers given represent mean Z statistics, their ARE values, and sample sizes required to attain 80% power. The results displayed were chosen to highlight the effect of sampling (and genotyping) varying the numbers of unaffected sibs and/or parents from families with two or three affected sibs and two unaffected sibs. Full results are available online [64]. On average, the concordant test was always more efficient on a per-genotype basis than the paired test, although the power of the paired test was usually greater when the number of unaffected sibs tested was > 2.

Table 4 Alternative Model Simulation

Regression Models

Table 5 shows the effect of various design and population parameters on the noncentrality parameter for both the concordant-only test (Z c / F MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaWaaOaaaeaacqWGgbGraSqabaaaaa@2D05@ ) and the paired test (Z p / F MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaWaaOaaaeaacqWGgbGraSqabaaaaa@2D05@ ). The only change in parameterization of the model for the paired test vis-a-vis the concordant test involved substituting the number of typed unaffected sibs for the total number of unaffected sibs. The AR for the linked locus had the largest positive effect on power of the concordant test, followed closely by the negative effect on power of increasing AR at the unlinked locus and increasing recombination fraction between the marker and trait loci. Increasing the number of affected sibs per family and increasing the number of affected sibs genotyped per family both substantially improved power. The number of unaffected sibs present in sampled families had little or no effect on power. Increased power was also observed for increasing numbers of available parents, the size of the effect on Z c / F MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaWaaOaaaeaacqWGgbGraSqabaaaaa@2D05@ being about 15% of the effect of increasing numbers of affected sibs. Substituting spouse and offspring for an unavailable affected sib reduced power substantially, but genotyping a second child recovered much of that lost power.

Table 5 Effect of design and population parameters or non-centrality parameters

In general, the effects on power of changes to the genetic and design parameters were very similar for the discordant test. Increasing the number of unaffected sibs typed did yield a small increase in power, but increasing the number of affected sibs, parents or offspring proxies increased power by a larger amount, even with the discordant pair test.

The effect of experimental screening for the unlinked syndrome varied substantially depending on the relative magnitude of the effects of the unlinked syndrome: if the unlinked syndrome had an attributable risk greater than or equal to that of the linked syndrome, experimental screening resulted in a large increase in power. Otherwise, the effect of experimental screening was negligible.

Power for a given sample size F and test size α with a specified combination of design and genetic parameters can be derived from the regression models in Table 5 by first obtaining an estimate of the noncentrality parameter Z/ F MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaWaaOaaaeaacqWGgbGraSqabaaaaa@2D05@ from the appropriate column of Table 4, multiplying by F MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaWaaOaaaeaacqWGgbGraSqabaaaaa@2D05@ to obtain z ^ MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGafmOEaONbaKaaaaa@2D62@ , and then solving for β in the equation below:

β = Φ ( Z α − z ^ ) , MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xI8qiVKYPFjYdHaVhbbf9v8qqaqFr0xc9vqFj0dXdbba91qpepeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGaeqOSdiMaeyypa0JaeuOPdyKaeiikaGIaemOwaO1aaSbaaSqaaiabeg7aHbqabaGccqGHsislcuWG6bGEgaqcaiabcMcaPiabcYcaSaaa@3862@

where β is the probability of Type II error (hence power is 1-β) and Φ(z) is the cumulative standard normal distribution. A script for computing the predicted power for any particular combination of these parameters, using the statistical languages S-plus or R is also available from the website [65].

Figures 1, 2, 3, 4, 5, 6 show estimated power of the Z c test for varying sample sizes given several values of AR for the linked and unlinked loci, recombination fraction ( θ ), number of parents genotyped, and number of offspring proxies. Except as noted, the power estimates are based on the following settings of the genetic and design parameters: two total affected sibs, both sampled, two unaffected sibs (not sampled), no parents or offspring proxies, AR1 (linked locus) = 0.1, AR2 (unlinked locus) = 0.05, θ = 0.05, and no screening to exclude unlinked families.

Figure 1
figure 1

Effect of sample size and varying attributable risk at the linked locus on estimated power.

Figure 2
figure 2

Effect of sample size and varying attributable risk at the unlinked locus on estimated power.

Figure 3
figure 3

Effect of sample size and varying recombination fraction on estimated power.

Figure 4
figure 4

Effect of sample size and varying number of typed parents on estimated power.

Figure 5
figure 5

Effect of varying number of offspring proxies on power for families of two affected siblings. Effect of sample size and varying numbers of offspring proxies (1 or 2) on estimated power, families with two affected sibs, with only one available for genotyping (1 or 2), compared with families with both affected sibs available for genotyping (S = 2).

Figure 6
figure 6

Effect of varying number of offspring proxies on power for families of three affected siblings. Effect of sample size and varying numbers of offspring proxies (O) on estimated power, families with three affected sibs, with only two available for genotyping (O = 0, 1, or 2), compared with families with all three affected sibs available for genotyping (S = 3).

Relative Efficiency of Alternative Designs

Because the power of the discordant test was rarely much greater than that of the concordant test, and the concordant test requires genotyping of only the affected sibs, the ARE of the concordant test was always greater on average than that of the discordant test. Nevertheless, we were interested in specific combinations of design and genetic parameters that might have resulted in better relative efficiency for the discordant test. Overall, the ARE for the discordant test was larger than that for the concordant test in 13% of the replications. We used a logistic regression model with the same parameters as those in Tables 2, 3 and 4 to predict the probability that Z p would outperform Z c in terms of relative efficiency (not shown). Only under circumstances that would result in very low power, such as attributable risks for the unlinked locus more than twice as large as attributable risks for the linked locus, or recombination fractions > 0.1, was Z p predicted to outperform Z c in our simulated sample of 500 families.

In principle, including genotype data from unaffected siblings can improve the ability to estimate haplotypes and thereby improve power when multipoint data are studied. Table 6 compares estimates of Z c and Z p for a selected set of simulations with multipoint Z m scores for the same families as calculated by the computer program Merlin [58]. In these simulations, when markers were spaced no closer than 10 cM from one another, as is usually the case in an initial genome scan, we observed no improvement in power with the concordant multipoint statistic, but an improvement in power with the discordant test. When markers were spaced at 5 cM intervals, however, the power of both multipoint statistics to detect linkage exceeded that of both Z c and Z p . The conservative bias of Z mc noted in Tables 2 and 3 appears to decrease as marker intervals become smaller. To test this, we conducted additional simulations under the null hypothesis as described above for Tables 2 and 3, with 1000 repetitions and markers spaced at 5, 10, and 20 cM. The magnitude of the conservative bias in Z mc decreases consistently (mean Z mc = -0.58 at 20 cM, -0.23 at 10 cM, and 0.06 at 5 cM) as marker intervals contract, becoming significantly anti-conservative at 5 cM.

Table 6 Comparison of two-point vs. multipoint linkage scores under various non-null simulation conditions.

Replacement of a missing affected individual by a spouse and offspring is not generally as efficient per genotype as if that individual had been available, although the efficiency improves with each additional offspring included. Figure 5 shows the effect of replacing one member of an ASP with one or two offspring and the spouse. Figure 6 shows the effect of replacing one member of an affected sib trio with one or two offspring and the spouse. Because families with three affected sibs are more likely to be segregating a disease-predisposing allele than families with two affected sibs, each family is more informative for linkage, even if DNA is available for only two sibs. Substituting the spouse and one or more offspring for the missing sib adds additional power, although at the cost of additional genotyping.

Discussion

In studying a disease like colon cancer with both incomplete penetrance and a high incidence of sporadics, prior studies have shown that to be efficient, families must include two or more individuals with the same disease from whom samples can be obtained. The practical experience of many investigators suggests that once an initial entree is gained into a family, the chances of enrolling other members are quite high. Close relatives are often very motivated to participate in research into a disease that has afflicted their family, especially when the commitment is minimal, involving only a blood specimen and a signed consent, which are all that are required for a linkage study of diseases that have an easily established phenotype, like cancer. In our simulations, we considered inclusion of unaffected sibs and the use of spouse and offspring to replace missing affected sibs. Including unaffected siblings in the design of a study can improve the power to detect linkage for highly-penetrant diseases [53, 66]. However, our simulation studies demonstrate that for the model-free linkage tests we studied, for low penetrance loci, and with no genotyping error, little increase in power can be gained by including unaffected siblings in the design of a sib-pair study of a late onset, complex disease such as colorectal cancer. The inclusion of unaffected siblings can be useful, however, in reducing anti-conservative biases arising from heterogeneity or misspecification of marker allele frequencies or genotyping errors, and conservative biases arising if multipoint statistics are used with an insufficiently dense marker set. Table 2 shows that, with markers spaced at 10 cM intervals, Z mc is conservatively biased, while exhibiting an anticonservative bias in Table 3 under conditions of heterogeneity in marker allele frequencies. In Table 6, Z mp outperforms with markers spaced at 10 and 20 cM. At 5 cM, Z mc becomes anticonservatively biased, as noted above. It may be useful to perform simulations to assess the characteristics of the tests when the marker spacing decreases, as would be possible with the newer SNP array-based platforms. Further, since genome-wide-association studies do not utilize the full power of the sibpair design, future research should be aimed at assessing the optimal setting for relying on the sibpair design, as it is premature to move completely away from this study design [15].

If a secondary goal of a study is to estimate the penetrance, then unaffected relatives should be included in the design of the study; also unaffected siblings could help in evaluating the impact of environmental factors upon disease risk. Genotyping errors for microsatellites scans are currently very low but are hard to assess without the availability of parents or siblings. Our findings parallel those of Holmans et al. [67], who suggested that genotyping affected individuals only is efficient.

Unaffected siblings can be used for studies that take advantage of linkage disequilibrium to identify associations. Colorectal cancer and other late onset diseases with incompletely penetrant susceptibility alleles complicate the identification of unaffected individuals for association studies, because the probability that a person who does not currently exhibit the disease will become affected sometime in the future can be relatively large. In association studies using families, the oldest unaffected sibling is the most informative because s/he is more likely to have attained the age at which all the cases in the family were diagnosed (although Kraft and Thomas [68, 69] have shown how younger siblings can also be used).

The inclusion of unaffected sibs is also advantageous with respect to the common practice of genotyping in batches, particularly by nuclear family. A correlation may be induced artificially if the genotyping errors are resolved within families by requiring Mendelian segregation of alleles, which can lead to false positive evidence for linkage, unless the unaffected relatives are used for comparison. Such excess evidence for linkage tends to accrue from the families with available parents because these pedigrees are the mostly likely to yield non-Mendelian segregation due to genotyping errors, which have to be resolved in turn [70, 71]. Good laboratory practice requires that at least some samples receive duplicate genotyping so that it would be possible to identify problematic markers showing excess genotyping error rates. Meiotic drive exists in some mammals and if present in humans could conceivably increase the expected IBD sharing at a locus above 0.5. If meiotic drive is present in humans then multiple studies of many different diseases should show this effect [72].

One sampling option that we have shown can be viable includes sibships in which an affected member is dead but the spouse and offspring of the deceased are available, thus effectively increasing the number of pairs and yielded a total information content per family approaching other designs based on affected sibs. In the context of a high-risk clinic, pursuing the family of a dead sib can be quite labor intensive compared with the cost of recruiting more sibships. However, in an established registry, the opposite may be true, so that extending the relatives to be sampled becomes a more cost-effective strategy. Such a scheme could be worthy of further consideration in situations where the prospects of recruiting additional sibships are limited. Using spouses and offspring as proxies for missing or deceased sibs is obviously less efficient than had the affected sibs themselves been available, but still can provide adequate linkage information and may be required if the disease is often lethal so that samples from affected sibs are hard to obtain. Even when affected siblings are unavailable for study, it is still possible to genotype blocks that may be available from residual tissues, such as lymph nodes, that were obtained for the purposes of staging. However, genetic analysis of blocks is more difficult than from blood samples because the DNA is partially degraded, which may preclude multiplex genotyping. Therefore, genotyping the relatives of the affected but unavailable cosib may be more efficient than genotyping residual tissues.

Available parents contributed somewhat to the efficiency obtained in our simulated linkage studies. There are other benefits of including parents when they are available, including greatly reduced sensitivity to allele frequency misspecification, substantial improvements to haplotype estimation, and identifying nonpaternities or other errors in family structure or in genotyping. There are some practical advantages to including both parents of each sibship, whenever possible. However, parents are likely to be available only for a small minority of the families because most inherited cancers have a relatively late onset, albeit typically earlier than for sporadic cases. For example, data from the high-risk families of the CFRCCS and the population-based Diet, Activity and Reproduction in Colon Cancer (DARCC) study [26] show that about 3–4% of the living ASPs have two parents alive while about 12% (DARCC) to 22% (CFRCCS) have only one. The sib pair protocol of the Eastern Cooperative Oncology Group (ECOG) for mapping the interactive susceptibility loci of four major malignancies includes the accrual of parents only when both are available. However, their rationale is quite different from that of allele-sharing methodology because the parental data are collected for a separate parallel analysis using the transmission disequilibrium test (TDT) [73].

The family structures that could be studied are not necessarily restricted to the sibs of a proband ascertained through a registry or clinic. Consideration should also be given to collecting the extended family members of the affected sibs. Familial cancer registries such as the CFRCCS and CGN routinely collect family history from all their participants. Recent reports indicate that study subjects are capable of accurately reporting cancer status among their close relatives, with accuracy varying by cancer site and degree of relationship [74]. Pedigrees that extend to affected aunts and uncles or grandparents of the affected sibs could be used in a confirmatory analysis for the source of the segregating disease allele by the method of Olson and Elston [75], without obtaining their blood specimens, by correlating the parent of origin of shared alleles with the side of the family of the affected aunt or uncle.

For rare autosomal dominant traits, Risch [76] showed that cousin pairs actually provide more information for detecting tight linkage than sib pairs. Narod and Amos ([77]) also showed through simulation the efficacy of incorporating cousins in a linkage study of breast cancer, which like colorectal cancer shows genetic heterogeneity, a likely high proportion of phenocopies, and environmental and life-style related risk factors. However, Risch also found that for recessive conditions or when the disease and marker loci were not tightly linked, a sib pair design was more effective than other designs. Since the mode of inheritance for as yet unidentified genetic factors remains unknown, the sibship design remains preferable to other family units since it provides power under all genetic models.

We estimated the numbers of families required to study colorectal cancer and similar diseases with reasonable power, if our assumptions about disease allele frequencies, mode of inheritance, and heterogeneity are not too far from the truth. Our simulation studies show that at least 500–1000 families are required to provide reasonable assurance of adequate power across a range of genetic models that are consistent with the observed familiality and population prevalence of colorectal cancer. Colon cancer risk is strongly associated with certain environmental factors, some of which might interact with the gene(s) being sought. Although 1000 pairs will most likely provide adequate power to identify genetic risk factors, the further delineation of gene-environment interactions may yet require larger sample sizes [78]. Our simulation study focused upon efficiency of various genotyping approaches, where we assumed that samples from individuals are already available. If samples are not available, then additional design constraints may become important. For instance, the collection of sib pairs affected by disease can be a slow process and trade-offs between efficiency in genotyping versus power from available samples may need to be evaluated.

Because the costs of drawing blood and extracting DNA are far smaller than those of genotyping the 400–1000 markers needed for a genome scan, and because the unaffected and affected siblings can contribute different information, we suggest collecting all available members of each sibship, but only genotyping affected sibs, parents, and any spouse/offspring proxies for an initial genome scan. DNA from the unaffected sibs may still be useful for fine mapping and association studies and for estimating the penetrance. The CFRCCS and DARCC databases indicate that about 90% of the living ASPs have at least one unaffected sib alive, with a mean of about 2.5. Since the optimal number of unaffected sibs to sample per sibship if more than one were available has not been resolved, an ad-hoc plan may be to obtain the blood specimens from all those who consent. If the genotyping resources were constrained (e.g. to at most two unaffecteds per sibship), an efficient protocol is to start with the oldest first-degree relative and to proceed downwards, i.e. include both parents if available, otherwise one parent and the oldest unaffected sib, etc.

Population heterogeneity and allele frequencies have an important impact on the study design. In the absence of parents, the marker allele frequencies in the study population have to be estimated as the basis for estimating the IBD probabilities, which requires an assumption of homogeneity of marker allele frequencies. Population heterogeneity arises when the allele frequencies vary across subgroups, because of demographic, geographical, or other factors. Table 3 shows that an incorrect assumption of population homogeneity so the assumption of a common allele frequency across the entire collection of families can bias affecteds-only linkage results, depending on the degree of admixture and the degree to which the allele frequencies vary among the subpopulations.

We observed moderate to substantial losses of power to detect linkage in the limited number of simulations we performed with population heterogeneity of this sort (see Table 6). The use of unaffected sibs provides one means of overcoming the problem of heterogeneity in marker allele frequencies, since both concordant and discordant pairs tend to be biased in a similar manner by any misspecification of allele frequencies. To fully exploit this advantage, however, a matched comparison is needed so that the analysis focuses on the within-family differences in IBD probabilities between the two types of pairs. This would overcome any problems of imbalance in the ethnic distribution of concordant and discordant pairs. While this can be accomplished by means of a simple paired t-test, like Z p , a more sophisticated GEE-2 approach is possible, modeling the entire vector of phenotypes in each family in relation to its IBD matrix [79]. This would have the advantage of combining information from both types of comparison in a matched fashion, so that all families, including those with no unaffected sibs, would contribute. The simulations summarized in Table 6 do not show any power advantage for either Z p or multipoint approaches under the simulated conditions of population admixture, although the anti-conservative bias in Z c under heterogeneity of marker allele frequencies may partially obscure a real power difference between the concordant and discordant tests. Population admixture presents a particularly insidious threat to the validity of tests for linkage if parents or unaffected siblings are not available. However, it might be possible to detect population substructure by checking for the departure from disequilibrium that it engenders.

We did not directly study the asymptotic relative efficiency of 10 cm versus 5 cm linkage scans. At the time we designed our study, the usual practice in genotyping facilities is to first apply a 10 cm map and then to follow up with denser mapping in linked regions. We generally anticipated that an initial 5 cM mapping strategy is not cost effective and that some version of grid tightening would ordinarly be employed [67]. Currently with the availability of more modern technology, a 10 cM scan is now considered rather sparse, and the 5 cM scan is considered a better standard, with fine mapping at 1 cM (although you still see published studies that use 10 cM scans; see [16–18]). Many studies now use SNP platforms, although it is not clear whether these are optimal for sibpair studies. When dense sets of SNPs are analyzed, there is much more potential for biases to appear if parental data are unavailable and linkage disequilibrium among the markers is not adequately modeled [80]. Such biases are reduced when an additional unaffected sibling or a parent is included in the analysis. Other than the need to address the potential for bias, the high marker informativity of microsatellites compared with SNPs would suggest that results from our simulation studies should shed light on optimal designs for studies of small families, whether microsatellites or SNPs are used for analysis.

Crude stratification by recruitment center is unlikely to be reliable enough for controlling population heterogeneity without additional adjustment. Stratification by ethnicity is generally more crucial than by geography, although both factors should ideally be incorporated. However, collection of ethnicity is not entirely trivial if it is to be worthwhile. Although various coding systems have been established by different agencies, no consensus has been established regarding the level of detail required on ethnicity data in genetic research, e.g. category distinctions, mixed-race marriages. Mandal et al. [81] have shown that marker allele frequencies are less important if there are four or more persons per family, especially when very polymorphic markers are used. When the parents of the sibpair have been genotyped, then there is no dependence on population marker allele frequencies and no source of bias in linkage analysis.

Conclusion

We have shown that for a wide variety of situations relevant to sib-pair studies of colon cancer and similar late-onset complex diseases, standard concordant-pair allele-sharing statistics based on identity by descent probabilities are more efficient than similarly constructed discordant statistics in homogeneous populations, but may be biased away from the null in situations where subjects are chosen from multiple populations having differing marker allele frequencies or other sources of bias. Where heterogeneity in marker allele frequencies is anticipated because of underlying population admixture, linkage tests based on comparison of concordant vs. discordant allele sharing should be considered. Either of these approaches should allow studies of 500–1000 families containing an ASP to achieve reasonable power to detect linkage under conditions including genetic and population heterogeneity, unavailable parents, misspecified allele frequencies, and other afflictions of the sib-pair design. While collecting DNA samples from unaffected sibs can be useful for a wide variety of purposes–especially if multipoint methods are used–in many circumstances it should be unnecessary to genotype these samples for purposes of performing a genome scan. If adequate allele frequency data are available and microsatellites are being used, we suggest a single-point affecteds-only analysis for a initial scan, followed by a multipoint analysis of affected and unaffected members of all available sibships with additional markers around initial hits. For dense SNP mapping studies, analysis using individual SNPs will not be sufficiently informative and so multipoint analyses will be required, but unless the parents are all available, analyses should be restricted to markers that show low levels of linkage disequilibrium (the reference here would be to a paper by Bacanu SA. Multipoint linkage analysis for a very dense set of markers Genet Epidemiol. 2005 Nov;29(3):195–203.) or estimate haplotype frequencies (Abecasis and Wigginton, Handling marker-marker linkage disequilibrium: pedigree analysis with clustered markers. Am J Hum Genet. 2005 Nov;77(5):754–67. Epub 2005 Sep 20.) If the parents are available, even though we have shown that genotyping them is inefficient, an argument can be made for genotyping them because their inclusion ameliorates any potential effect of population admixture, greatly facilitates the identification of any genotyping errors and reduces the dependence upon correct specification of haplotype frequencies when multipoint analyses are conducted (can refer to Huang et al, 2004 Ignoring linkage disequilibrium among tightly linked markers induces false-positive evidence of linkage for affected sib pair analysis.

Am J Hum Genet. 2004 Dec;75(6):1106-12. Epub 2004 Oct 18.). The choice of whether or not to genotype unaffected individuals also would depend upon the feasibility and cost of cherry-picking for regional genotyping of regions showing evidence for linkage, but we have not studied either of these issues in this paper. Admixture is more likely to be of concern when studying populations that are known to have been founded by different ethnic groups or races such as Hispanics and African-Americans.

We have also observed that, if genetic testing is available for previously-identified syndromes, and if those syndromes are thought to account for a larger portion of the disease burden than the syndrome of interest, prior exclusion of families linked to the known syndrome can meaningfully increase the power of the study.

Finally we note that the colon sibpair study, for which this paper was written, was completed after accruing less than 100 families. In fact, most of the colon sibpair studies that have been published include fewer than 100 families, because recruitment is a major challenge. Although the results discussed here suggest numbers that may be challenging to accrue, the published literature has reported positive studies, suggesting that the assumptions used in our calculations may have been too conservative. In addition, linkage studies are meant to be performed in an iterative fashion so that the results from ongoing studies can be combined. Since our conclusions and recommendations arising from the simulations describe relative advantage of various designs, our results are of value in future study design.

References

  1. Haseman JK, Elston RC: The investigation of linkage between a quantitative trait and a marker locus. Behav Genet. 1972, 2: 3-19. 10.1007/BF01066731.

    Article  CAS  PubMed  Google Scholar 

  2. Fulker DW, Cardon LR: A sib-pair approach to interval mapping of quantitative trait loci. Am J Hum Genet. 1994, 54: 1092-1103.

    CAS  PubMed  PubMed Central  Google Scholar 

  3. Amos CI, Elston RC: Robust methods for the detection of genetic linkage for quantitative data from pedigrees. Genet Epidemiol. 1989, 6: 349-360. 10.1002/gepi.1370060205.

    Article  CAS  PubMed  Google Scholar 

  4. Cordell HJ, Wedig GC, Jacobs KB, Elston RC: Multilocus linkage tests based on affected relative pairs. Am J Hum Genet. 2000, 66: 1273-1286. 10.1086/302847.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  5. Weeks DE, Lange K: The affected-pedigree-member method of linkage analysis. Am J Hum Genet. 1988, 42: 315-326.

    CAS  PubMed  PubMed Central  Google Scholar 

  6. Olson JM: A general conditional-logistic model for affected-relative-pair linkage studies. Am J Hum Genet. 1999, 65: 1760-1769. 10.1086/302662.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  7. Khoury MJ, Flanders WD, Lipton RB, Dorman JS: Commentary: the affected sib-pair method in the context of an epidemiologic study design. Genet Epidemiol. 1991, 8: 277-282. 10.1002/gepi.1370080408.

    Article  CAS  PubMed  Google Scholar 

  8. Greenwood CM, Bull SB: Analysis of affected sib pairs, with covariates–with and without constraints. Am J Hum Genet. 1999, 64: 871-885. 10.1086/302288.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  9. Gauderman WJ, Morrison JL, Siegmund KD, Thomas DC: A joint test of linkage and gene × environment interaction, with affected sib pairs. Genet Epidemiol. 1999, 17 (Suppl 1): S563-568.

    Article  PubMed  Google Scholar 

  10. Goldin LR, Gershon ES: Power of the affected-sib-pair method for heterogeneous disorders. Genet Epidemiol. 1988, 5: 35-42. 10.1002/gepi.1370050104.

    Article  CAS  PubMed  Google Scholar 

  11. Kruglyak L, Lander ES: Complete multipoint sib-pair analysis of qualitative and quantitative traits. Am J Hum Genet. 1995, 57: 439-454.

    CAS  PubMed  PubMed Central  Google Scholar 

  12. Whittemore AS: Genome scanning for linkage: an overview. Am J Hum Genet. 1996, 59: 704-716.

    CAS  PubMed  PubMed Central  Google Scholar 

  13. Knapp M, Seuchter SA, Baur MP: Linkage analysis in nuclear families. 2: Relationship between affected sib-pair tests and lod score analysis. Hum Hered. 1994, 44: 44-51.

    Article  CAS  PubMed  Google Scholar 

  14. Hodge SE: Model-free vs. model-based linkage analysis: a false dichotomy?. Am J Med Genet. 2001, 105: 62-64. 10.1002/1096-8628(20010108)105:1<62::AID-AJMG1063>3.0.CO;2-C.

    Article  CAS  PubMed  Google Scholar 

  15. Thomas DC: Are we ready for genome-wide association studies?. Cancer Epidemiol Biomarkers Prev. 2006, 15: 595-598. 10.1158/1055-9965.EPI-06-0146.

    Article  PubMed  Google Scholar 

  16. Kemp Z, Carvajal-Carmona L, Spain S, Barclay E, Gorman M, Martin L, Jaeger E, Brooks N, Bishop DT, Thomas H, et al: Evidence for a colorectal cancer susceptibility locus on chromosome 3q21-q24 from a high-density SNP genome-wide linkage scan. Hum Mol Genet. 2006, 15: 2903-2910. 10.1093/hmg/ddl231.

    Article  CAS  PubMed  Google Scholar 

  17. Tomlinson I, Webb E, Carvajal-Carmona L, Broderick P, Kemp Z, Spain S, Penegar S, Chandler I, Gorman M, Wood W, et al: A genome-wide association scan of tag SNPs identifies a susceptibility variant for colorectal cancer at 8q24.21. Nat Genet. 2007, 39: 984-988. 10.1038/ng2085.

    Article  CAS  PubMed  Google Scholar 

  18. Wiesner GL, Daley D, Lewis S, Ticknor C, Platzer P, Lutterbaugh J, MacMillen M, Baliner B, Willis J, Elston RC, Markowitz SD: A subset of familial colorectal neoplasia kindreds linked to chromosome 9q22.2-31.2. Proc Natl Acad Sci USA. 2003, 100: 12961-12965. 10.1073/pnas.2132286100.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  19. Slager S, Huang J, Vieland V: Effect of allelic heterogeneity on the power of the transmission disequilibrium test. Genet Epidemiol. 2000, 18: 143-156. 10.1002/(SICI)1098-2272(200002)18:2<143::AID-GEPI4>3.0.CO;2-5.

    Article  CAS  PubMed  Google Scholar 

  20. Macconaill LE, Aldred MA, Lu X, Laframboise T: Toward accurate high-throughput SNP genotyping in the presence of inherited copy number variation. BMC Genomics. 2007, 8: 211-10.1186/1471-2164-8-211.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Johns LE, Houlston RS: A systematic review and meta-analysis of familial colorectal cancer risk. Am J Gastroenterol. 2001, 96: 2992-3003. 10.1111/j.1572-0241.2001.04677.x.

    Article  CAS  PubMed  Google Scholar 

  22. La Vecchia C, Negri E, Franceschi S, Gentile A: Family history and the risk of stomach and colorectal cancer. Cancer. 1992, 70: 50-55. 10.1002/1097-0142(19920701)70:1<50::AID-CNCR2820700109>3.0.CO;2-I.

    Article  CAS  PubMed  Google Scholar 

  23. Cannon-Albright LA, Thomas A, Goldgar DE, Gholami K, Rowe K, Jacobsen M, McWhorter WP, Skolnick MH: Familiality of cancer in Utah. Cancer Res. 1994, 54: 2378-2385.

    CAS  PubMed  Google Scholar 

  24. Slattery ML, Kerber RA: Family history of cancer and colon cancer risk: the Utah Population Database. J Natl Cancer Inst. 1994, 86: 1618-1626. 10.1093/jnci/86.21.1618.

    Article  CAS  PubMed  Google Scholar 

  25. Le Marchand L, Zhao LP, Quiaoit F, Wilkens LR, Kolonel LN: Family history and risk of colorectal cancer in the multiethnic population of Hawaii. Am J Epidemiol. 1996, 144: 1122-1128.

    Article  CAS  PubMed  Google Scholar 

  26. Kerber RA, Slattery ML, Potter JD, Caan BJ, Edwards SL: Risk of colon cancer associated with a family history of cancer or colorectal polyps: the diet, activity, and reproduction in colon cancer study. Int J Cancer. 1998, 78: 157-160. 10.1002/(SICI)1097-0215(19981005)78:2<157::AID-IJC6>3.0.CO;2-Y.

    Article  CAS  PubMed  Google Scholar 

  27. Goldgar DE, Easton DF, Cannon-Albright LA, Skolnick MH: Systematic population-based assessment of cancer risk in first-degree relatives of cancer probands. J Natl Cancer Inst. 1994, 86: 1600-1608. 10.1093/jnci/86.21.1600.

    Article  CAS  PubMed  Google Scholar 

  28. Kune GA, Kune S, Watson LF: The role of heredity in the etiology of large bowel cancer: data from the Melbourne Colorectal Cancer Study. World J Surg. 1989, 13: 124-129. 10.1007/BF01671173. discussion 129-131

    Article  CAS  PubMed  Google Scholar 

  29. Garabrant DH, Peters JM, Mack TM, Bernstein L: Job activity and colon cancer risk. Am J Epidemiol. 1984, 119: 1005-1014.

    CAS  PubMed  Google Scholar 

  30. Colditz GA, Cannuscio CC, Frazier AL: Physical activity and reduced risk of colon cancer: implications for prevention. Cancer Causes Control. 1997, 8: 649-667. 10.1023/A:1018458700185.

    Article  CAS  PubMed  Google Scholar 

  31. Gertig DM, Hunter DJ: Genes and environment in the etiology of colorectal cancer. Semin Cancer Biol. 1998, 8: 285-298. 10.1006/scbi.1998.0078.

    Article  CAS  PubMed  Google Scholar 

  32. Hensrud DD, Heimburger DC: Diet, nutrients, and gastrointestinal cancer. Gastroenterol Clin North Am. 1998, 27: 325-346. 10.1016/S0889-8553(05)70006-6.

    Article  CAS  PubMed  Google Scholar 

  33. Schottenfeld D, Winawer SJ: Cancers of the large intestine. Cancer epidemiology and prevention. Edited by: Schottenfeld D, Fraumeni JF. 1996, New York: Oxford University Press, 813-840.

    Google Scholar 

  34. Potter JD: Colorectal cancer: molecules and populations. J Natl Cancer Inst. 1999, 91: 916-932. 10.1093/jnci/91.11.916.

    Article  CAS  PubMed  Google Scholar 

  35. Vachon CM, Sellers TA, Kushi LH, Folsom AR: Familial correlation of dietary intakes among postmenopausal women. Genet Epidemiol. 1998, 15: 553-563. 10.1002/(SICI)1098-2272(1998)15:6<553::AID-GEPI1>3.0.CO;2-R.

    Article  CAS  PubMed  Google Scholar 

  36. Khoury MJ, Beaty TH, Liang KY: Can familial aggregation of disease be explained by familial aggregation of environmental risk factors?. Am J Epidemiol. 1988, 127: 674-683.

    CAS  PubMed  Google Scholar 

  37. Wooster R, Bignell G, Lancaster J, Swift S, Seal S, Mangion J, Collins N, Gregory S, Gumbs C, Micklem G: Identification of the breast cancer susceptibility gene BRCA2. Nature. 1995, 378: 789-792. 10.1038/378789a0.

    Article  CAS  PubMed  Google Scholar 

  38. Mecklin JP, Jarvinen HJ, Hakkiluoto A, Hallikas H, Hiltunen KM, Harkonen N, Kellokumpu I, Laitinen S, Ovaska J, Tulikoura J, et al: Frequency of hereditary nonpolyposis colorectal cancer. A prospective multicenter study in Finland. Dis Colon Rectum. 1995, 38: 588-593. 10.1007/BF02054116.

    Article  CAS  PubMed  Google Scholar 

  39. Wang Q, Lasset C, Desseigne F, Saurin JC, Maugard C, Navarro C, Ruano E, Descos L, Trillet-Lenoir V, Bosset JF, Puisieux A: Prevalence of germline mutations of hMLH1, hMSH2, hPMS1, hPMS2, and hMSH6 genes in 75 French kindreds with nonpolyposis colorectal cancer. Hum Genet. 1999, 105: 79-85. 10.1007/s004390051067.

    CAS  PubMed  Google Scholar 

  40. Peel DJ, Ziogas A, Fox EA, Gildea M, Laham B, Clements E, Kolodner RD, Anton-Culver H: Characterization of hereditary nonpolyposis colorectal cancer families from a population-based series of cases. J Natl Cancer Inst. 2000, 92: 1517-1522. 10.1093/jnci/92.18.1517.

    Article  CAS  PubMed  Google Scholar 

  41. Percesepe A, Borghi F, Menigatti M, Losi L, Foroni M, Di Gregorio C, Rossi G, Pedroni M, Sala E, Vaccina F, et al: Molecular screening for hereditary nonpolyposis colorectal cancer: a prospective, population-based study. J Clin Oncol. 2001, 19: 3944-3950.

    CAS  PubMed  Google Scholar 

  42. Weber TK, Chin HM, Rodriguez-Bigas M, Keitz B, Gilligan R, O'Malley L, Urf E, Diba N, Pazik J, Petrelli NJ: Novel hMLH1 and hMSH2 germline mutations in African Americans with colorectal cancer. Jama. 1999, 281: 2316-2320. 10.1001/jama.281.24.2316.

    Article  CAS  PubMed  Google Scholar 

  43. Bai YQ, Akiyama Y, Nagasaki H, Lu SL, Arai T, Morisaki T, Kitamura M, Muto A, Nagashima M, Nomizu T, et al: Predominant germ-line mutation of the hMSH2 gene in Japanese hereditary non-polyposis colorectal cancer kindreds. Int J Cancer. 1999, 82: 512-515. 10.1002/(SICI)1097-0215(19990812)82:4<512::AID-IJC7>3.0.CO;2-8.

    Article  CAS  PubMed  Google Scholar 

  44. Aaltonen LA, Salovaara R, Kristo P, Canzian F, Hemminki A, Peltomaki P, Chadwick RB, Kaariainen H, Eskelinen M, Jarvinen H, et al: Incidence of hereditary nonpolyposis colorectal cancer and the feasibility of molecular screening for the disease. N Engl J Med. 1998, 338: 1481-1487. 10.1056/NEJM199805213382101.

    Article  CAS  PubMed  Google Scholar 

  45. Rudy DR, Zdon MJ: Update on colorectal cancer. Am Fam Physician. 2000, 61: 1759-1770. 1773–1754

    CAS  PubMed  Google Scholar 

  46. Hemminki K, Li X: Familial colorectal adenocarcinoma and hereditary nonpolyposis colorectal cancer: a nationwide epidemiological study from Sweden. Br J Cancer. 2001, 84: 969-974. 10.1054/bjoc.2000.1718.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  47. Salovaara R, Loukola A, Kristo P, Kaariainen H, Ahtola H, Eskelinen M, Harkonen N, Julkunen R, Kangas E, Ojala S, et al: Population-based molecular detection of hereditary nonpolyposis colorectal cancer. J Clin Oncol. 2000, 18: 2193-2200.

    CAS  PubMed  Google Scholar 

  48. Risch N: The genetic epidemiology of cancer: interpreting family and twin studies and their implications for molecular genetic approaches. Cancer Epidemiol Biomarkers Prev. 2001, 10: 733-741.

    CAS  PubMed  Google Scholar 

  49. Kruglyak L, Daly MJ, Reeve-Daly MP, Lander ES: Parametric and nonparametric linkage analysis: a unified multipoint approach. Am J Hum Genet. 1996, 58: 1347-1363.

    CAS  PubMed  PubMed Central  Google Scholar 

  50. SAGE: Statistical Analysis for Genetic Epidemiology. Computer program package. 2004, Cork, Ireland: Statistical Solutions Ltd; Computer program package, 5.0

    Google Scholar 

  51. Sobel E, Lange K: Descent graphs in pedigree analysis: applications to haplotyping, location scores, and marker-sharing statistics. Am J Hum Genet. 1996, 58: 1323-1337.

    CAS  PubMed  PubMed Central  Google Scholar 

  52. Abecasis GR, Cardon LR, Cookson WO: A general test of association for quantitative traits in nuclear families. Am J Hum Genet. 2000, 66: 279-292. 10.1086/302698.

    Article  CAS  PubMed  Google Scholar 

  53. Blackwelder WC, Elston RC: A comparison of sib-pair linkage tests for disease susceptibility loci. Genet Epidemiol. 1985, 2: 85-97. 10.1002/gepi.1370020109.

    Article  CAS  PubMed  Google Scholar 

  54. Guo X, Elston RC: Two-stage global search designs for linkage analysis II: including discordant relative pairs in the study. Genet Epidemiol. 2000, 18: 111-127. 10.1002/(SICI)1098-2272(200002)18:2<111::AID-GEPI2>3.0.CO;2-M.

    Article  CAS  PubMed  Google Scholar 

  55. Hodge SE: The information contained in multiple sibling pairs. Genet Epidemiol. 1984, 1: 109-122. 10.1002/gepi.1370010203.

    Article  CAS  PubMed  Google Scholar 

  56. Amos CI, Elston RC, Bonney GE, Keats BJ, Berenson GS: A multivariate method for detecting genetic linkage, with application to a pedigree with an adverse lipoprotein phenotype. Am J Hum Genet. 1990, 47: 247-254.

    CAS  PubMed  PubMed Central  Google Scholar 

  57. Boehnke M: Allele frequency estimation from data on relatives. Am J Hum Genet. 1991, 48: 22-25.

    CAS  PubMed  PubMed Central  Google Scholar 

  58. Abecasis GR, Cherny SS, Cookson WO, Cardon LR: Merlin–rapid analysis of dense genetic maps using sparse gene flow trees. Nature Genetics. 2002, 30: 97-101. 10.1038/ng786.

    Article  CAS  PubMed  Google Scholar 

  59. Snedecor G, Cochran W: Statistical Methods. 1967, Ames: Iowa State University Press, 6

    Google Scholar 

  60. The R Project for Statistical Computing. [http://www.r-project.org]

  61. Akaike H: A Bayesian analysis of the minimum AIC procedure. Annals of the Institute of Statistical Mathematics. 1978, 30A: 9-14. 10.1007/BF02480194.

    Article  Google Scholar 

  62. Schork NJ, Greenwood TA: Inherent bias toward the null hypothesis in conventional multipoint nonparametric linkage analysis. Am J Hum Genet. 2004, 74: 306-316. 10.1086/381714.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  63. Cordell HJ: Bias toward the null hypothesis in model-free linkage analysis is highly dependent on the test statistic used. Am J Hum Genet. 2004, 74: 1294-1302. 10.1086/421476.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  64. Colon Cancer Sibling Pair Study. [http://hedwig.mgh.harvard.edu/cgn/public/studies/colon_sib_pair]

  65. Cancer Genetics Network. [http://hedwig.mgh.harvard.edu/cgn]

  66. Ott J: Analysis of Human Genetic Linkage. 1999, 382-

    Google Scholar 

  67. Holmans P, Craddock N: Efficient strategies for genome scanning using maximum-likelihood affected-sib-pair analysis. Am J Hum Genet. 1997, 60: 657-666.

    CAS  PubMed  PubMed Central  Google Scholar 

  68. Kerber RA, Slattery ML: The impact of family history on ovarian cancer risk. The Utah Population Database. Arch Intern Med. 1995, 155: 905-912. 10.1001/archinte.155.9.905.

    Article  CAS  PubMed  Google Scholar 

  69. Kraft P, Thomas DC: Case-sibling gene-association studies for diseases with variable age at onset. Stat Med. 2004, 23: 3697-3712. 10.1002/sim.1722.

    Article  PubMed  Google Scholar 

  70. O'Connell JR, Weeks DE: PedCheck: a program for identification of genotype incompatibilities in linkage analysis. Am J Hum Genet. 1998, 63: 259-266. 10.1086/301904.

    Article  PubMed  PubMed Central  Google Scholar 

  71. Goring HH, Terwilliger JD: Linkage analysis in the presence of errors I: complex-valued recombination fractions and complex phenotypes. Am J Hum Genet. 2000, 66: 1095-1106. 10.1086/302797.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  72. Zollner S, Wen X, Hanchard NA, Herbert MA, Ober C, Pritchard JK: Evidence for extensive transmission distortion in the human genome. Am J Hum Genet. 2004, 74: 62-72. 10.1086/381131.

    Article  PubMed  Google Scholar 

  73. Spielman RS, McGinnis RE, Ewens WJ: Transmission test for linkage disequilibrium: the insulin gene region and insulin-dependent diabetes mellitus (IDDM). Am J Hum Genet. 1993, 52: 506-516.

    CAS  PubMed  PubMed Central  Google Scholar 

  74. Ziogas A, Anton-Culver H: Validation of family history data in cancer family registries. Am J Prev Med. 2003, 24: 190-198. 10.1016/S0749-3797(02)00593-7.

    Article  PubMed  Google Scholar 

  75. Olson JM, Elston RC: Using family history information to distinguish true and false positive model-free linkage results. Genet Epidemiol. 1998, 15: 183-192. 10.1002/(SICI)1098-2272(1998)15:2<183::AID-GEPI6>3.0.CO;2-7.

    Article  CAS  PubMed  Google Scholar 

  76. Risch N: Linkage strategies for genetically complex traits. II. The power of affected relative pairs. American Journal of Human Genetics. 1990, 46: 229-241.

    CAS  PubMed  PubMed Central  Google Scholar 

  77. Narod SA, Amos C: Estimating the power of linkage analysis in hereditary breast cancer. Am J Hum Genet. 1990, 46: 266-272.

    CAS  PubMed  PubMed Central  Google Scholar 

  78. Gauderman WJ, Thomas DC: The role of interacting determinants in the localization of of genes. Genetic dissection of complex traits: challenges for the next millenium. Edited by: Rao DC. 2000, Chicago: Academic Press, 393-412.

    Google Scholar 

  79. Thomas DC, Qian D, Gauderman WJ, Siegmund K, Morrison JL: A generalized estimating equations approach to linkage analysis in sibships in relation to multiple markers and exposure factors. Genet Epidemiol. 1999, 17 (Suppl 1): S737-742.

    Article  PubMed  Google Scholar 

  80. Huang Q, Shete S, Amos CI: Ignoring linkage disequilibrium among tightly linked markers induces false-positive evidence of linkage for affected sib pair analysis. Am J Hum Genet. 2004, 75: 1106-1112. 10.1086/426000.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  81. Mandal DM, Wilson AF, Elston RC, Weissbecker K, Keats BJ, Bailey-Wilson JE: Effects of misspecification of allele frequencies on the type I error rate of model-free linkage analysis. Hum Hered. 2000, 50: 126-132. 10.1159/000022900.

    Article  CAS  PubMed  Google Scholar 

Pre-publication history

Download references

Acknowledgements

The authors wish to thank Robert Elston and Dan Schaid for helpful suggestions at the design stage of this project, John Morrison for help with the computer programming, and Hang Lee and Deb Neklason for helpful comments on the manuscript. Supported in part by NIH U24 CA78174, R01 CA040641, and P01 CA73992 (RK), NIH HG02275, NIH 5 U42 CA78142 (CA), U01 CA78284, and R01 CA74302 (DF, BY), U01 CA78284, and CA52862, GM58897, and U01 CA78296 (DT).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Dianne M Finkelstein.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

RAK took the lead in developing the results (performed simulations) and in writing the manuscript; CIA was a major participant in developing the results and preparing the manuscript; BYY drafted the manuscript and participated in manuscript preparation discussions, DMF coordinated the draft and development of the manuscript and participated in manuscript preparation discussions, DCT was a major participant in developing the results and preparing the manuscript. All authors read the final manuscript.

Richard A Kerber, Christopher I Amos and Duncan C Thomas contributed equally to this work.

Authors’ original submitted files for images

Rights and permissions

Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Kerber, R.A., Amos, C.I., Yeap, B.Y. et al. Design considerations in a sib-pair study of linkage for susceptibility loci in cancer. BMC Med Genet 9, 64 (2008). https://doi.org/10.1186/1471-2350-9-64

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1471-2350-9-64

Keywords