ABSTRACT
This report documents the presence of fecal indicators and bacterial pathogens in sand at 53 California marine beaches using both culture-dependent and -independent (PCR and quantitative PCR [QPCR]) methods. Fecal indicator bacteria were widespread in California beach sand, with Escherichia coli and enterococci detected at 68% and 94% of the beaches surveyed, respectively. Somatic coliphages and a Bacteroidales human-specific fecal marker were detected at 43% and 13% of the beaches, respectively. Dry sand samples from almost 30% of the beaches contained at least one of the following pathogens: Salmonella spp., Campylobacter spp., Staphylococcus aureus, and methicillin-resistant Staphylococcus aureus (MRSA), which were detected at 15%, 13%, 14%, and 3% of tested beaches, respectively. Fecal indicators and pathogens were poorly correlated to one another and to land cover. Sands were dry at the time of collection, and those with relatively high moisture tended to have higher concentrations or a more frequent occurrence of both indicators and pathogens. Using culture-dependent assays, fecal indicators decayed faster than pathogens in microcosm experiments using unaltered beach sand seeded with sewage and assessed by culture-dependent assays. The following order of persistence was observed (listed from most to least persistent): Campylobacter > Salmonella > somatic coliphages > enterococci > E. coli > F+ phages. In contrast, pathogens decayed faster than fecal indicators in culture-independent assays: enterococci > Bacteroidales human-specific marker > Salmonella > Campylobacter. Microcosm experiments demonstrated that both indicators and pathogens were mobilized by wetting with seawater. Decay rates measured by QPCR were lower than those measured with culture-dependent methods. Enterococcal persistence and possible growth were observed for wetted microcosms relative to unwetted controls.
INTRODUCTION
Seventy-four percent of beach advisories and closures in the United States during 2009 were due to pollution violating bacterial water quality standards (20), and a majority of these (53%) were attributed to unknown sources of pollution (20). Previous work has shown that beach sand can act as a non-point source of microbial pollution for coastal waters (74, 77). Fecal indicator bacteria (FIB), including Escherichia coli and enterococci, are found in sand and can be transported from sand to the sea via “over-beach transport” (77). Both freshwater and marine beach sand have been shown to harbor high concentrations of FIB, and concentrations in sand often greatly exceed concentrations in beach water on a per-mass basis (74, 77). Notably, recent epidemiological research has shown an increased risk of gastrointestinal illness from contact with beach sand (33).
Compared to the number of studies of E. coli and enterococci, there has been limited work on the distribution of pathogens, alternative fecal indicators, and source identification markers in beach sand. The presence of coliphages and Bacteroidales human-specific fecal markers (HF markers) (5, 59) in beach sand has been previously documented (10, 58, 77). In addition, the occurrence of pathogenic and potentially pathogenic bacteria (Salmonella, Campylobacter, Shigella, Pseudomonas aeruginosa, Staphylococcus aureus, Aeromonas, and Vibrio parahaemolyticus), human viruses (adenovirus, enterovirus, norovirus, and hepatitis A virus), amoeba, protozoa, and yeast in beach sand outside (21, 27, 39, 52, 54, 69, 76) and inside (1, 11, 15, 28, 29, 58, 63, 70) the United States has been documented.
The survival and regrowth of FIB in beach sand and sediments has been documented (14, 17, 19, 31, 42), despite low levels of carbon and moisture (2, 78). Beach sand and sediments may provide favorable conditions for persistence and regrowth of FIB by providing protection from sunlight irradiation and predation, favorable nutrient conditions, and colonizable surfaces (17, 25, 61). The growth of both E. coli and enterococci has been investigated in sand using a variety of different conditions, including sterilized, seeded sand and natural, unaltered sand containing an indigenous population of FIB (30). However, only a few studies have documented the survival and persistence of pathogens, and those studies have focused primarily on freshwater sediments (13, 36). Studies in marine sand are limited. Only one study has investigated the persistence of a human pathogen, E. coli O157:H7, in marine beach sand (75).
In the present study, the presence and abundance of E. coli, enterococci, somatic coliphages, a Bacteroidales human-specific fecal marker, Campylobacter spp., Salmonella spp., and S. aureus (including methicillin-resistant S. aureus [MRSA] strains) were documented in beach sand from 53 beaches along the California coast. This work was motivated by the lack of data on pathogens and alternative fecal indicators (e.g., coliphage and human-specific fecal markers) in beach sand. Understanding the relationships between FIB, alternative indicators, and human pathogens is needed to identify pollution sources and to gain insight into the potential health risks associated with exposure to polluted beach sand. This study focused predominately on dry sand (not wetted daily by the tides), because it represents a route for human exposure that includes nonswimmers.
A second objective of this study was to document the survival profiles of selected indicators and pathogens in marine beach sand and to test the hypothesis that persistence is increased when dry sand is subjected to wetting events (e.g., by spring tides). The potential for persistence and mobilization was investigated by establishing column microcosms of natural marine beach sand, amending them with sewage, and analyzing them by both culture-dependent and culture-independent (quantitative PCR [QPCR]) techniques. The persistence of E. coli, enterococci, F+ and somatic coliphages, a human-specific fecal marker in Bacteroidales, Campylobacter spp., and Salmonella spp. in the microcosms was investigated.
MATERIALS AND METHODS
California coast sand survey sites and sample collection.Sand was collected at 53 California beaches between the Mexico and Oregon borders (Fig. 1; see also Table S1 in the supplemental material) on four separate outings between 16 and 29 October 2009. The climate in California is Mediterranean, with distinct dry and wet seasons, and sampling was conducted prior to the onset of the rainy season. In the 3 days prior to sampling, coastal counties reported precipitation of less than 2.5 cm (data not shown) (http://cdec.water.ca.gov). Beaches represented a wide range of natural and anthropogenic conditions, including sand grain size, sand organic carbon content, presence of a putative pollution point source (river, creek, or storm drain), surrounding land use, and degree of shelter from waves; many sites from Yamahara et al. (77) were included. At each beach, two samples of dry, exposed sand were collected from (i) within 1 m above the high tide line, here termed “dry samples,” and (ii) from a location likely to be polluted (e.g., near a flock of birds, storm drain, river, sea wall, or a beach path), referred to here as “targeted samples.” The samples were out of the tidal range during collection, but these sites presumably could be inundated during spring tides or large-wave events. Each sand sample was collected by compositing 10 subsamples (25 ml) to obtain a total volume of 250 ml. Samples were stored on ice and processed within 24 h of collection.
Occurrence of Campylobacter (A), the human-specific fecal marker in Bacteriodales (HF marker) (B), S. aureus, including MRSA (C), and Salmonella (D) in beach sand along the California coast. Inset pie charts indicate the percentages of beaches positive for each organism. n = 53 for all assays (except n = 37 for S. aureus).
Microcosms to study pathogen and fecal indicator persistence and mobilization in sand.Microcosm experiments were conducted to document microbe survival profiles and to test the hypothesis that the persistence of microbes in dry beach sand increases when the sands are subjected to periodic wetting (e.g., spring tides). Acrylic column microcosms were constructed to mimic a vertical section of sand at the beach (78). Columns consisted of a single acrylic tube 22.9 cm in length with an inner diameter of 2.3 cm. Stainless steel mesh (mesh pore size = 0.0625 mm) was used at the top and bottom of the columns to retain sand but allowed water to flow through and help maintain aerobic conditions. Sand collected from Lovers Point, CA (36°37′29″N, 121°54′59″W), was used to pack the columns. Beach sand was collected in sterile 1-liter Whirl-Pak (Nasco, Fort Atkinson, WI) bags within 1 m above the high tide line; the sand was collected from 10 different locations along the shoreline of the beach and homogenized (78). The sand was not washed or sterilized. The sand was then seeded with primary treated sewage (filtered through a 250-μm-pore-size sieve) from the Palo Alto Regional Water Quality Control Plant. A total of 4.5 liters of sewage was added to approximately 6,650 g (∼4.75 liters) of sand. The sewage-sand mixture was mechanically homogenized using a sterilized stainless steel mixing paddle for 5 min, allowed to rest for 30 min, and transferred to a sterile draining container, which allowed excess sewage to drain. Seeded sand was rehomogenized as previously described (78) and packed into 44 columns using a tap and fill procedure. The total mass of sand in each column was ∼133 g (dry weight). To determine the initial concentration of microorganisms, a 100-g sample of the composite sand was removed after packing every seventh column, and the average was used to estimate the initial concentration (n = 6).
Columns were kept in the dark at 22°C for up to 32 days. Equal numbers of columns were designated treatments and controls. Each treatment column was subjected to wetting with 50 ml of seawater (collected at Lovers Point on the day of use and filtered using a 0.22-μm-pore-size filter) and subsequent draining to simulate the natural wetting and draining process that occurs at the upper reaches of the beach during the highest spring tides (78). Here this process is referred to as “watering.” Prior to application of the filtered seawater to the columns, it was tested for all microorganisms assayed during this experiment (see below). Watering was performed in June 2010 on each day that the tide at Lovers Point exceeded 1.85 m (relative to mean sea level) (http://tbone.biol.sc.edu/tide). This datum was chosen as it was at the upper reaches of the tidal excursion at Lovers Point. The tides exceeded the datum on days 10 and 11 of the microcosm experiment. During the watering events, 50 ml of water was applied to the treatment columns and allowed to drain to a catch basin under the influence of gravity. The leachates from all treatment columns were collected and combined for analysis of microorganisms. The concentration of microorganisms in the leachate was multiplied by the collected leachate volume and divided by the dry weight of sand in the column to normalize the number of organisms mobilized to the mass of the sand.
One control and one treatment column were sacrificed (i.e., the entire sand volume of each column was emptied into its own sterile 1-liter beaker) daily for the first 7 days of the experiment. Thereafter, control and treatment columns were sacrificed concurrently approximately every 2 to 3 days. On the 2 days when the columns were watered, treatment columns were sacrificed before watering. Sacrificed sand was homogenized by hand mixing with a sterile spatula for 10 min. Homogenized sand was divided into 2 subsamples: (i) approximately 90 g for elution and membrane filtration and (ii) 20 g for moisture content and organic carbon analyses. All elutions and filtrations were performed immediately after a column was sacrificed.
Methods to analyze microorganisms.Sand collected during the beach survey was analyzed for levels of E. coli, enterococci, somatic coliphages, a Bacteroidales human-specific fecal marker (HF marker), Salmonella spp., Campylobacter spp., S. aureus, and methicillin-resistant S. aureus. Sand microcosms were analyzed for E. coli, enterococci, F+ and somatic coliphages, the HF marker, Salmonella spp., and Campylobacter spp.
Some targets were measured by culture-dependent methods only (E. coli, somatic coliphage, and F+ coliphage) and some by culture-independent methods only (HF marker). Other targets were measured using culture methods supplemented by PCR verification (S. aureus and MRSA), and some targets were measured by both culture-based and QPCR methods (enterococci, Salmonella spp., and Campylobacter spp.). E. coli and enterococci measured by culture-based methods were designated cEC and cENT, respectively. Enterococci, Salmonella spp., and Campylobacter spp. measured by QPCR methods were labeled tENT, total Salmonella, and total Campylobacter, respectively. Note that the analysis for S. aureus was carried out in only 37 beach samples due to analytical constraints (Fig. 1).
For all assays, microorganisms from sand aliquots were eluted using a ratio of eluant volume to sand mass of 10:1 (6). During the beach sand survey and the microcosm experiments, the masses of sand eluted were 60 g and 90 g, respectively. Sand was eluted by a previously described method of shaking by hand using nanopure water (6) or 1× phosphate-buffered saline (PBS) for S. aureus prior to membrane filtration (28). Eluant was membrane filtered through 0.45-μm-pore-size HAWG filters (Millipore, Billerica, MA) for culture methods and through a 0.22-μm-pore-size polycarbonate filter (GE Osmonics, Minnetonka, MN) for QPCR.
Microbial analyses by culture-dependent methods.EPA methods 1604 (67) and 1600 (66) were used to enumerate cEC and cENT, respectively. Survey samples used 50 ml of sand eluant, and microcosm samples used 0.1 to 50 ml, adjusted to ensure a countable number of colonies. All concentrations are reported as CFU per gram of dry weight of sand.
Coliphages were enumerated using a modified version of a previously published protocol for water samples (62). Briefly, MgCl2 (0.05 M final concentration) was added to 100 ml of sand eluants and mixed for 5 min. Sand eluants amended with MgCl2 were membrane filtered through 0.22-μm-pore-size GSWP filters (Millipore, Billerica, MA). Filters were placed face down in 300 μl of 50% glycerol–phosphate-buffered saline and stored at −80°C until analysis. Coliphages were eluted from filters using 2 ml of 3% beef extract (MP Biomedical, Solon, OH) (pH 9.0). A double-agar-layer method using E. coli F-amp (ATCC 700891) for F+ coliphages and E. coli CN13 (ATCC 700609) for somatic coliphages was used to enumerate coliphages by plating 1-ml volumes of beef extract eluants with the appropriate coliphage host. Plaques were counted after 24 h of incubation at 37°C. Only somatic coliphages were enumerated during the coastal sand survey. In the column persistence experiments, both somatic and F+ coliphages were enumerated by aseptically cutting a single membrane filter in half. Coliphage concentrations are reported as PFU per gram of dry weight of sand.
S. aureus enumeration and PCR verification for sand samples were performed according to previously published protocols (28). Briefly, sand eluants (28) were filtered and incubated on CHROMagar Staph aureus (SCA) or CHROMagar MRSA (C-MRSA) (BD Diagnostic, Franklin Lake, NJ) to enumerate S. aureus and MRSA, respectively. SCA plates were incubated at 37°C for 24 h, and C-MRSA plates were incubated at 37°C for 48 h. Filters were refrigerated overnight for color development before counting the number of mauve colonies on the filters was performed. A representative number of mauve colonies (typically 5 to 10 colonies) were picked from each filter and streaked for isolation to verify the presence of S. aureus by appearance (mauve with matte halo). For SCA, this combination of visual identification of colonies on the filter with visual identification of isolated colonies provided a positive agreement (sensitivity) value of 84%, negative agreement (specificity) value of 95%, and positive predictive accuracy value of 99% (28). Further verification of isolate identification was provided by PCR. The source of DNA was crude lysate obtained by heating (95°C, 10 min) an isolated colony in molecular-analysis-grade water with lysostaphin (Sigma catalog no. L7386) (final concentration, 50 μg/ml). Identification of S. aureus was verified by PCR confirmation of the presence of the clfA gene, and MRSA identification was verified by PCR confirmation of the presence of both the clfA and mecA genes (48). Amplification reactions were carried out according to Goodwin and Pobuda (28).
The presence of culturable Salmonella and Campylobacter in each survey sample was assessed by enriching (i) membrane-filtered microorganisms eluted from sand (100-ml filtration [60 g of sand and 600 ml of eluant]) or (ii) an equivalent mass of sand (6 g). Enumeration in microcosm samples was achieved by the most-probable-number (MPN) method (see below) by membrane filtration of triplicate sand eluant volumes (100, 10, and 1 ml) and placing aseptically rolled filters into 25 ml of enrichment broth.
Salmonella detection and enumeration used a modified version of EPA method 1682 for enumeration in biosolids by the MPN method (3, 60, 68). Membrane filters or sands were enriched in 25 ml of tryptic soy broth (TSB) at 37°C for 24 h. TSB enrichments (30 μl) were dropped onto modified semisolid Rappaport-(MSRV) medium (BD Diagnostic) and incubated at 42°C for 24 h. Motile organisms were streaked and incubated (37°C, 24 h) on xylose lysine deoxycholate agar (XLDA) (BD Diagnostic). Colonies displaying typical Salmonella morphology (red-pink or red with black colonies) underwent biochemical confirmation on lysine iron agar (LIA) (BD Diagnostic) and triple-sugar iron agar (TSIA) (BD Diagnostic). Putative positive isolates were archived in 50 μl of 1× Tris-EDTA (TE) buffer and stored at −80°C for confirmation by PCR. DNA was obtained by lysing archived isolates at 85°C for 10 min followed by centrifugation and collection of the supernatant. Lysate supernatants were amplified for the Salmonella genus-specific invA gene by the use of Qiagen Hotstar Plus Master Mix (Qiagen Inc., Valencia, CA) following the PCR conditions in Malorny et al. (46). PCR positives were matched to the appropriate TSB tube, and MPNs were determined using a 3-tube MPN table (3).
Campylobacter detection and enumeration used a modified version of the method of Khan and Edge (38) in which membrane filters or sands were enriched in 25 ml of Bolton broth (catalog no. CM0983; Remel, Lenexa, KS) supplemented with Campylobacter Selective Supplement (catalog no. SR0183; Remel, Lenexa, KS) under microaerophilic conditions at 42°C for 48 h using GasPak 100 systems with EZ Campy Container System sachets (BD Diagnostic). Bolton broth enrichments were streaked onto modified Karmali agar (MKA) (catalog no. CM0935; Remel, Lenexa, KS) supplemented with Campylobacter Selective Supplement Karmali (catalog no. SR0167; Remel, Lenexa, KS) and incubated under microaerophilic conditions at 42°C for 48 h. Colonies displaying typical Campylobacter morphology (white to gray colonies) were picked as presumptive positives. DNA from presumptive positives was obtained as described above for Salmonella, with PCR confirmation targeting Campylobacter 16S rRNA (43). Corresponding positives were matched to the appropriate TSB tube, and MPNs were determined using a 3-tube MPN table (3).
Microbial analyses by culture-independent methods.For all QPCR assays, the membrane filter from a 100-ml volume of sand eluant was folded into a 2.0-ml FastDNA Lysing Matrix E microcentrifuge tube (MP Biomedical, Solon, OH) and stored at −80°C until DNA extraction. Bacterial DNA was extracted using the manufacturer's instructions for the FastDNA Spin kit for soils (MP Biomedical, Solon, OH) (78) as modified by first pulverizing the frozen filters by bead milling (Mini-Beadbeater-1; Biospec Products, Bartlesville, OK) (15 s at 4,800 oscillation/min) and next centrifuging the lysing tubes for 60 s at 24,000 × g. DNA extraction proceeded using a FastPrep instrument (MP Biomedical, Solon, OH) with the addition of a 10-min settling step using binding matrix solution and an additional wash step performed with FastDNA Spin kit SEWS-M solution. DNA was eluted in two 50-μl fractions, for a total of 100 μl. DNA was stored at −80°C until used for downstream PCRs.
QPCR assays (Table 1) used previously published protocols (32, 35, 40, 45, 47). Reaction mixtures consisted of 1× TaqMan Universal Mastermix (Applied Biosystems, Foster City, CA), forward and reverse primers and probe (Table 1), 0.2% bovine serum albumin fraction V (Gibco, Carlsbad, CA), and 2 μl of template DNA (20-μl final volume). Triplicate reactions were run on a StepOnePlus real-time PCR system (Applied Biosystems, Foster City, CA) under the following thermal cycling conditions: 2 min at 50°C and 10 min at 95°C, followed by cycles of 15 s at 95°C and 1 min at the corresponding annealing temperatures and numbers of cycles shown in Table 1. Fluorescence and quantification cycles for each assay were manually adjusted to compare standard curves across runs. Slopes, y intercepts, and reaction efficiencies are presented in Table 1.
QPCR chemistries, conditions, and standard curve parametersa
Genomic DNA (gDNA) standards were generated using Enterococcus faecium (ATCC 19434), Salmonella enterica subsp. enterica serovar Typhimurium LT2 (ATCC 19585), and Campylobacter jejuni (ATCC 700819). Pure cultures of ATCC stocks were grown to the log phase, and DNA was extracted using a QIAmp DNA Mini kit (Qiagen, Valencia, CA). Plasmid DNA standards were created for the HF marker by cloning PCR amplicons into a pCR2.1-TOPO vector, transformation into competent E. coli following manufacturer's protocols (Invitrogen, Carlsbad, CA), and purification using a Qiagen Plasmid Maxi kit (Qiagen, Valencia, CA). Genomic and plasmid DNA was quantified using a NanoDrop ND-1000 spectrophotometer (Nanorop Technologies, Wilmington, DE) and serially diluted to create standards that ranged from 100 to 106 copies (Table 1). Copy numbers and cell equivalents (CE) were calculated utilizing the total genome size and copy numbers of the amplified gene in Enterococcus spp. (6 copies of 23S rRNA [51]), Salmonella spp. (1 copy of the ttrRSBCA locus [49]), and Campylobacter spp. (3 copies of 16S rRNA [55]). For plasmid-generated standards, the total plasmid size was calculated and cell equivalents (CE) were calculated using 6 rRNA operons/genome for the HF marker (71).
QPCR inhibition tests were performed on sand survey samples by comparing bacterial concentrations in undiluted and 1:10-diluted DNA extracts for each assay. QPCR inhibition tests for microcosm samples with enterococci and Campylobacter assays were performed by spiking sample extract with an aliquot of a standard (102 or 103 copies). The inhibition factor (IF) was calculated as previously described in Yamahara et al. (78). The microcosm matrix was fixed over the course of the experiment; therefore, tests for inhibition (10% of the samples) were distributed evenly over the duration of the experiment (n = 7; Table S3 in the supplemental material provides details).
Negative controls and blanks.Culture-dependent and -independent filtration blank experiments were performed with every 6 samples (18 total) for each of the membrane filtration methods used during the California beach survey. During the column microcosm study, a single filtration blank experiment was performed each day (23 total) for each of the culture-dependent and -independent membrane filtration assays. Filtration blank experiments for culture-dependent assays were performed by membrane filtration of 50 ml of 1× PBS rinse solution, and filter blanks were processed as previously described. For culture-independent assays, 50 ml of DNase/RNase-free water was membrane filtered as previously described for the DNA-based assays. An extraction blank was run alongside every 12 samples during DNA extractions (4 total). No-template controls were run on each PCR and QPCR plate.
Determination of beach and sand characteristics.The moisture content (θm) of each sand sample from the beach survey and microcosm columns was determined by drying preweighed sand at 110°C for 24 h. Moisture content was used to normalize all bacterial densities per gram of dry sand. Microcosm sand porosity (φ) and grain size distribution were calculated and used to estimate sand hydraulic conductivity (K) using the Kozeny-Carman method (23).
The organic carbon content by mass (Cm) of sand from the survey was determined for each sand sample using the loss-on-ignition technique (37). Dry sand was combusted at 550°C for 6 h, cooled in a desiccator, and then weighed. The error associated with triplicate Cm measurements was 0.3%.
The grain size of each sand sample from the beach survey was determined by sieving. Percent mass of sand retained on and passing through no. 35 (0.5 mm), no. 60 (0.25 mm), and no. 120 (0.125 mm) sieves was calculated after shaking for 5 min at 4,000 rpm. Percent fine grains (fines) was determined by adding the mass of sand retained and passing through the no. 120 sieve and dividing by the total mass analyzed.
Land cover within a 10-km-radius circular buffer around each beach was determined using the 2001 National Land Cover Data set (USGS [http://seamless.usgs.gov]) and ARCMAP software (ESRI, Redlands, CA) (see Table S2 in the supplemental material). The various land cover classes can be found at http://www.mrlc.gov/nlcd01_leg.php. Land covers were classified as follows: urban (covers 21 to 24), agricultural (covers 81 and 82), and forested (covers 41, 42, 43, 51, 52, 71, and 72). Wetland land covers, barren rock, and unconsolidated shore were characterized as “other.” The fractions of the land that were urban, agricultural, forested, and other were calculated for each of the sampling sites. Urban and agricultural land covers were added to obtain the total developed land cover value; forested land cover was deemed undeveloped.
Decay rate calculations.For the column microcosm studies, decay rates of microorganisms were calculated using the Chick-Watson model (16, 72) as follows: C(t) = C0ek1(t), where C(t) is the concentration at a point in time (t), C0 is the initial concentration, and k1 is the first-order decay constant. Decay rates were calculated using a linear curve fit between the natural log-transformed normalized concentration (ln C/C0) and time. Only data points within the upper and lower detection limits were included in the calculation of decay rates (see Table S4 in the supplemental material). The following were compared: (i) decay rates of individual microorganisms in treatment versus control microcosms and (ii) decay rates between various organisms as measured in the control microcosms. Comparison of regression slopes (decay rates) was accomplished by regressing the two individual first-order curves combined with a dichotomous interaction term as presented in Neter et al. (50).
We tested whether a biphasic decay model could be used to estimate the concentrations of microorganism during the persistence studies (see the supplemental material for methods and results) and found that the biphasic model generally did not improve the fit of the data compared to the Chick-Watson model. Comparisons between the biphasic and Chick-Watson models were based on adjusted R2 and corrected Akaike's Information Criterion (AICc) values (34). Thus, only results from the Chick-Watson model are presented here.
Statistical methods.Statistical analyses were carried out using PASW Statistics, release 18.0.0 (IBM, Chicago, IL). For the beach survey, microbial variables were dichotomous (Salmonella and Campylobacter) or continuous (cENT, tENT, cEC, somatic coliphages, S. aureus, and the HF marker). Values below the lower limit of detection for the continuous variables were assigned a value of zero. Nonparametric statistical methods (Kruskal-Wallis test and Spearman's rank correlation) were used to compare fecal indicators and pathogens measured during the survey. N-way analyses of variance (ANOVA) were used to identify beach and sand characteristics that controlled microbe population variability. Ranked microbial concentrations were used as the dependent variable. The presence of waves, quartile of θm, quartile of Cm, quartile of developed land cover, and presence of a putative source were used as independent variables; no interaction terms were included. Terms were eliminated from the models one by one in cases in which they did not represent a significant percentage of the variance of the dependent variable. All results and relationships were deemed significant at P < 0.05. In some cases, results with P < 0.1 are presented. The mean concentrations reported represent the arithmetic averages, and errors reported represent standard deviations about the mean, unless otherwise noted.
RESULTS
Assay performance.All method blanks were negative, indicating no cross-contamination during filtrations, nucleic-acid extractions, and PCR. DNA extracts from the beach sand survey showed no significant QPCR inhibition. Concentrations measured in the undiluted and 1:10-diluted DNA extracts of positive samples were equivalent, once adjusted for dilution (see Fig. S1 in the supplemental material). Samples that were negative in undiluted DNA extracts were also negative in 1:10-diluted DNA extracts. The QPCR inhibition in samples from the persistence study was inconsequential; the inhibition factor (IF) values ranged from 0.85 to 1.0 and from 0.82 to 1.0 for tENT and Campylobacter assays, respectively (see Table S3 in the supplemental material). QPCR concentrations were not corrected for inhibition.
For the beach survey assays, the lower detection limits were 0.2 CFU/g for cEC and cENT, 0.1 PFU/g for the coliphages, 0.06 CFU/g for S. aureus, 0.2 MPN/g for Salmonella and Campylobacter, 1.9 CE/g for tENT, 3.4 CE/g for the HF marker, 19.1 CE/g for total Salmonella, and 35.1 CE/g for total Campylobacter. For the persistence study, the lower detection limits were 0.2 CFU/g for cEC and cENT, 0.2 PFU/g for coliphages, 0.03 MPN/g for Salmonella and Campylobacter, 2.1 CE/g for tENT, 2.0 CE/g for the HF marker, 1.9 CE/g for total Salmonella, and 10.4 CE/g for total Campylobacter. The detection limits for QPCR-measured organisms were based on standard curve detection (>95% consistent amplification) of 4.2 (tENT), 4.0 (HF marker), 3.8 (total Salmonella), and 21.0 (total Campylobacter) gene copies (Table 1). The precision of the quantification cycle (Cq), reported as percent coefficient of variation, is provided for each QPCR assay (Table 1).
Beach sand survey results.At least one pathogen (Salmonella, Campylobacter, and/or S. aureus) was detected at 28.3% (15/53) of the beaches surveyed, and 7.5% (4/53) of beach samples were positive for at least two of these pathogens. The spatial occurrence of Salmonella, Campylobacter, S. aureus, and the HF marker is shown in Fig. 1. Microbe concentrations for each beach sample are provided in Tables S1 and S2 in the supplemental material.
Overall, cEC was detected at 67.9% (36/53) of the beaches and cENT at 94.3% (50/53). Concentrations of cEC and cENT spanned similar ranges of from 0.19 CFU/g to 142.4 CFU/g. Enterococci (tENT) were detected by QPCR in all samples (100%) and ranged from 3.1 × 100 to 2.0 × 106 CE/g, with average concentrations 2 orders of magnitude higher than those of cENT. Somatic coliphages were detected at 43.3% (23/53) of the beaches, and concentrations ranged from 0.1 to 13.2 PFU/g. The human-specific marker in Bacteroidales (HF marker) was detected at 13.2% (7/53) of beaches, with concentrations ranging from 1.9 to 132.8 CE/g. S. aureus was detected in 13.5% (5/37) of the beaches tested, and concentrations ranged from 0.1 to 71.6 CFU/g. An MRSA isolate was recovered from one beach (1/37) (De Anza Cove, San Diego, CA) (Fig. 1).
Combining results from the two enrichment methods, culturable Salmonella was detected at 11.3% (6/53) of the beaches and culturable Campylobacter at 13.2% (7/53). Differences were observed between culture and QPCR detection. Total Salmonella was detected at 5.7% of the beaches (3/53), with concentrations ranging from 2.9 to 103.3 CE/g, and no Campylobacter was detected by QPCR. The lower occurrence of the QPCR-measured organisms could potentially be a result of the QPCR assays having a lower limit of detection that was higher than that of the culture-based assays. Of the 3 beaches positive for Salmonella by QPCR, only one was also positive by culture.
Differences between the two enrichment methods also were observed. Four sand samples were positive for Salmonella by direct sand enrichment, and four were positive by sand eluant enrichment; however, only one of those eight samples was positive by both methods. The direct sand method was twice as likely to yield Campylobacter compared to the sand eluant method (7 samples for direct versus 3 for eluant); however, none of the 10 samples were positive by both methods. Data were combined from the two measurement methods to obtain a data series representing the occurrence of culturable Campylobacter and Salmonella.
Sample moisture, organic content, and percent fines ranged considerably across samples (θm, 0.08% to 20.4% [wt/wt]; Cm, 0.4% to 3.5% [wt/wt]; percent fines, 0 to 99.1 [wt/wt]). The percentage of fine grains was positively correlated to the moisture content (rs = 0.20; P = 0.04); therefore, only θm and Cm were used as sand characteristic variables in the n-way ANOVAs.
Levels for targeted samples (dry sand near putative pollution sources) were higher than for dry samples (sand above the high tide line) for some but not all parameters investigated. Targeted sample levels were higher for cEC, cENT, somatic coliphages, and θm (Kruskal-Wallis test; P < 0.05). The following variables did not differ significantly between dry and targeted samples: the occurrence of S. aureus, tENT, and the HF marker (Kruskal-Wallis test; P > 0.12), Cm, percent fines (Kruskal-Wallis; P = 0.78), and the occurrence of Salmonella and Campylobacter (Fisher's exact test; P > 0.32). Data from dry and targeted sand samples were combined to probe the relationship between the pathogen and fecal indicators and the beach attributes.
Bivariate analyses revealed a relatively small set of microbial correlations. cEC was positively correlated to cENT (rs = 0.63; P < 0.001), tENT (rs = 0.52; P < 0.001), and somatic coliphages (rs = 0.34; P < 0.001). The HF marker was positively associated with S. aureus (rs = 0.29; P = 0.02). cEC densities were higher when Salmonella were present (Kruskal-Wallis test; P < 0.05). There were no other statistically significant associations between microbes.
In an attempt to describe factors that influenced the occurrence and density of microorganisms, various sand and beach characteristics were investigated (θm, Cm, surrounding land cover, presence of waves, and the presence of a putative pollutant source such as a river, stream, or storm drain). N-way ANOVA analysis suggested that sand moisture content (θm) was an important factor for describing both FIB and pathogens (Table S1 in the supplemental material presents θm values). cEC, cENT, somatic coliphage, Salmonella, and Campylobacter microorganisms were all positively associated with θm (P < 0.001 to 0.05 for each). In addition, cENT was negatively associated with the presence of waves (P = 0.001), and S. aureus was positively associated with the presence of a putative pollutant source (P = 0.04). None of the variables explained variations in the densities of tENT or HF markers.
Persistence of fecal indicators and pathogens in natural beach sand.Column microcosms investigated the persistence of fecal indicators and pathogens in natural sand seeded with sewage. The porosity (φ) and hydraulic conductivity (K) of the sand used for the columns were 0.43 and 0.13 cm/s, respectively. The microorganism survival profiles are presented in Fig. 2 and the initial concentrations in Table 2. cENT, cEC, tENT, the HF marker, Salmonella, and total Salmonella persisted in control columns over the entire duration of the experiment. F+ and somatic coliphages were detected only until days 14 and 24, respectively. Campylobacter spp. were detected only until day 22 of the experiment, and total Campylobacter spp. were detected only until day 3.
Time series of normalized FIB and human pathogen concentrations (C/C0) in microcosm experiments comparing treatment (wetted) to controls. (A to C) Culture-dependent detection of enterococci and E. coli (A), F+ and somatic coliphages (B), and Campylobacter spp. and Salmonella spp. (C). (D to F) Culture-independent quantification of enterococci (tENT) (D), human-specific marker in Bacteroidales (HF marker) (E), and Campylobacter spp. and Salmonella spp. (F). Gray vertical bars show the watering events in treatment columns. Control column decay functions are shown as dashed lines, and treatment decay functions are shown as solid lines. All decay functions are shown for the time interval for which decay rates were calculated. The lower detection limit for microorganisms is denoted by horizontal arrows along the right vertical axes. Initial concentrations of culturable Salmonella were determined at day 5 of the experiment; prior to day 5, all concentrations were over the detection limit.
Decay rates (k1) and initial concentrations (Co) of fecal indicators and pathogens in beach sand within treatment and control columnsa
The persistence of the microorganisms was described using first-order decay rates (k1) and T90 values (time until 90% of microorganisms are inactivated) (Fig. 3 and Table 2). In general, the continuous first-order decay model provided a good estimate of decreasing microbial concentrations (Table 2). The linear curve fit between natural log-transformed concentration and time was statistically significant (P < 0.05) for all microbial strains in the treatment microcosms and for 9 out of the 10 microbial strains in the control microcosms (Table 2). Microorganism persistence was assessed by (i) column decay rates in control columns and (ii) decay rates in treatment versus control columns to assess the effect of watering. Additionally, microorganism concentrations in control and treatment columns were compared using a paired t test for each time point after watering. Prior to watering (days 0 to 10), decay rates did not differ between treatment and control columns for all the organisms tested (P > 0.05 for all).
First-order decay rates of fecal indicators and pathogens in California beach sand during column microcosm experiments. For each microorganism, decay rates are shown for treatment and control columns. The error bars represent 95% confidence intervals.
tENT was the only microorganism (including coliphages) detected in the filtered seawater used for watering treatment columns; concentrations ranged from 3.4 to 11.2 cell equivalents (CE)/ml (average, 6.4 ± 2.7 CE/ml; n = 6). Given that 50 ml of this solution was applied during each watering simulation, approximately 2.4 ± 2.6 CE of tENT per g of sand in the microcosm was added to the column during each watering simulation. This quantity is insignificant given the concentrations of tENT observed in the columns.
Enterococcal decay in microcosms.cENT and tENT persisted for the duration of the experiment. cENT decayed more slowly in the water-treated columns compared to controls (P = 0.04). On average over the entire experiment, the ratio of tENT to cENT was ∼103 CE/CFU, and tENT decayed at approximately half the rate of cENT (P < 0.001). Unlike cENT, no significant difference between treatments and controls for tENT decay rates was observed (P = 0.76).
Populations of cENT and tENT in treatment columns increased at day 12, immediately following watering (Fig. 2A and B). After watering, cENT concentrations in treatment columns were significantly higher than in control columns (paired t test; P < 0.001). tENT concentrations also were higher in treatment columns after watering compared to concentrations in control columns at the α = 0.1 significance level (paired t test; P < 0.09). A higher concentration of cENT and tENT was found in watered treatment columns, despite the fact that a total of 56.9 ± 10.1 CFU/g cENT and 2.2 × 104 ± 1.6 × 103 CE/g tENT were mobilized from columns and collected in leachates.
E. coli decay in microcosms.In contrast to enterococci, decay of cEC was not affected by watering. Treatment and control columns were not significantly different with regard to decay rates (P = 0.96) or the concentrations after watering (paired t test; P = 0.73). In addition, less E. coli mobilization compared to that of enterococci was observed; 4.5 ± 1.4 CFU/g was recovered from the leachates after the two watering events. cEC persisted in control columns until day 30.
Human-specific Bacteroidales decay in microcosms.The HF marker was detected in control columns over the duration of the experiment. The decay rates of the HF marker in control and treatment columns were significantly different at the α = 0.1 level (P = 0.05); decay was faster in the treatment than the control column. The HF marker concentrations were significantly lower in treatments after watering compared to control concentrations (paired t test; P = 0.02). A total of 5.1 × 103 ± 2.7 × 102 CE/g was recovered from leachates during both watering events.
Coliphage decay in microcosms.F+ coliphages persisted through day 15 in control columns. In contrast, somatic coliphages in control columns were detected until the end of the experiment. F+ coliphages decayed significantly faster than somatic coliphages in control columns (P < 0.001). No difference was observed in the decay rates between treatments and control columns for either F+ or somatic coliphages over the entire time series (P = 0.89 and P = 0.99, respectively). However, it should be noted that F+ coliphages were nearly absent in beach sand before the onset of watering. Watering removed a total of 5.5 × 10−3 ± 7.8 × 10−2 PFU/g F+ coliphages and 1.3 ± 0.13 PFU/g somatic coliphages.
Salmonella decay in microcosms.Watering did not affect the persistence of culturable Salmonella. Treatment and control columns were not significantly different with regard to decay rates (P = 0.83) or the concentrations after watering (paired t test; P = 0.58). Over both days of watering, a total of 0.98 ± 0.12 MPN/g culturable Salmonella microorganisms were mobilized and recovered in leachates. Results for Salmonella decay in the control were similar whether measured by culture-dependent or -independent methods. Total Salmonella as measured by QPCR decayed faster than culturable Salmonella in treatment columns (P = 0.01), and the concentrations in treatment columns were significantly lower after watering compared to control column concentrations (paired t test; P = 0.02). A total of 3.2 × 104 ± 1.5 × 103 CE/g total Salmonella microorganisms mobilized from columns and recovered in leachates after the two watering events.
Campylobacter decay in microcosms.Watering did not affect the persistence of culturable Campylobacter. Treatment and control columns were not significantly different with regard to decay rates (P = 0.39). Concentrations after watering could not be compared, because culturable Campylobacter microorganisms were not detected in the treatment columns after watering. However, culturable Campylobacter microorganisms were detected until day 23 in control columns. A total of 3.2 × 10−2 ± 1.2 × 10−1 MPN/g culturable Campylobacter microorganisms were mobilized from columns and recovered in leachates from the watering events.
Total Campylobacter as measured by QPCR had the highest decay rate of all pathogens and indicators in control columns. This result may be an artifact of the fact that the lower limit of detection of the Campylobacter QPCR assay was relatively high. On days when total Campylobacter was not detected, the Campylobacter concentration based on the MPN assay was much lower than the QPCR assay detection limit (assuming that 1 CE is approximately equal to 1 MPN). No difference was observed in total Campylobacter decay data between treatment and control columns (P = 0.52). A total of 6.5 ± 1.8 CE/g was recovered from leachate after the two watering events.
Comparison of fecal indicators and pathogen persistence in microcosms.Similarities between fecal indicators (cENT, tENT, cEC, HF marker, and both coliphages) and pathogen persistence were assessed by comparing control column decay rates (Table 3). No difference was observed in the decay of cENT compared to that of culturable Salmonella, culturable Campylobacter, and total Salmonella (P > 0.06 for all). cEC and F+ coliphage had unique decay profiles that were dissimilar from those of all other pathogens tested. The HF marker decayed at the same rate as total Salmonella (P > 0.16). Somatic coliphage decayed similarly to both culturable and total Salmonella (P > 0.46 for both). No indicator decayed in a fashion similar to that of total Campylobacter.
P values for comparisons of fecal indicators and pathogen or source tracking marker decay ratesa
The persistence of the HF marker, an increasingly popular source identification marker, was compared to the persistence of other indicators. The decay rate of this marker was similar to the decay rate of tENT (P > 0.05) and different from the decay rates of all other indicators (P < 0.05) (Table 3).
DISCUSSION
At least one human pathogen (Salmonella, Campylobacter, or S. aureus) was detected at 28% of the beaches surveyed along the California coast using a combination of culture-dependent and culture-independent methods. While the QPCR methods detect both viable and nonviable pathogens, note that a bacterial pathogen was culturable (e.g., viable) at 26% of the beaches tested. This suggests that beach sand may represent a health risk, a result consistent with recent epidemiological evidence that contact with beach sand is associated with an increased risk of gastrointestinal illness (33).
Moisture content appears to be an important sand characteristic that positively influences the presence and density of indicators and pathogens, as indicated by cEC, cENT, somatic coliphage, Salmonella, and Campylobacter measurements during the California beach survey. This contrasts with the results of Bolton et al. (9), which did not indicate a relationship between sand moisture and the presence of Campylobacter or Salmonella in United Kingdom beach sand. However, the results here are consistent with previous observations indicating that moisture content is a significant factor controlling the persistence of fecal indicators in beach sand (19, 58, 78).
Surrounding land cover and sand organic carbon content were not associated with the presence or density of fecal indicator and pathogens in the tested California beach sands. The presence of a putative source (storm drain, river, or stream) was positively associated with densities of S. aureus but not with any other microbes. The presence of waves was negatively associated with cENT at beaches but was not associated with other microbes. Overall, the ANOVA models did not explain all the variance (maximum of 22%) in the dependent variables, meaning that other factors are likely important. For example, it is possible that rates of discharge from storm drains and antecedent rainfall (>3 days) could be important independent variables that were not accounted for during this survey. The data collected here offer a snapshot of the microbial communities present in the sand; these communities are likely highly dynamic and change in space and time. Future work that probes the temporal and spatial dynamics of these organisms at a particular beach would be useful.
Fecal indicators were not consistently associated with pathogens in California beach sands. This finding is similar to those reported by Shah et al. (58) for a subtropical beach in Florida. In the present study, Salmonella was correlated to cEC, but there were no other significant correlations. Campylobacter showed no significant relationship to any indicator organism, including the HF marker. The correlation observed between Salmonella and cEC in beach sands may suggest that these microorganisms originated from similar sources (26, 53). Moreover, the lack of association between the HF marker, Salmonella, and Campylobacter in sand was suggestive of nonhuman sources of these pathogens in beach sand, such as marine birds and mammals (44, 64). The microcosm studies demonstrated that the HF marker was long lived in beach sand (Fig. 2 and 3); thus, it is unlikely that the lack of association between it and these pathogens was due to its relatively rapid decay in sands.
Overall, the HF marker did not correlate well to other indicators or bacterial pathogens. Nonetheless, it was present in 13.2% of the tested beaches at concentrations of up to 132.8 CE/g. This indicates that human fecal pollution was likely present in some beach sand samples, perhaps from accidental fecal release (24), sewage-contaminated runoff, or infrastructure failures. The HF marker was significantly correlated only to S. aureus. Although S. aureus is primarily shed from the skin (22, 56), genetic signatures can be found in sewage and treated wastewater (12); thus, it is possible that the HF marker and the viable S. aureus detected here were indicators of human sources of pollution. It should be noted, however, that a recent study documented that the HF marker measured here may have exhibited some cross-reactivity with feces from other animal hosts (59).
The persistence studies indicated that many of the organisms detected in the field study can persist for upward of 20 days (average T90 = 20.5 days) in beach sand (the exceptions were cEC, F+ coliphage, and total Campylobacter). Overall, the results suggested that pathogens and indicators found on the beach can be viable and that beach sands may represent a health risk for approximately 3 weeks after the deposition of sewage. The effect of periodic wetting varied depending on the microorganism. Persistence studies suggested that the wetting of sand that occurs at the upper reach of the tidal excursion every 2 weeks during spring tides may prolong the persistence of organisms (cENT), may not appreciably change the persistence (cEC, F+, somatic coliphages, culturable Salmonella, tENT, and culturable and total Campylobacter), or may reduce the persistence (total Salmonella and the HF marker). In the case of enterococci, higher cENT and tENT concentrations in treatment groups compared to controls after watering (and despite significant leaching) may be suggestive of growth. A previous study (78) showed that enterococci can grow in sand and attributed the growth to the presence of moisture, assimilable organic carbon, or trace nutrients. In contrast, the loss of Salmonella from treatment columns during watering suggests reduced persistence for this microorganism. Exposure to oxic water during watering treatments may also have injured oxygen-sensitive microbes, such as the HF marker and Campylobacter, resulting in lower persistence of these microbes.
Overall, the presence and extended persistence of fecal indicators and pathogens in beach sand suggest the importance of the beach as a non-point source of pollution for coastal waters. During wetting, indicators and pathogens were mobilized in the microcosms, perhaps via thin film expansion, air-water interface scouring, and shear mobilization (4, 18), suggesting that a fraction of these organisms are capable of being transported to adjacent waters. These mobilized organisms may enter the water column directly (over-beach transport) (74, 77) or may be transported through the unsaturated zone of the beach to the water table (through-beach transport) (7).
During the column experiments, decay rates measured by culture-independent methods were lower relative to the decay rates measured by culture-dependent methods. Excluding Campylobacter, decay rates for cultured organisms were about 0.1 per day higher than for QPCR-measured organisms (t test, P = 0.05). This result was not surprising given the differences between the two enumeration methods (8, 32, 73). QPCR measures not only live cells but also viable but nonculturable (VBNC) cells (which can still be pathogenic in some cases [57]), dead cells, and exogenous DNA. Thus, rather than measuring only cell inactivation or loss of culturability, the decay rates calculated using culture-independent methods may also, in part, have measured the degradation of genomic DNA. DNA degradation has been shown to be slow relative to the culture-based or infectious equivalent (71).
tENT levels were approximately 2 orders of magnitude higher than cENT levels in sand from the California beach survey and 3 orders of magnitude higher than cENT levels during the persistence experiments. The tENT/cENT ratio observed in the beach survey is similar to previously measured ratios in Lovers Point beach sand (78) and may suggest that a fraction of the tENT were not culturable. During the persistence study, the ratio of tENT/cENT began at 1.2 × 103 CE/CFU and increased at a rate of 202 CE CFU−1 day−1 (data not shown). The initial ratio of 1.2 × 103 CE/CFU suggests that even fresh sewage contains a large fraction of VBNC ENT, dead ENT, and/or exogenous ENT DNA. The increasing ratio observed over time is consistent with cells moving from the culturable state to a VBNC or dead state over time. Differences between tENT and cENT assay specificities may provide another explanation for the high ratio of tENT/cENT.
All of the QPCR assays performed well based on amplification efficiency (>92%), R2 (0.99), and detection limits (3.8 to 4.2 copies/reaction) except for the Campylobacter assay, which had a higher limit of detection (21 copies/reaction) and suboptimal amplification efficiency (85%). These analytical issues may explain the nondetection of total Campylobacter during the California beach survey and the persistence experiments. The results obtained for total Campylobacter measured by QPCR contrast with those obtained for culturable Campylobacter; the latter was detected at seven beaches and for longer than 18 days in the persistence experiments. Based on the lower limit of detection, the culturable Campylobacter assay is more sensitive than the total Campylobacter assay. While inhibition can influence the number of false-negative results, a high degree of inhibition was not observed for the total Campylobacter assay (see Table S3 in the supplemental material). Thus, care should be taken when applying this Campylobacter QPCR assay to environmental samples.
In the present study, coliphages were eluted from sand by the use of nanopure water and vigorous shaking and then eluted from the sand elution membrane filter by the use of beef extract. Previous work studying viruses attached to solids, including sands, used beef extract to elute viruses (10, 41, 65), which aids in reducing attractive forces between virus and solid surfaces but may promote bacterial growth and was thus not used here. The viruses enumerated in the present study included only the subset that were weakly attached to grains and those attached at air-water or at air-water-solid interfaces where interactions between virus and particle could be broken by wetting with nanopure water.
The microcosm experiments were limited with regard to mimicking real-world conditions; thus, caution should be exercised in extending results. Experimental conditions expected to differ from field conditions include sand homogenization, temperature control, UV protection afforded by dark incubations, and slower desiccation due to the lack of winds and heat. In these experiments, natural sand was amended with sewage to represent a fresh sewage spill; however, many beaches have significant non-point sources of pollution which could differ in microbial makeup. Rates of biotic predation may have been impacted by the experimental setup, but the effect is difficult to predict. The natural sands in the microcosm were not sterilized or washed, so the presence of indigenous microbes and protozoa could have predated that of the allochthonous microbes; however, the addition of sewage and column storage could have been suboptimal for grazer persistence, and the sewage likely introduced additional grazers. Despite the difficulties in simulating field conditions, these microcosm experiments are the first to report the persistence of enteric pathogens and source tracking markers in sand and as such provide a basis for future research.
ACKNOWLEDGMENTS
We acknowledge the members of the Boehm laboratory and Allison Pieja, who assisted with the work, and the anonymous reviewers, who provided suggestions for improving the manuscript.
This work was supported by NSF CAREER award BES-0641406 to A.B.B.
FOOTNOTES
- Received 5 August 2011.
- Accepted 3 January 2012.
- Accepted manuscript posted online 13 January 2012.
Supplemental material for this article may be found at http://dx.doi.org/10.1128/AEM.06185-11.
- Copyright © 2012, American Society for Microbiology. All Rights Reserved.
REFERENCES
- 1.↵
- 2.↵
- 3.↵
- 4.↵
- 5.↵
- 6.↵
- 7.↵
- 8.↵
- 9.↵
- 10.↵
- 11.↵
- 12.↵
- 13.↵
- 14.↵
- 15.↵
- 16.↵
- 17.↵
- 18.↵
- 19.↵
- 20.↵
- 21.↵
- 22.↵
- 23.↵
- 24.↵
- 25.↵
- 26.↵
- 27.↵
- 28.↵
- 29.↵
- 30.↵
- 31.↵
- 32.↵
- 33.↵
- 34.↵
- 35.↵
- 36.↵
- 37.↵
- 38.↵
- 39.↵
- 40.↵
- 41.↵
- 42.↵
- 43.↵
- 44.↵
- 45.↵
- 46.↵
- 47.↵
- 48.↵
- 49.↵
- 50.↵
- 51.↵
- 52.↵
- 53.↵
- 54.↵
- 55.↵
- 56.↵
- 57.↵
- 58.↵
- 59.↵
- 60.↵
- 61.↵
- 62.↵
- 63.↵
- 64.↵
- 65.↵
- 66.↵
- 67.↵
- 68.↵
- 69.↵
- 70.↵
- 71.↵
- 72.↵
- 73.↵
- 74.↵
- 75.↵
- 76.↵
- 77.↵
- 78.↵