San Diego Beachwatch Data, With Features

sandiegodata.org-beachwatch-4 Last Modified: 2018-08-10 22:40

Water quality data for San Diego county beaches from CEDEN, with added features for log transformation, quantiles and group codes.

Beachwatch Data, with Enhanced Features

This datasets rebuilds ceden.waterboards.ca.gov-beachwatch-sandiego with constant and null columns removed and many features added. It also breaks out station information into a seperate datasets, and enumerates the many difference combinations of methodname/analyte/unit, adding a code for each group to the dataset in measure_code. The measure code identifies sets of records that have compatible measurements.

The dataset adds counts, mean, median and quantiles for groups of station_code/measure_code. The dataset rows are grouped, for each station and measure code, and mean, median and quantiles computed for each group. The procedure is performed both for result and for lresult, the log of results.

After computing the group summary statistics, the processing creates dichotomous features for the relationship of result and lresult to the summary value, including:

  • Greater than the median
  • Greater than the mean
  • Less than or equal to the 25th percentile
  • Greater than or equal to the 7th percentile

These variables are particularly useful for doing logistic regressions across the measure code groups or stations.

Elided Columns

This datasets excludes the const and empty columns from the source dataset. These columns and their values are:

program                      BeachWatch
parentproject                BeachWatch_San Diego County
project                      BeachWatch_San Diego County
locationcode                 SurfZone
collectiondepth              -88
unitcollectiondepth          NR
sampletypecode               Grab
collectionreplicate          1
resultsreplicate             1
labsampleid                  Not Recorded
matrixname                   samplewater
mdl                          -88
rl                           -88
batchverification            NR
compliancecode               NR
eventcode                    WQ
protocolcode                 Not Recorded
collectionmethodname         Water_Grab
collectiondevicedescription  Not Recorded
calibrationdate              0000-00-00
positionwatercolumn          Not Recorded
preppreservationname         Not Recorded
preppreservationdate         0000-00-00 00:00:00
digestextractmethod          Not Recorded
digestextractdate            0000-00-00
analysisdate                 0000-00-00
dilutionfactor               -88
expectedvalue                0
submissioncode               NR
county                       San Diego
county_fips                  73
regional_board               San Diego
rb_number                    9
sampleid                     Not Recorded

The dataset also excludes these Null columns:

  • observation
  • samplecomments
  • collectioncomments
  • resultscomments
  • batchcomments
  • groupsamples
  • occupationmethod
  • startingbank
  • distancefrombank
  • unitdistancefrombank
  • streamwidth
  • unitstreamwidth
  • stationwaterdepth
  • unitstationwaterdepth
  • hydromod
  • hydromodloc
  • locationdetailwqcomments
  • channelwidth
  • upstreamlength
  • downstreamlength
  • totalreach
  • locationdetailbacomments
  • huc8
  • huc8_number
  • huc10
  • huc10_number
  • huc12
  • huc12_number
  • waterbody_type

Notes

The most prevalent measure code in this dataset is 24 for Enterococcus (analyte) meaured with Enterolert (methodname) in units of MPN/100 mL. This is probably because in 2004, the EPA changed recomendations to use Enterococcus as a primary indicator bacteria in coastal waters:

EPA subsequently recommended the use of E. coli or enterococci for fresh
recreational waters and enterococci for marine recreational waters because
levels of these organisms more accurately predict acute gastrointestinal
illness than levels of fecal coliforms.

Contacts

Wrangler : Eric Busboom, Civic Knowledge


Loading the ZIP Package

Zip packages are compressed, so large resources may load faster.

import metapack as mp
pkg = mp.open_package('http://library.metatab.org/sandiegodata.org-beachwatch-4.zip')

Loading the CSV Package

CSV packages load resources individually, so small resources may load faster.

import metapack as mp
pkg = mp.open_package('http://library.metatab.org/sandiegodata.org-beachwatch-4.csv')

Data and Resources

Additional Info

Field Value
Version 4
Last Updated August 10, 2018, 22:40 (UTC)
Created August 9, 2018, 23:03 (UTC)
root.ckanid 083b5c5a-d869-4562-a643-a00ee42462a2
root.created 2018-08-07T14:26:42
root.dataset beachwatch
root.declare metatab-latest
root.description for log transformation, quantiles and group codes.
root.giturl https://github.com/san-diego-water-quality/water-datasets.git
root.identifier 2fd7bc17-28c2-4f4a-b494-1d9ca706a79a
root.issued 2018-08-10T22:40:32
root.modified 2018-08-10T22:40:34
root.name sandiegodata.org-beachwatch-4
root.origin sandiegodata.org
root.tag water-project
root.title San Diego Beachwatch Data, With Features
root.version 4