UM Geospatial Digital Special Collections

Citation: Florida Department of Environmental Protection and Division of Waste Management (2001). Florida Superfund Waste Cleanup Sites [gis dataset]. FDEP Open Data Administrator. https://geodata.dep.state.fl.us/datasets/FDEP::florida-superfund-waste-cleanup-sites/about. last updated: 2024-10-28 (update frequency: 1 day). Abstract: Point feature class of the superfund sites in Florida from the National Priority List (NPL). Key words: Florida, Superfund Waste Cleanup Site, Safety, Public Health, Pollution, Contamination, Superfund Open Geospatial Consortium Standards: dynamic vector tiles | | WMS (coming soon) | WFS (coming soon) Analytical Functions: gdsc_nearest_neighbor(table=fl_superfund_waste_cleanup_sites,lat=25.718,lng=-80.279,id=name) ETL documentation

ETL for fl_superfund_waste_cleanup_sites

######### # GDSC ETL is performed in two steps: shell script to ETL data into postgres # and then additional transformations with SQL in postGIS (if needed). #### ######### # Step 1 - bash script (pseudo code) #### # create directory structure and move into it mkdir -p /data/fl_superfund_waste_cleanup_sites/{download,etl} && cd /data/fl_superfund_waste_cleanup_sites # set update flag based on last update and update frequency do_update=0 if date() < last_update + update_frequency else do_update = 1 # download if update flag is set: if do_update == 1 then wget -O download/fl_superfund_waste_cleanup_sites.json 'https://ca.dep.state.fl.us/arcgis/rest/services/OpenData/CLEANUP_SP/MapServer/1/query?where=1%3D1&outFields=*&outSR=4326&f=json' # replace column names Shape__Length and Shape__Area to avoid conflict when # providing as service on ArcServer. sed -i 's/Shape__Length/shape_length/gI; s/Shape__Area/shape_area/gI' download/fl_superfund_waste_cleanup_sites.json # load into postGIS with: ogr2ogr -lco GEOMETRY_NAME=geom -f PostgreSQL PG:"" download/fl_superfund_waste_cleanup_sites.json -nlt point -nln fl_superfund_waste_cleanup_sites ######### # Step 2 - SQL script (pseudo code): #### # remove duplicate points and make geometries valid: UPDATE fl_superfund_waste_cleanup_sites SET geom=ST_MakeValid(ST_RemoveRepeatedPoints(geom));" # add local geometry column and reproject existing geometries into local EPSG: SELECT AddGeometryColumn ( 'fl_superfund_waste_cleanup_sites', 'geom_local',2236,'point',2 ); UPDATE fl_superfund_waste_cleanup_sites SET geom_local=ST_MakeValid(ST_RemoveRepeatedPoints(ST_Transform(geom,2236))); CREATE INDEX fl_superfund_waste_cleanup_sites_geom_local_idx ON fl_superfund_waste_cleanup_sites USING GIST (geom_local); NOTIFY pgrst, 'reload schema';"