UM Geospatial Digital Special Collections

Citation: Miami-Dade County (2016). Miami-Dade Septic System [gis dataset]. University of Miami GDSC. https://gis-mdc.opendata.arcgis.com/datasets/MDC::doh-septic-system/about. last updated: 2024-05-01 (update frequency: Weekly). Abstract: A collection of polygon features for all buildings within the Urban Development Boundary (UDB) and outside the UDB, approximately 938 square miles. The planimetric layer for Miami-Dade County was previously updated in 2015 byEarth Sciences and Resources Institute (ESRI). This feature class contains features extracted from LiDAR captured by GPI in 2018. Key words: Miami-Dade County, Septic, Septic Systems Open Geospatial Consortium Standards: vector tiles | WMS (coming soon) | WFS (coming soon) Analytical Functions: gdsc_get_attributes(tablename=mdc_septic_systems,lat=25.718,lng=-80.279,identifier=objectid,attrs=[apno,systtype,systaddr,city,zipcode,folio,acreage,wsupltyp,comresid,estimgpd,apprdate,finalinsp,finsysaprv,latorig,lonorig,geofolio,stndaddr,lat,lon,point_x,point_y,creationdate,creator,editdate,editor],normal='') ETL documentation

ETL for mdc_septic_systems

######### # GDSC ETL is performed in two steps: shell script to ETL data into postgres # and then additional transformations with SQL in postGIS (if needed). #### ######### # Step 1 - bash script (pseudo code) #### # create directory structure and move into it mkdir -p /data/mdc_septic_systems/{download,etl} && cd /data/mdc_septic_systems # set update flag based on last update and update frequency do_update=0 if date() < last_update + update_frequency else do_update = 1 # download if update flag is set: if do_update == 1 then ogr2ogr -nln mdc_septic_systems download/mdc_septic_systems.geojson "https://services.arcgis.com/8Pc9XBTAsYuxx9Ny/arcgis/rest/services/DOHSepticSystem_gdb/FeatureServer/0/query?outFields=*&where=1%3D1&outSR=4326&f=geojson" # replace column names Shape__Length and Shape__Area to avoid conflict when # providing as service on ArcServer. sed -i 's/Shape__Length/shape_length/gI; s/Shape__Area/shape_area/gI' download/mdc_septic_systems.geojson # load into postGIS with: ogr2ogr -lco GEOMETRY_NAME=geom -f PostgreSQL PG:"" download/mdc_septic_systems.geojson -nlt point -nln mdc_septic_systems ######### # Step 2 - SQL script (pseudo code): #### # remove duplicate points and make geometries valid: UPDATE mdc_septic_systems SET geom=ST_MakeValid(ST_RemoveRepeatedPoints(geom));" # add local geometry column and reproject existing geometries into local EPSG: SELECT AddGeometryColumn ( 'mdc_septic_systems', 'geom_local',2236,'point',2 ); UPDATE mdc_septic_systems SET geom_local=ST_Transform(geom,2236); CREATE INDEX mdc_septic_systems_geom_local_idx ON mdc_septic_systems USING GIST (geom_local); NOTIFY pgrst, 'reload schema';"