Miami-Dade County Open Data Hub (2022). Miami-Dade County Cooling Centers [gis dataset]. Miami-Dade County. https://mdc.maps.arcgis.com/home/item.html?id=9a42d1aae6e74cdcb2cbc9d82d58d6bd. last updated: 0001-01-01 (update frequency: As Needed). A point feature class with all of the cooling centers in Miami-Dade County. These sites consist of libraries and certain parks and recreation locations. These sites can be activated in case of a heat emergency. Key words: Miami-Dade County Open Geospatial Consortium Standards: dynamic vector tiles | | WMS (coming soon) | WFS (coming soon) Analytical Functions: gdsc_get_attributes(tablename=mdc_cooling_centers,lat=25.718,lng=-80.279,identifier=objectid,normal='') ETL documentation

ETL for mdc_cooling_centers

######### # GDSC ETL is performed in two steps: shell script to ETL data into postgres # and then additional transformations with SQL in postGIS (if needed). #### ######### # Step 1 - bash script (pseudo code) #### # create directory structure and move into it mkdir -p /data/mdc_cooling_centers/{download,etl} && cd /data/mdc_cooling_centers # set update flag based on last update and update frequency do_update=0 if date() < last_update + update_frequency else do_update = 1 # download if update flag is set: if do_update == 1 then wget -O download/mdc_cooling_centers.geojson 'https://services.arcgis.com/8Pc9XBTAsYuxx9Ny/arcgis/rest/services/Cooling_Centers/FeatureServer/0/query?where=1%3D1&outFields=*&returnGeometry=true&outSR=4326&f=geojson' # replace column names Shape__Length and Shape__Area to avoid conflict when # providing as service on ArcServer. sed -i 's/Shape__Length/shape_length/gI; s/Shape__Area/shape_area/gI' download/mdc_cooling_centers.geojson # load into postGIS with: ogr2ogr -lco GEOMETRY_NAME=geom -f PostgreSQL PG:"" download/mdc_cooling_centers.geojson -nlt point -nln mdc_cooling_centers ######### # Step 2 - SQL script (pseudo code): #### # remove duplicate points and make geometries valid: UPDATE mdc_cooling_centers SET geom=ST_MakeValid(ST_RemoveRepeatedPoints(geom)); # add local geometry column and reproject existing geometries into local EPSG: SELECT AddGeometryColumn ( 'mdc_cooling_centers', 'geom_local', 2236, 'point', 2 ); UPDATE mdc_cooling_centers SET geom_local=ST_MakeValid(ST_RemoveRepeatedPoints(ST_Transform(geom,2236))); CREATE INDEX mdc_cooling_centers_geom_local_idx ON mdc_cooling_centers USING GIST (geom_local); NOTIFY pgrst, 'reload schema'; # Move into corrrect directory and create derivative directory in data package on osgeo cd /data/mdc_cooling_centers/ mkdir -p derived # Create shapefile of table in derivate directory on osgeo ogr2ogr -f "ESRI Shapefile" -overwrite derived/mdc_cooling_centers.shp PG:"" mdc_cooling_centers # Create downloadable tarfile of shp in derivative directory on osgeo rm -f derived/mdc_cooling_centers.shp.tar.gz tar -czf derived/mdc_cooling_centers.shp.tar.gz meta_dcat_mdc_cooling_centers.json -C derived mdc_cooling_centers.shp mdc_cooling_centers.prj mdc_cooling_centers.shx mdc_cooling_centers.dbf # Move into correct directory cd /data/mdc_cooling_centers/ # Create pg_dump of table SQL in derivate directory on postgis. pg_dump -h None -t mdc_cooling_centers > derived/mdc_cooling_centers.sql # Create downloadable tarfile of SQL in derivative directory on postgis rm -f derived/mdc_cooling_centers.sql.tar.gz tar -czf derived/mdc_cooling_centers.sql.tar.gz meta_dcat_mdc_cooling_centers.json -C derived mdc_cooling_centers.sql