UM Geospatial Digital Special Collections

Citation: City of Miami GIS (2021). City of Miami Neighborhoods [gis dataset]. City of Miami GIS. https://datahub-miamigis.opendata.arcgis.com/datasets/2f54a0cbd67046f2bd100fb735176e6c/explore. last updated: 2024-10-28 (update frequency: As Needed). Abstract: City of Miami Neighborhoods Shapefile Key words: City of Miami, Neighborhoods Open Geospatial Consortium Standards: dynamic vector tiles | | WMS (coming soon) | WFS (coming soon) Analytical Functions: gdsc_get_attributes(tablename=com_neighborhoods,lat=25.718,lng=-80.279,identifier=label,attrs=[label],normal='') ETL documentation

ETL for com_neighborhoods

######### # GDSC ETL is performed in two steps: shell script to ETL data into postgres # and then additional transformations with SQL in postGIS (if needed). #### ######### # Step 1 - bash script (pseudo code) #### # create directory structure and move into it mkdir -p /data/com_neighborhoods/{download,etl} && cd /data/com_neighborhoods # set update flag based on last update and update frequency do_update=0 if date() < last_update + update_frequency else do_update = 1 # download if update flag is set: if do_update == 1 then wget -O download/com_neighborhoods.json 'https://opendata.arcgis.com/api/v3/datasets/2f54a0cbd67046f2bd100fb735176e6c_0/downloads/data?format=geojson&spatialRefId=4326&where=1%3D1' # replace column names Shape__Length and Shape__Area to avoid conflict when # providing as service on ArcServer. sed -i 's/Shape__Length/shape_length/gI; s/Shape__Area/shape_area/gI' download/com_neighborhoods.json # load into postGIS with: ogr2ogr -lco GEOMETRY_NAME=geom -f PostgreSQL PG:"" download/com_neighborhoods.json -nlt multipolygon -nln com_neighborhoods ######### # Step 2 - SQL script (pseudo code): #### # remove duplicate points and make geometries valid: UPDATE com_neighborhoods SET geom=ST_MakeValid(ST_RemoveRepeatedPoints(geom));" # add local geometry column and reproject existing geometries into local EPSG: SELECT AddGeometryColumn ( 'com_neighborhoods', 'geom_local',2236,'multipolygon',2 ); UPDATE com_neighborhoods SET geom_local=ST_MakeValid(ST_RemoveRepeatedPoints(ST_Transform(ST_Multi(geom),2236))); CREATE INDEX com_neighborhoods_geom_local_idx ON com_neighborhoods USING GIST (geom_local); NOTIFY pgrst, 'reload schema';"