UM Geospatial Digital Special Collections

Citation: OpenStreetMap contributors (2024). Miami-Dade County Neighborhoods [gis dataset]. OpenStreetMap. https://www.openstreetmap.org/. last updated: 2024-10-28 (update frequency: As Needed). Abstract: A polygon feature tagged as "place" in Miami-Dade County sourced from OpenStreetMap. Key words: Miami-Dade County, place, OSM, neighborhood, municipality Open Geospatial Consortium Standards: dynamic vector tiles | | WMS (coming soon) | WFS (coming soon) Analytical Functions: gdsc_get_attributes(tablename=mdc_neighborhoods,lat=25.718,lng=-80.279,identifier=name,attrs=[osm_id,name,type,admin_level,boundary,other_tags],normal='') ETL documentation

ETL for mdc_neighborhoods

######### # GDSC ETL is performed in two steps: shell script to ETL data into postgres # and then additional transformations with SQL in postGIS (if needed). #### ######### # Step 1 - bash script (pseudo code) #### # create directory structure and move into it mkdir -p /data/mdc_neighborhoods/{download,etl} && cd /data/mdc_neighborhoods # set update flag based on last update and update frequency do_update=0 if date() < last_update + update_frequency else do_update = 1 # download if update flag is set: if do_update == 1 then curl -o download/mdc_neighborhoods.osm 'https://overpass-api.de/api/interpreter?data=area%5Bname=%22Miami-Dade%20County%22%5D-%3E.a1;(nwr%5Bplace~%22.?*%22%5D(area.a1););(._;>;);out;' # load into postGIS with: ogr2ogr -lco GEOMETRY_NAME=geom -f PostgreSQL PG:"" download/mdc_neighborhoods.osm ######### # Step 2 - SQL script (pseudo code): #### # Select proper geometry into the named table psql -d $POSTGRES_DB -U $POSTGRES_USER -p $POSTGRES_PORT -h postgis-d1gxh00d8j6m2xd0 -c " SELECT * INTO mdc_neighborhoods FROM multipolygons; DROP TABLE IF EXISTS lines; DROP TABLE IF EXISTS multilinestrings; DROP TABLE IF EXISTS multipolygons; DROP TABLE IF EXISTS other_relations; DROP TABLE IF EXISTS points" # remove duplicate points and make geometries valid: UPDATE mdc_neighborhoods SET geom=ST_MakeValid(ST_RemoveRepeatedPoints(geom));" # add local geometry column and reproject existing geometries into local EPSG: SELECT AddGeometryColumn ( 'mdc_neighborhoods', 'geom_local',2236,'multipolygon',2 ); UPDATE mdc_neighborhoods SET geom_local=ST_MakeValid(ST_RemoveRepeatedPoints(ST_Transform(ST_Multi(geom),2236))); CREATE INDEX mdc_neighborhoods_geom_local_idx ON mdc_neighborhoods USING GIST (geom_local); NOTIFY pgrst, 'reload schema';"