Introduction to Vector Tiles

Slide 1

Slide 1 text

Introduction to Vector Tiles UN Open GIS Initiative For FOSS4G Thailand 2022 For JICA Knowledge Co-creation Program 2022 Hidenori Map contents of this presentation are not necessarily authorized. Takeaway 1

Slide 2

Slide 2 text

Hello. • I am Hidenori, a government employee contributing to the UN through FOSS4G on web maps. • From OSGeo Japan chapter. • Lead, United Nations Vector Tile Toolkit (UNVT) • Lead, UN Open GIS Initiative Domain Working Group 7 (DWG 7)on Smart Maps • Working for the Geospatial Information Authority of Japan (GSI). • I am talking about Vector Tiles - an industry standard to distribute vector geospatial data on the web. • Presentation goal: to let us think together to keep web maps open - so that everyone can have access to geospatial information for smarter decision. 2

Slide 3

Slide 3 text

Presentation structure 1. Examples 2. Who we are 3. UNVT Portable 4. How we can combine efforts 3 to keep web maps open as UN Open GIS DWG 7

Slide 4

Slide 4 text

1. Examples 1. Examples 2. Who we are 3. UNVT Portable 4. How we can combine efforts 4

Slide 5

Slide 5 text

UN Maps in sync with OpenStreetMap 5 Global coverage updated weekly.

Slide 6

Slide 6 text

GSI Maps - size optimized and int’lized 6 Open Source Government topographic maps in vector tiles

Slide 7

Slide 7 text

GSI Maps - size optimized and int’lized 7 Open Source Rich annotations

Slide 8

Slide 8 text

GSI Maps - size optimized and int’lized 8 Open Source Contour lines

Slide 9

Slide 9 text

GSI Maps - size optimized and int’lized 9 Open Source Detailed roads and tunnels

Slide 10

Slide 10 text

GSI Maps - size optimized and int’lized 10 Open Source Detailed in large scale

Slide 11

Slide 11 text

GSI Maps - size optimized and int’lized 11 Open Source 1:2,500 roads and buildings

Slide 12

Slide 12 text

GSI Maps - size optimized and int’lized 12 Vector Tiles for the whole Japan area available up to 1:2,500. Open Source National dataset in around 30GB.

Slide 13

Slide 13 text

optgeo/protomaps-vector-planet-odbl-port 13 Experimenting PMTiles Open Source

Slide 14

Slide 14 text

optgeo/etak - Estonian open geodata 14 Open Source Demonstrating applicability in various data.

Slide 15

Slide 15 text

optgeo/clear-optbv 15 PoC on UN Clear Map + GSI Maps integration. Open Source Different sources together.

Slide 16

Slide 16 text

optgeo/deck-optbv-intl - Deck.gl example 16 Open Source Make sure our vector tiles work with different libraries.

Slide 17

Slide 17 text

optgeo/jukyo-master - Gov’t address data 17 Open Source Address data being developed by the Government of Japan

Slide 18

Slide 18 text

optgeo/jukyo-master - Gov’t address data 18 Open Source Use heat maps to show the data density.

Slide 19

Slide 19 text

optgeo/jukyo-master - Gov’t address data 19 Open Source Street level details.

Slide 20

Slide 20 text

optgeo/jukyo-master - Gov’t address data 20 Open Source House numbers when zoomed.

Slide 21

Slide 21 text

21 Covering 3D - terrain and point clouds, too.

Slide 22

Slide 22 text

optgeo/nagi-vi 22 Buildings + terrain + orthophoto, with tilt-shift effect. Covering whole Japan. Open Source

Slide 23

Slide 23 text

optgeo/togari (⿃狩) 23 Light-weight visualization of point clouds. - ”Voxel Tiles” Open Source City area

Slide 24

Slide 24 text

optgeo/togari (⿃狩) 24 Light-weight visualization of point clouds. - ”Voxel Tiles” Open Source Mountains

Slide 25

Slide 25 text

optgeo/tansei (淡⻘) COPC visualization 25 Experimenting with open point cloud data from Virtual Shizuoka project.

Slide 26

Slide 26 text

Slide 27

Slide 27 text

Click each box to see COPC data 27 Open Source also to download them.

Slide 28

Slide 28 text

Slide 29

Slide 29 text

COPC is easy. But it is big. 29

Slide 30

Slide 30 text

COPC is easy. But it is big. 30 300m x 400m Typical size = 100MB

Slide 31

Slide 31 text

2. Who we are 1. Examples 2. Who we are 3. UNVT Portable 4. How we can combine efforts 31 as DWG 7

Slide 32

Slide 32 text

DWG 7 Smart Maps 1. We are a part of the UN Open GIS Initiative. 2. We are Domain Working Group 7 (DWG 7) on Smart Maps. 3. UN Vector Tile Toolkit is now a brand under DWG 7. 32 UN Open GIS Initiative DWG 7 on Smart Maps

Slide 33

Slide 33 text

DWG 7 Smart Maps UN Open GIS Initiative (http://unopengis.org/): 1. The initiative to identify and develop an Open Source GIS bundle that meets the requirement of UN Operations. 2. United effort to improve the effectiveness and efficiency of utilizing Open Source GIS around the world. 33 UN Open GIS Initiative DWG 7 on Smart Maps

Slide 34

Slide 34 text

DWG 7 Smart Maps Domain Working Group (DWG) 7 on Smart Maps (http://github.com/unopengis/7): ü We want to make it an open global practice community of engineers and operators who are keeping web maps open and diverse. ü Participants bring their high-level objectives with clearly defined owners and success criteria to get all the DWG members on the same page. ü We currently have 7 objectives. 34 UN Open GIS Initiative DWG 7 on Smart Maps

Slide 35

Slide 35 text

DWG 7 Smart Maps United Nations Vector Tile Toolkit (http://unvt.github.io): ü A collection of Open Source Software (OSS) to produce, host, style and optimize vector tiles for web mapping. 35 UN Open GIS Initiative DWG 7 on Smart Maps

Slide 36

Slide 36 text

2022 Upgrade from UNVT to Smart Maps • UNVT was a sub-project under UN Open GIS Initiative WG3 on Data Collection since 2018. • DWG7 on Smart Maps was newly established based on UNVT at the UN Open GIS Conference in Firenze, Italy 2022-08. • Smart Maps are user-oriented rather than technology-oriented. • Smart = Fast + Simple. • Smart Maps are not only about 2D vector data - also about 3D and real time. 36

Slide 37

Slide 37 text

Smart Maps - UNVT = DEM + COPC + LOD1 1. Digital Elevation Model (DEM) in Terrain Tiles 2. Point Cloud in Cloud Optimized Point Cloud (COPC) 3. 3D City Models, firstly in LOD1, as Vector Tiles Smart Maps DWG takes advantage of base map expertise: Ø Data optimization based on the map scale. Ø Seamless integration of geospatial data. Vector Tiles continue to take the central part. But we also work with DEM, COPC, and LOD1 City Models. Metaphor 37

Slide 38

Slide 38 text

7 Objectives under DWG7 38

Slide 39

Slide 39 text

7 Objectives under DWG7 #1 UN operation by Taro U Basemap, terrain, satellite images with UN Global Service Centre. 39

Slide 40

Slide 40 text

7 Objectives under DWG7 #2 GSI operation by Hidenori Basemap, COPC, and capacity building. 40

Slide 41

Slide 41 text

7 Objectives under DWG7 #3 UNVT Portable by Taichi Capacity building and Disaster Response with Local Gov’ts 41

Slide 42

Slide 42 text

7 Objectives under DWG7 #4 Smart Campus by Santosh (Nascent, Ahmedabad, India) Smart Campus solution hosting 42

Slide 43

Slide 43 text

7 Objectives under DWG7 #5 3D Spatial ID by Takayuki (Geolonia, Japan) 3D geospatial data free flow by extending vector tiles for 3D apps. 43

Slide 44

Slide 44 text

7 Objectives under DWG7 44 #6 3D Sensor lntegration by Hidenori Add Smart Maps values to existing sensor network infrastructure.

Slide 45

Slide 45 text

7 Objectives under DWG7 45 #7 Core by Taro M Document, package, contribute to essential tools for Smart Maps.

Slide 46

Slide 46 text

7 Objectives under DWG7 46 #7 Core by Taro M Document, package, contribute to essential tools for Smart Maps. YAML-based vector tile styling tool donated by Geolonia to UNVT.

Slide 47

Slide 47 text

7 Objectives under DWG7 47 #7 Core by Taro M Document, package, contribute to essential tools for Smart Maps.

Slide 48

Slide 48 text

Details: DWG7 Project Document Please see https://github.com/UNopenGIS/7/wiki/Project-Document 48

Slide 49

Slide 49 text

3. UNVT Portable 1. Examples 2. Who we are 3. UNVT Portable 4. How we can combine efforts 49

Slide 50

Slide 50 text

UNVT Portable - Raspberry Pi map server 50 Raspberry Pi - single-board PC developed by Raspberry Pi foundation.

Slide 51

Slide 51 text

UNVT Portable - what and why • What • Single-board PC that works as a web map server. • Why • We needed an easy access to UNIX for capacity building. • We needed a cheap server that hosts data at the scale of 100GB. • GitHub Pages are good up to 1GB. • We use GitHub Pages for 100MB while we use UNVT Portable for 100GB. • We expect potential use for resource-limited environments. 1. For disaster situations. 2. For local governments. 3. For capacity building. • I run a UNVT Portable server with 2TB of storage from home. 51

Slide 52

Slide 52 text

Benefit of UNVT Portable 1. We can easily experiment technologies used in cloud-native environments. 2. UNVT Portable is like a sky lantern because it can reach the “height of the cloud” in an affordable way. 3. With multiple “sky lanterns” we can develop practical technologies combining existing tools. A) In-house object storage B) Battery-powered server Richy Metaphor 52

Slide 53

Slide 53 text

Experiment A: in-house object storage • COPC requires 100 times bigger storage. • Before COPC: 30GB - the size of microSD card. • After COPC: 3TB - the size of multiple external storage. • I am experimenting with MinIO - open source object storage software. 53

Slide 54

Slide 54 text

MinIO storing COPC 54 3TB object storage with single-board PCs. Not very fast, but somewhat usable. And it works as a home server.

Slide 55

Slide 55 text

Experiment B: off the grid • Can we run a UNVT Portable with mobile battery and solar panel? • Result is positive. Estimated running hours: 55 20100 mAh battery 18 hours 10000 mAh battery 10 hours 5000 mAh battery 4 hours Tested with ANKER PowerCore.

Slide 56

Slide 56 text

Application of UNVT Portable UNVT Portable = Cloud technology at hand • “Forward deployment” of the web map servers. üFor local governments and schools. üFor disaster situations. 56 Experiment Capacity Building Forward Deployment Application of UNVT Portable

Slide 57

Slide 57 text

4. How we can combine efforts 1. Examples 2. Who we are 3. UNVT Portable 4. How we can combine efforts 57

Slide 58

Slide 58 text

How we can combine efforts • DWG 7 is open. • It would be great if you participate! 58 Mission Community promises and values How to get involved UN Open GIS DWG 7

Slide 59

Slide 59 text

Mission We build a global community of engineers and operators who are keeping web maps open and diverse. Current active participants include: United Nations Geospatial Information Section, United Nations Global Service Centre, Geospatial Information Authority of Japan, Aoyama Gakuin University, Crisis Mappers Japan, DRONEBIRD, Japan Flying Labs, Tokyo Cartographic, Nascent Infotechnologies, Geolonia. Participated by public, private, and academia. 59

Slide 60

Slide 60 text

Community Promises 1. We treat people as equals. Everyone is welcome. 2. We prefer open collaboration. 3. Contributions are esteemed by their merit. 4. We respect data producers. 5. We criticize ideas, not people. 6. We believe in fail forward to learn and improve. 60

Slide 61

Slide 61 text

Ground rules 1. We move by empathy and trust, not by requests. 2. It is OK to use local languages. It is nice to use common languages. 61 Some participants meets weekly using Japanese language. Why don’t you meet using Thai language? We can meet using English language, too.

Slide 62

Slide 62 text

Community value statement 1. We support participants to design, produce, style, host and optimize vector tiles. 2. We support participants to cope with resource-limited environments. 3. We support participants to learn about use cases. 4. We support participants to have fun. 5. We support participants to introduce new ideas. 6. We support participants to help each other. 7. We support participants to handle images, raster data (terrain tiles), point clouds, and 3D city models, too. 62

Slide 63

Slide 63 text

How to get involved Visit our repository to see what is happening. • https://github.com/unopengis/7 Contact me. Ask any question. • Connect Hidenori Fujimura on Facebook. • Connect Hidenori Fujimura on LinkedIn. Bring your own objective and let’s collaborate. Thank you. 63

Slide 64

Slide 64 text

Introduction to Vector Tiles UN Open GIS Initiative For FOSS4G Thailand 2022 For JICA Knowledge Co-creation Program 2022 Hidenori Takeaway 64