A Brand-New Application  of Elixir and Pelemay:  Real-time, High Resolution  Satellite Image Processing

Slide 1

Slide 1 text

A Brand-New Application of Elixir and Pelemay: Real-time, High Resolution Satellite Image Processing Susumu Yamazaki Univ. of Kitakyushu 1 © 2020 Susumu Yamazaki © 2012 Plataformatec © 2018 Susumu Yamazaki & Yuki Hisae

Slide 2

Slide 2 text

Susumu Yamazaki (ZACKY) • Twitter / GitHub / Gmail: ZACKY1972 • Associate Professor • The Leader of the Nudge Social Implementation Research Center • at Univ. of Kitakyushu • Co-author of Pelemay • Co-organizer of ElixirConf JP 2 © 2020 Susumu Yamazaki

Slide 3

Slide 3 text

Slide 4

Slide 4 text

Slide 5

Slide 5 text

Slide 6

Slide 6 text

Slide 7

Slide 7 text

Slide 8

Slide 8 text

Slide 9

Slide 9 text

Slide 10

Slide 10 text

Hisanobu Takayama • He is the CEO of minsora, Inc., a company that has the philosophy, “Change structures of the space industries from the region. Make the outer space more fun and interesting!” • He has organized many projects on outer space, including ALMA telescope (see the upper figure), which is a radio telescope placed in Atacama, HTV (see the lower figure), which supplies resources to the space station, and promoting foundation of business on utilization of outer space. • Currently, he is conducting to create the Asia's first space port and city, and then a new market and ecosystem centered on the port, in Oita, Kyushu, Japan. • He has proposed joint research on utilizing SAR satellites to me. 10 © 2020 Susumu Yamazaki ©JAXA/NASA © NAO

Slide 11

Slide 11 text

Slide 12

Slide 12 text

What is SAR Satellites? • SAR: Synthetic Aperture Radar • They observe the Earth’s surface by microwave (see the right figure), not by radiant rays. • Because SAR is an active sensor unlike an optical passive sensor, they can observe the Earth’s surface even at nighttime when the sun doesn’t reach. • Microwave transmitted by them also passes through even cloud unlike radiant rays. 12 © 2020 Susumu Yamazaki © CRISP, 2001

Slide 13

Slide 13 text

Slide 14

Slide 14 text

How much observation power do SAR satellites have? • SAR satellites can observe always the Earth’s surface even at nighttime and/or in bad weather due to above-mentioned their own principle. • Synspective, one of Japanese enterprise, will deploy 25 SAR satellites, which can identify a 1-3m (3-10 feet) square object on the Earth’s surface. • GeoEye-1 and WorldView-2, SAR satellites of USA, can identify a 50cm (1.6 feet) square object on the Earth’s surface. • iQPS, another of Japanese enterprise, will deploy 36 SAR satellites that can take photographs of almost any point in the world within 10 minutes, and conduct fixed-point observations at particular areas once every 10 minutes. 14 © 2020 Susumu Yamazaki

Slide 15

Slide 15 text

Slide 16

Slide 16 text

What apps will be expected? • Disaster preparation and recovery • Harvest predictions • Economic predictions • Natural environment protection and observation • Physical distribution management • Searching for mineral resources • And so on. 16 © 2020 Susumu Yamazaki

Slide 17

Slide 17 text

Slide 18

Slide 18 text

Slide 19

Slide 19 text

Slide 20

Slide 20 text

Slide 21

Slide 21 text

Slide 22

Slide 22 text

Slide 23

Slide 23 text

Slide 24

Slide 24 text

Slide 25

Slide 25 text

Slide 26

Slide 26 text

Slide 27

Slide 27 text

Slide 28

Slide 28 text

Slide 29

Slide 29 text

Slide 30

Slide 30 text

Slide 31

Slide 31 text

Slide 32

Slide 32 text

Slide 33

Slide 33 text

Slide 34

Slide 34 text

Slide 35

Slide 35 text

Slide 36

Slide 36 text

Slide 37

Slide 37 text

Slide 38

Slide 38 text

Slide 39

Slide 39 text

Slide 40

Slide 40 text

Slide 41

Slide 41 text

Slide 42

Slide 42 text

After the outbreak of Coronavirus… • Tourism has been damaged seriously, because of preventing tourists from moving between areas as well as between countries, and from dinning at restaurant during the tour without any countermeasures against contagion. • It will be important to make tourism profitable by making it efficient, without reducing its attraction and safety. • I hypothesis that transportation during a tour is changed from public one to private one by vehicles. • Navigation for tourists smoothly is one of important measures. • But, gathering personal information by smartphones is not welcome. 42 © 2020 Susumu Yamazaki

Slide 43

Slide 43 text

Smooth navigation by satellites • SAR satellites has a potential to identify all of vehicles and obstacles on roads and parking lots observable from the outer space, once every 10 minutes, even nighttime and/or in bad weather. • So, it can be realized to implement a traffic control system that can identify congestion on every roads and parking lots using image recognition technology to images from satellites. • Of course, it can be realized without any personal information and additional sensors on the roads and parking lots! • I’d like to be going to make this system integrated with other navigation systems, such as Google Maps, in future. 43 © 2020 Susumu Yamazaki

Slide 44

Slide 44 text

Slide 45

Slide 45 text

Sediment disasters are more likely to occur in Japan See the right figure: • The x-axis of it is year. • The y-axis of it shows the total flooded area, the total amount of damage caused by flood, and the ratio. • The blue line shows the flooded area of Japan (square kilometer). • The green line shows the total amount of damage caused by flood of Japan (billion Yen, normalized with the value in 2000). • The gray lines shows the ratio of the total amount of damage to the total flooded area multiplied by 1,000 and the trend line of it, which represents seriousness of the flood damage. 45 © 2020 Susumu Yamazaki The trend line of seriousness of the flood damage has a positive slope!

Slide 46

Slide 46 text

Slide 47

Slide 47 text

A Menace of Flood Damage 47 © 2020 Susumu Yamazaki This is the street view of Toho small town, Fukuoka, Japan, when the flood damage of a very heavy outbreak of rain that poured in west Japan in 2017, which forced us to pay 536,000,000,000 Yen (about 5 billion dollars). You can see this at https://goo.gl/maps/eM6cpL4LpYBMyFig7

Slide 48

Slide 48 text

Slide 49

Slide 49 text

Why is flood damage so serious in Japan? Rivers in Japan are much more rapid than those in the US and Europe. See the right figure: • The x-axis of it is the distance from the estuary (kilometer). • The y-axis of it is the elevation difference from the estuary (meter). • This ellipse surrounds Japanese rivers. 49 © 2020 Susumu Yamazaki Japanese Rivers are like waterfalls! This is because the total area of Japanese mountains and hills is 70% of the whole country.

Slide 50

Slide 50 text

Why is flood damage so serious in Japan? In addition, heavy rainfall becomes more likely in recent years. See the right figure: • The x-axis of it is year. • The y-axis of it is the frequency of rainfall over 50 mm per hour in Japan. • The blue line shows the frequency for each year. • The red line shows the trend line of it. 50 © 2020 Susumu Yamazaki The frequency of heavy rainfall has been increasing! So, flooding has become more likely in Japan in recent years, though flood control has been developed.

Slide 51

Slide 51 text

Slide 52

Slide 52 text

What can satellites support for solving to flood issues? We can find out where there might have been a landslide by following the steps: 1. Take pictures of places with potential heavy rainfall according to the weather forecast, before the heavy rainfall. 2. Take pictures of the places again, during and after the heavy rainfall. 3. Find image differences of the photos before and after the heavy rainfall. Very easy! All we have to do is to do it in time. 52 © 2020 Susumu Yamazaki

Slide 53

Slide 53 text

Slide 54

Slide 54 text

Potential outcome Such a system to detect sediment-related disasters every time even in nighttime and/or in bad weather • Can notify the damage caused by flood quickly to the disaster countermeasures office. • May find houses buried under sand and mud quickly to rescue people from it. • Enables quick and accurate recovery planning by the disaster countermeasures office. We can obtains many benefits by it, as a result. 54 © 2020 Susumu Yamazaki

Slide 55

Slide 55 text

Slide 56

Slide 56 text

Slide 57

Slide 57 text

Slide 58

Slide 58 text

A Brand-New Application: Real-time, High Resolution Satellite Image Processing 58 © 2020 Susumu Yamazaki I’ll build an ecosystem using satellites that enables the proposed apps as well as other useful apps, to be developed!

Slide 59

Slide 59 text

Slide 60

Slide 60 text

Slide 61

Slide 61 text

We need more POWER! • Suppose to utilize full potential of SAR satellites. • Surface area of the Earth is 510,100,000 (five hundred ten million and one hundred thousand) square kilometer. • If the resolution of SAR satellites is supposed to be 50 centimeter, the number of the pixels of the image of the entire Earth will be 2,040,400,000,000,000 (two quadrillion, forty trillion and four hundred billion). • This equals to approximately 246,000,000 (two hundred forty six million) 4K images. • The memory size of raw data of it will be several PB, which equals to several thousands TB! • Such huge images may come every 10 minutes from satellites! • Too huge to be transmitted, processed and memorized, even if using supercomputers… • So, current available computational power in the entire world is not enough to utilize full potential of SAR satellites. 61 © 2020 Susumu Yamazaki

Slide 62

Slide 62 text

Limit the potential of satellites • Within limited local area when observing usually, for example, the Kanmon area; • Within some areas as large as the usual observing area, when observing in emergency; • In order to realize the system with limited available computer resources… Still it requires quite large computational power. 62 © 2020 Susumu Yamazaki ʆ Kammon area about 1,200 square kilometer

Slide 63

Slide 63 text

Slide 64

Slide 64 text

Slide 65

Slide 65 text

What’s Pelemay? •Pelemay is a native compiler for Elixir, which generates SIMD instructions. It has a plan to generate for GPU code. https://github.com/zeam-vm/pelemay •Current Pelemay’s version is 0.0.13. •Supported Platforms: •x86_64 and ARM / macOS, Linux and Nerves •Elixir 1.9 to 1.10 / OTP 20 to 22 •See the upper right figure, which shows sample source code using Pelemay. •See the lower right figure, which shows an additional description to mix.exs. 65 © 2020 Susumu Yamazaki © 2018 Susumu Yamazaki & Yuki Hisae

Slide 66

Slide 66 text

Slide 67

Slide 67 text

How much effective is Pelemay? •Pelemay makes Elixir much faster! •See the right figure: •This shows speed up ratios of the benchmarks by Pelemay to Enum, which is measured by Benchfella. •The speed up ratios of integer calculation, float calculation and string replacement by Pelemay are 2.25x, 4.48x and 3.85x to Enum. •Furthermore, it has more potential to make Elixir much faster, if now-going research and development will be completed! 67 © 2020 Susumu Yamazaki © 2018 Susumu Yamazaki & Yuki Hisae

Slide 68

Slide 68 text

Slide 69

Slide 69 text

A NEW HOPE: Elixir and Pelemay 69 © 2020 Susumu Yamazaki © 2012 Plataformatec © 2018 Susumu Yamazaki & Yuki Hisae • Elixir has enough potential to process concurrency for transmission. • Elixir and Pelemay will provide enough parallel computation for processing.

Slide 70

Slide 70 text

Slide 71

Slide 71 text