Slide 1

Slide 1 text

A webapp and repository for multilayer networks LASAGNE Project Meeting 6-7 Nov 2014, QMUL The LASAGNE Multilayer Network Translation Framework Matt Williams, Mirco Musolesi University of Birmingham

Slide 2

Slide 2 text

LASAGNE Multilayer Data Tools • Common format for multilayer network data within LASAGNE • Common format for algorithms • Dissemination to broader multi* research community

Slide 3

Slide 3 text

Outline • LASAGNE data formats recap • Dataset connectors • Translation webapp • Multilayer network repository

Slide 4

Slide 4 text

LMF Formats Source Dataset Connector Metaformat Files Node List Layer List Intra-Layer Edge List Inter-Layer Edge List Aggregate Multiplex File LASAGNE Multilayer Network Framework (LMF)

Slide 5

Slide 5 text

Metaformat Files • Node list • Layer list • Intra-layer edge list • Inter-layer edge list

Slide 6

Slide 6 text

Metaformat Files ↵ L1 L2

Slide 7

Slide 7 text

Metaformat Files ↵ node id time stamp weight ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... node list L1 L2

Slide 8

Slide 8 text

Metaformat Files ↵ layer id label/ weight time stamp ... ... ... ... ... ... layer list L1 L2

Slide 9

Slide 9 text

Metaformat Files ↵ i j α t w intra-layer edge list ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... one file per layer L1 L2

Slide 10

Slide 10 text

Metaformat Files ↵ inter-layer edge list i j α β t w ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... L1 L2

Slide 11

Slide 11 text

LMF Aggregate File nodeID_i nodeID_j layerID_alpha layerID_beta timestamp weight w vi vj ↵ t ... ... ... ... ... ... • Single file representing whole multilayer network

Slide 12

Slide 12 text

Dataset Connectors • Translates source data to LMF metaformat and aggregate • Output as either CSV files or MySQL database

Slide 13

Slide 13 text

Implemented Connectors Noordin Top Terrorist Network Human Brain Connectivity Flight Routes Online Multiplayer Game 45 subjects, obtained via CNRS Subset obtained via MUW

Slide 14

Slide 14 text

Data Format Public Layers Nodes Weighted Time- varying Explicit Inter-Edges Terrorist Pajek ✔ 4 78 ✘ ✘ ✘ Flights Open Flights ✔ 10 100 ✘ ✘ ✘ Pardus Bespoke ✘ 4 2,058 ✘ ✘ ✘ Brain Bespoke ✘ 2 90 ✔ ✘ ✘ Implemented Connectors

Slide 15

Slide 15 text

Command-Line Tools • 4x connectors • Export to MySQL and CSV file • Open source https://github.com/nsds/LMTF-Tools

Slide 16

Slide 16 text

Translation Framework • Easy-to-use web tool for translating data sets • 4x connectors available through webapp

Slide 17

Slide 17 text

LMTF Demo!

Slide 18

Slide 18 text

Translation Framework Web Browser Web Server (Apache) Application Server (LMTF) Translation Working Storage Dataset Repository Job Queue & Dispatcher (beanstalk) http e-mail (smtp) • LMF data packaged as ZIP archive • Delivery via e-mail (URL to ZIP archive) or in-browser

Slide 19

Slide 19 text

Translation Framework

Slide 20

Slide 20 text

LMF Data Repository • Public repository of many multilayer network datasets, stored in LASAGNE data formats • Available as direct download • Current datasets: OpenFlights Routes Noordin Top Terrorist Networks

Slide 21

Slide 21 text

Data Format Public Layers Nodes Weighted Time- varying Explicit Inter-Edges Terrorist Pajek ✔ 4 78 ✘ ✘ ✘ Flights Open Flights ✔ 10 100 ✘ ✘ ✘ Pardus Bespoke ✘ 4 2,058 ✘ ✘ ✘ Brain Bespoke ✘ 2 90 ✔ ✘ ✘ LMF Data Repository

Slide 22

Slide 22 text

Data Format Public Layers Nodes Weighted Time- varying Explicit Inter-Edges Terrorist Pajek ✔ 4 78 ✘ ✘ ✘ Flights Open Flights ✔ 10 100 ✘ ✘ ✘ Pardus Bespoke ✘ 4 2,058 ✘ ✘ ✘ Brain Bespoke ✘ 2 90 ✔ ✘ ✘ LMF Data Repository

Slide 23

Slide 23 text

Deployment • High-performance machine at UoB • 128GB RAM and 2TB working storage • High bandwidth http://pizza.cs.bham.ac.uk/lmtf

Slide 24

Slide 24 text

LMTF Translation Demo!

Slide 25

Slide 25 text

Outlook • LMF: LASAGNE Multilayer Network Format • LMTF: LASAGNE Multilayer Network Translation Framework ‣ Command line tools for translation ‣ Webapp for translation • Connectors so far – testing the framework • Open-source – encourage third party connectors • Ready for dissemination to community

Slide 26

Slide 26 text

Opportunities • Call for more data sources! ‣ New connectors, for variety of types of multilayer dataset ‣ Especially: non-aligned, non-diagonal, time-varying, weighted ‣ Connectors for standard data formats: Gephi GEXF, ... • Expand multilayer network dataset repository • Suggestions very welcome! Propose a dataset, we’ll write a connector! • Collaborate on tools and algorithms for this format

Slide 27

Slide 27 text

Translation framework: Command-line tools and connectors: http://pizza.cs.bham.ac.uk/lmtf https://github.com/nsds/LMTF-Tools https://github.com/nsds/LMTF Source code to be available

Slide 28

Slide 28 text

A webapp and repository for multilayer networks The LASAGNE Multilayer Network Translation Framework Matt Williams, Mirco Musolesi University of Birmingham With thanks to... LMTF contributors: Victor Darvariu, Kevin Pomorski, Demet Turan Data providers: CNRS, MUW M.J.Williams @cs.bham.ac.uk

Slide 29

Slide 29 text

Acknowledgements Brain connectivity diagram Yasser Iturria-Medina, et al. Brain Hemispheric Structural Efficiency and Interconnectivity Rightward Asymmetry in Human and Nonhuman Primates. 2011. [http://cercor.oxfordjournals.org/content/21/1/56] Flight paths visualisation Michael Markieta [http://www.arupconnect.com/2012/12/14/global-flight-paths/] Pizza slice [http://icons.mysitemyway.com/magic-marker-icons-food-beverage/] WWW click icon Freepik [http://www.flaticon.com/free-icon/world-wide-web_1198]