An epistemological experiment: issue mapping, data journalism and the public understanding of complex issues

Slide 1

Slide 1 text

An epistemological experiment: issue mapping, data journalism and the public understanding of complex issues 27th October 2014, Utrecht Data School, Utrecht University Liliana Bounegru | lilianabounegru.org | @bb_liliana! Jonathan Gray | jonathangray.org | @jwyg

Slide 2

Slide 2 text

Gray, J., Bounegru, L. & Chambers, L. (2012) The Data Journalism Handbook.! Available at: http://datajournalismhandbook.org/

Slide 3

Slide 3 text

Rogers, R. (2013) Digital Methods.  Cambridge, MA: MIT Press.

Slide 4

Slide 4 text

“An epistemological experiment”

Slide 5

Slide 5 text

social science researchers leading digital newsrooms new ways of covering complex issues = +

Slide 6

Slide 6 text

social science! researchers leading digital newsrooms new ways of covering complex issues = +

Slide 7

Slide 7 text

Using digital traces to study the social: actor-network theory, issue mapping, digital methods

Slide 8

Slide 8 text

– Bruno Latour, Reassembling the Social: An Introduction to Actor-Network Theory (2005) “[T]here is nothing speciﬁc to social order; (…) there is no social dimension of any sort, no social ‘context’, no distinct domain of reality to which the label ‘social’ or ‘society’ could be attributed; (…) no ‘social force’ is available to ‘explain’ the residual features other domains cannot account for (…) and (…) society, far from being the context ‘in which’ everything is framed, should rather be constructed as one of the many connecting elements circulating in tiny conduits”

Slide 9

Slide 9 text

“The social is visible only by the traces it leaves..” – Bruno Latour, Reassembling the Social: An Introduction to Actor-Network Theory (2005)

Slide 10

Slide 10 text

“The interest of electronic media lies in the fact that every interaction that passes through them leaves traces..” – Bruno Latour & Tommaso Venturini, “The Social Fabric: Digital Traces and Quali-quantitative Methods” (2009)

Slide 11

Slide 11 text

Digital methods are “methods of the medium” designed to repurpose digital objects such as tags, likes, links and hashtags to study issues. – Digital Methods Initiative,  University of Amsterdam

Slide 12

Slide 12 text

Three examples:! 1. climate change negotiations! 2. rise of the far right in Europe! 3. health worker migration

Slide 13

Slide 13 text

Example #1:! mapping dominant topics and countries in UN climate negotiations

Slide 14

Slide 14 text

EMAPS (2014) “Climaps: A Global Issue Atlas of Climate Change Adaptation”! Available at: http://climaps.org/

Slide 15

Slide 15 text

“Adaptation turn”

Slide 16

Slide 16 text

– Leo Hickman, “Can carbon offsetting ever be truly green?”,  The Guardian, 3rd September 2008. “In what seems like a ﬂash, the climate-change debate has lurched from talk of mitigation to one of adaptation.”

Slide 17

Slide 17 text

The Atlantic (2014) “The UN's New Focus: Surviving, Not Stopping, Climate Change”.  Available at: http://www.theatlantic.com/international/archive/2014/04/the-uns-new-focus-surviving-not- stopping-climate-change/359929/

Slide 18

Slide 18 text

Can the shift from mitigation to adaptation be observed in the UNFCCC negotiations?

Slide 19

Slide 19 text

Venturini, T., Baya-lafﬁte, N., Cointet, J., Gray, I., Zabban, V., & De Pryck, K. (2014) “Three Maps and Three Misunderstandings : A Digital Mapping of Climate Diplomacy.” Big Data and Society, 2014, 1(1).   Available at: http://medialab.sciences-po.fr/publications/misunderstandings/

Slide 20

Slide 20 text

Findings! Mitigation is more dominant - the majority of the clusters are about mitigation. Mitigation is much more diverse and distributed. Adaptation is a much more tightly clustered topic and highly connected to other topics.

Slide 21

Slide 21 text

Slide 22

Slide 22 text

Slide 23

Slide 23 text

Findings! Both adaptation and mitigation are highly visible in negotiations.    Adaptation ﬁnancing has been central to climate negotiations from the outset. There is a noticeable shift towards adaptation during the period we examined.

Slide 24

Slide 24 text

Slide 25

Slide 25 text

Which countries intervene most in UN climate negotiations and how do these interventions evolve over time?

Slide 26

Slide 26 text

Graphing the number of interventions in the negotiations of the 21 most active countries based on daily summaries from the Earth Negotiations Bulletin (ENB)

Slide 27

Slide 27 text

Slide 28

Slide 28 text

Findings! Notable stability in presence and intervention of countries. Notable exceptions include Bolivia and Philippines who are becoming more prominent in recent negotiations. Most active are China (representing G77), United States and Europe. Countries tend to be more active when they host the negotiations.

Slide 29

Slide 29 text

Slide 30

Slide 30 text

Wired Italia (2014) “Cambiamenti del clima: 20 anni di conferenze”. March 2014. No. 60.

Slide 31

Slide 31 text

Wired Italia (2014) “Cambiamenti del clima: 20 anni di conferenze”. March 2014. No. 60.

Slide 32

Slide 32 text

Wired Italia (2014) “Cambiamenti del clima: 20 anni di conferenze”. March 2014. No. 60.

Slide 33

Slide 33 text

Wired Italia (2014) “Beautiful Information, in mostra le migliori infograﬁche di Wired”.  Available at: http://www.wired.it/attualita/media/2014/03/04/beautiful-information-infograﬁche-wired/

Slide 34

Slide 34 text

Slide 35

Slide 35 text

Example #2:! mapping the rise of the far right in Europe with the web and social media

Slide 36

Slide 36 text

The Guardian (2013) “The rise of far right parties across Europe is a chilling echo of the 1930s”.  Available at: http://www.theguardian.com/commentisfree/2013/nov/15/far-right-threat-europe-integration

Slide 37

Slide 37 text

Hufﬁngton Post (2014) “Sudden Rise of Far Right Groups in EU Parliament Rings Alarm Bells Across Europe”. Available at: http://www.hufﬁngtonpost.com/elinadav-heymann/sudden-rise-of-far-right- _b_5512961.html

Slide 38

Slide 38 text

New York Times (2014) “Populist Party Gaining Muscle to Push Britain to the Right”.  Available at: http://www.nytimes.com/2014/05/08/world/europe/populist-party-gaining-muscle-to-push- britain-to-the-right.html

Slide 39

Slide 39 text

What are the recruitment methods  of far right groups?

Slide 40

Slide 40 text

Are current recruitment counter-measures proving effective?

Slide 41

Slide 41 text

What kinds of issues are most active amongst far right groups?

Slide 42

Slide 42 text

How are far right extremist groups connected to populist right and other right wing groups?

Slide 43

Slide 43 text

Proﬁles for 13 European countries.

Slide 44

Slide 44 text

1. List of links per country 2. Analyse links between them 3. Study issues and actors

Slide 45

Slide 45 text

Findings  New issues (e.g. environment, anti- globalisation and rights), principles and recruitment techniques.   Counter-measures are outdated. ! Islamophobia is located primarily in the North.

Slide 46

Slide 46 text

Greece: blood and soil and organic markets

Slide 47

Slide 47 text

Rogers, R. et al (2013) “Right-Wing Formations in Europe and Their Counter-Measures: An Online Mapping”. Digital Methods Initiative. https://wiki.digitalmethods.net/Dmi/RightWingPopulismStudy

Slide 48

Slide 48 text

No content

Slide 49

Slide 49 text

Hungary: horse and yurt recruitment festivals

Slide 50

Slide 50 text

Rogers, R. et al (2013) “Right-Wing Formations in Europe and Their Counter-Measures: An Online Mapping”. Digital Methods Initiative. https://wiki.digitalmethods.net/Dmi/RightWingPopulismStudy

Slide 51

Slide 51 text

No content

Slide 52

Slide 52 text

Taking back the yurt?

Slide 53

Slide 53 text

Counter-Jihadist groups on social media

Slide 54

Slide 54 text

The Guardian (2012) “Far-right anti-Muslim network on rise globally as Breivik trial opens”. Available at: http://www.theguardian.com/world/2012/apr/14/breivik-trial-norway-mass-murderer

Slide 55

Slide 55 text

Hope Not Hate (2012) “Counter-Jihad Report”.  Available at: http://www.hopenothate.org.uk/counter-jihad/

Slide 56

Slide 56 text

Are different Counter-Jihadist groups in Europe connected? If so how?

Slide 57

Slide 57 text

Digital Methods Initiative. “Counter-Jihadist Networks: Mapping the Connections Between Facebook Groups in Europe.”

Slide 58

Slide 58 text

Digital Methods Initiative. “Counter-Jihadist Networks: Mapping the Connections Between Facebook Groups in Europe.”

Slide 59

Slide 59 text

Findings    Facebook is an important medium for extremist groups. ! Three main clusters based on geographical proximity. ! European Counter-Jihadist groups are networked and transnational.

Slide 60

Slide 60 text

Digital Methods Initiative. “Counter-Jihadist Networks: Mapping the Connections Between Facebook Groups in Europe.”

Slide 61

Slide 61 text

Who are the new leaders?

Slide 62

Slide 62 text

No content

Slide 63

Slide 63 text

Findings! ! Ofﬂine leaders are active on Facebook. ! There are also new emerging online leaders. ! New technique for identifying online leaders.

Slide 64

Slide 64 text

Example #3:! who’s talking about health worker migration?

Slide 65

Slide 65 text

“care drain”

Slide 66

Slide 66 text

Mills et al (2008). “Should active recruitment of health workers from ! sub-Saharan Africa be viewed as a crime?”. Lancet 2008; 371: 685–88.

Slide 67

Slide 67 text

The Guardian (2011). “Assessing the cause and effect of health worker migration”.! Available at: http://www.theguardian.com/global-health-workers/health-workers-move-from-area-of-origin

Slide 68

Slide 68 text

– Sue George, “Assessing the cause and effect of health  worker migration”, The Guardian, 18th January 2011. “Health worker migration is a big issue – in 2005, it was widely reported that there were more Malawian doctors in Manchester than Malawi. Now, it seems, there are more Ethiopian doctors in Chicago than in Ethiopia.”

Slide 69

Slide 69 text

– Sue George, “Assessing the cause and effect of health  worker migration”, The Guardian, 18th January 2011. “[a 2010 global code of practice] sets out guiding principles and voluntary international standards for recruitment of health workers, to increase the consistency of national policies and discourage unethical practices”

Slide 70

Slide 70 text

Which actors in the UK health sector are talking about the migration of health workers?

Slide 71

Slide 71 text

Rogers, R., Sanchez Querubin, N. & Kril, A. (2015) Ageing Places: A Digital Issue Mapping.  Amsterdam: University of Amsterdam Press.

Slide 72

Slide 72 text

Findings for UK! Notable difference between sectors. Most vocal are government and academia.    Less discussion amongst healthcare NGOs. Next to no discussion in private sector.

Slide 73

Slide 73 text

Who is recruiting Polish health workers?

Slide 74

Slide 74 text

Findings for Poland! ! Demand for Polish care workers greater outside country than within. ! Based on recruitment postings, Poland looks to be susceptible to care drain.

Slide 75

Slide 75 text

Rogers, R., Sanchez Querubin, N. & Kril, A. (2015) Ageing Places: A Digital Issue Mapping.  Amsterdam: University of Amsterdam Press.

Slide 76

Slide 76 text

Digital tools and methods

Slide 77

Slide 77 text

Digital Methods Initiative (2014) DMI Tools.! Available at: http://tools.digitalmethods.net

Slide 78

Slide 78 text

Sciences Po Media Lab (2014) “Tools we develop and tools we use”! Available at: http://tools.medialab.sciences-po.fr/

Slide 79

Slide 79 text

“Netvizz is a tool that extracts data from different sections of the Facebook platform (personal proﬁle, groups, pages) for research purposes.”

Slide 80

Slide 80 text

Rieder, B. (2013). Studying Facebook via data extraction: the Netvizz application. In WebSci '13 Proceedings of the 5th Annual ACM Web Science Conference (pp. 346-355). New York: ACM.

Slide 81

Slide 81 text

Netvizz: https://tools.digitalmethods.net/netvizz/facebook/netvizz/

Slide 82

Slide 82 text

“The Twitter Capture and Analysis Toolset  (DMI-TCAT) captures tweets and allows for multiple analyses (hashtags, mentions, users, search, ...).”

Slide 83

Slide 83 text

Borra, E. & Rieder, B. (2014) “Programmed method: developing a toolset for capturing and analyzing tweets”. Aslib Journal of Information Management. Vol. 66 No. 3: 262-278.

Slide 84

Slide 84 text

TCAT: https://wiki.digitalmethods.net/Dmi/ToolDmiTcat

Slide 85

Slide 85 text

TCAT: https://wiki.digitalmethods.net/Dmi/ToolDmiTcat

Slide 86

Slide 86 text

“The Issue Crawler is web network location and visualisation software. It consists of crawlers, analysis engines and visualisation modules.”

Slide 87

Slide 87 text

“A software tool that locates and visualizes networks on the web”

Slide 88

Slide 88 text

Issue Crawler: https://wiki.digitalmethods.net/Dmi/ToolIssueCrawler

Slide 89

Slide 89 text

“Gephi is an interactive visualization and exploration platform for all kinds of networks and complex systems, dynamic and hierarchical graphs.”

Slide 90

Slide 90 text

Gephi: http://gephi.org

Slide 91

Slide 91 text

Which of these techniques might be of interest in journalism?

Slide 92

Slide 92 text

i. Co-occurrence analysis to identify themes ! ii. Network analysis to identify actors and sources ! iii. Hyperlink analysis to explore “politics of association” ! iv. Resonance analysis to identify source partisanship

Slide 93

Slide 93 text

social science researchers leading! digital! newsrooms new ways of covering complex issues = +

Slide 94

Slide 94 text

Emerging practises and epistemologies of data journalism

Slide 95

Slide 95 text

Geeks vs. pundits: ! The clash of two epistemological cultures

Slide 96

Slide 96 text

"Nate Silver says this is a 73.6 percent chance that the president is going to win? Nobody in that campaign thinks they have a 73 percent chance — they think they have a 50.1 percent chance of winning. And you talk to the Romney people, it’s the same thing. . . . Anybody that thinks that this race is anything but a toss-up right now is such an ideologue, they should be kept away from typewriters, computers, laptops and microphones for the next 10 days, because they're jokes." (Joe Scarborough, MSNBC, 2012)

Slide 97

Slide 97 text

“I am Nate Silver, the Lord and God of the Algorithm!” (Jon Stewart, 2012)

Slide 98

Slide 98 text

The life of data in the newsroom

Slide 99

Slide 99 text

“Objects, too, have agency” – Bruno Latour, Reassembling the Social: An Introduction to Actor-Network Theory (2005)

Slide 100

Slide 100 text

What journalistic practices, values and visions are articulated around the use of data as raw material for reporting? How are traditional journalistic practices, values and norms, transformed?

Slide 101

Slide 101 text

The politics of quantitative methods in the newsroom

Slide 102

Slide 102 text

Where do journalists’ attachments to particular forms of quantitative analysis come from? How are these commitments articulated? How do they shape the process of knowledge production and its outcomes? What quantitative methods are being left out? (the question of alternative histories)

Slide 103

Slide 103 text

Rieder, B (2013) “Interactive visualization and exploration of network data with Gephi”. Presentation from DMI Summer School. Available at: http://www.slideshare.net/digitalmethods/gephi-rieder-23834788

Slide 104

Slide 104 text

social science researchers leading digital newsrooms new ways of! covering! complex issues = +

Slide 105

Slide 105 text

How might digital and tools methods for issue mapping be used in journalism to improve coverage of complex issues?

Slide 106

Slide 106 text

Opportunities and challenges

Slide 107

Slide 107 text

Paper for Tow Center for Digital Journalism

Slide 108

Slide 108 text

Interviews and discussions with journalists in Europe and US about issue mapping and digital tools and methods

Slide 109

Slide 109 text

No content

Slide 110

Slide 110 text

Some preliminary ﬁndings and reﬂections…

Slide 111

Slide 111 text

Some different potential uses of digital methods in journalism: ! • Story discovery (news desk/projects) • Internal reference resource (news desk/projects) • Preparation for live coverage (news desk/projects) • Quick/easy tools for journalists (news desk/projects) • Presentational device (interactive/graphics) • Interactive news “toys” for exploration (interactive)

Slide 112

Slide 112 text

Some challenges to using digital methods in journalism: ! • Time, resource and budget constraints • Resistance to change in (especially bigger) newsrooms, hard to introduce new tools/methods • Social scientists often want to capture complexity, journalists often want to simplify • Tension between traditional journalistic values (recency, human interest, etc) and research values • Rendering complexity readable and accessible to broader publics - not just issue experts/researchers • Keeping interactive projects about current events up to date • Not just tool provision, but also training • Transparency of tools and interpretation of results • Some of tools are complex to install and no web version available • Speed of using tools as events unfold • Efﬁciency of these methods compared to others • Hard to ﬁnd stories in data

Slide 113

Slide 113 text

Some opportunities for using of digital methods in journalism: ! • Interest in using tools from interactive teams • More newsrooms have been experimenting with related approaches, still at very early stage • Potential for researchers working with journalists (rather than issue experts) to help with selection, ﬁltering, framing and narration • Introducing robust methodology around use of social media data in newsrooms • Identifying human sources for interviews. • New forms of analysis and veriﬁcation of sources. • Hyperlink analysis and web data currently very rarely used in journalism • Low uptake of text-mining and scientometrics tools and methods • Input/feedback from journalists could feed into existing software development • New web versions of existing tools (e.g. Gephi) • Using social media and web as data, not just content (to look at relationships and interactions)

Slide 114

Slide 114 text

Next steps: • Preliminary report for Tow Center • Embedded experiments in newsrooms • Pilot around Paris 2015 climate negotiations • Toolkit and handbook for journalists

Slide 115

Slide 115 text

Thank You! Liliana Bounegru | lilianabounegru.org | @bb_liliana Jonathan Gray | jonathangray.org | @jwyg Sciences Po médialab http://www.medialab.sciences-po.fr/ ! Sciences Po médialab - Tools http://tools.medialab.sciences-po.fr/ Digital Methods Initiative https://digitalmethods.net    Digital Methods Initiative - Tools https://tools.digitalmethods.net