Data Curation You Can Taste

Data Curation You Can Taste Improving crowd-sourced data from the
New York Public Library’s menu transcription project

Trevor Muñoz Lydia Zvyagintseva University of Maryland University of Alberta
@lydia_zv @trevormunoz

@trevormunoz @lydia_zv Data from What’s On the Menu? presents an
interesting curation challenge because …

@trevormunoz @lydia_zv The data has a safe, organizational home for
preservation

@trevormunoz @lydia_zv The data is already public open online

@trevormunoz @lydia_zv The data is available in multiple representations

@trevormunoz @lydia_zv Curation work from outside NYPL must be non-custodial

@trevormunoz @lydia_zv This data is in use but could still
be made more useful

@trevormunoz @lydia_zv What opportunities for curation are left?

@trevormunoz @lydia_zv Who am I ? A keener with a
library card, UAlberta student, data enthusiast

@trevormunoz @lydia_zv Why data curation ? Collections Information architecture Public
Services Systems & IT Project management Digital Humanities Community engagement

@trevormunoz @lydia_zv My vision: Data Curation

@trevormunoz @lydia_zv Why MITH ? mith.umd.edu

@trevormunoz @lydia_zv January 2013 It all started with this …
DHWI

@trevormunoz @lydia_zv April 2013 Three week practicum at MITH

@trevormunoz @lydia_zv The project menus.nypl.org

@trevormunoz @lydia_zv There's a lot of data behind What's on
the Menu?: a mix of simple bibliographic description of the menus (created by The New York Public Library) and the culinary and economic content of the menus themselves (transcribed by you). Now we're opening it up.” “

@trevormunoz @lydia_zv All data generated through What’s On the Menu?
is available as spreadsheet exports via an application programming interface (API) menus.nypl.org/data

@trevormunoz @lydia_zv The data

@trevormunoz @lydia_zv Use Cases I would like to work on
your menus to analyze wines that are available.… My project is to build a database to localize the wines” “ I’d love to get access to the API to get an idea of how diﬀerent cuisines – and in particular African cuisines – are represented in the data.” “

@trevormunoz @lydia_zv Use Cases … a term project for our
Advanced Natural Language Processing class. We are proposing a project to track food trends over time as well as by city within the U.S.” “ cont’d

@trevormunoz @lydia_zv Information Architecture

@trevormunoz @lydia_zv

@trevormunoz @lydia_zv Taxonomy

@trevormunoz @lydia_zv (User) Testing

@trevormunoz @lydia_zv 3 sample tasks ! tracks performance ! summarizes
results TreeJack

@trevormunoz @lydia_zv Prototyping

@trevormunoz @lydia_zv http://bit.ly/cope-pda2012 Inspired by Aaron Straup Cope’s

@trevormunoz @lydia_zv http://bit.ly/lydiaz_prototype

@trevormunoz @lydia_zv Impacts & Results

@trevormunoz @lydia_zv “hacker ethic”/rapid dev cycle—make it & revise value-added
service curation as publication collaborative community engagement

@trevormunoz @lydia_zv Post-project Open Data civic hackathon, HackYEG ERA: Repo
Lyfe OpenEdmonton—digital civic engagement group Thesis? Lydia

@trevormunoz @lydia_zv Post-project Trevor Using menus data to teach data
curation to digital humanists Testing tools with real data New research collaborations around curating menus data

@trevormunoz @lydia_zv http://www.dhcuration.org/

@trevormunoz @lydia_zv http://bit.ly/menus-ex

@trevormunoz @lydia_zv A new collaboration with Katie Rawson @katie_rawson

Data curation as not just a technical activity but also
an engagement with publics Data curation and digital humanities practices can each inform the other Multiple representations of the data set force us, as curators, to make decisions about signiﬁcant properties—what matters

Thank You. Trevor Muñoz Lydia Zvyagintseva [email protected] [email protected]

Data Curation You Can Taste

Data Curation You Can Taste

More Decks by trevormunoz

Other Decks in Education

Featured

Transcript