Slide 1

Slide 1 text

Reflections on the ! UW Libraries Data Info Literacy ! Reading Group! Brianna Marshall | February 3, 2016! UW Libraries Teaching + Learning Forum!

Slide 2

Slide 2 text

About Brianna Marshall! Lead, Research Data Services! –  Education + training! –  Consultations! –  Data management plans (DMPs)! ! researchdata.wisc.edu! @UWMadRschSvcs!

Slide 3

Slide 3 text

Why a Reading Group? •  Designated time to read + learn! •  Increase RDS visibility! •  Grow shared knowledge, investment! •  Create RDM/DIL evangelists!!

Slide 4

Slide 4 text

Introduction This poster describes a drop-in data management and visualization workshop under development. The workshop, scheduled for October 2013, will be aimed at graduate student researchers but open to all. The authors have mapped the core competencies for data information literacy outlined in "Determining Data Information Literacy Needs: A Study of Students and Research Faculty" (2011) with the workshop learning outcomes. Workshop planning considerations, content, and problems faced are described below. While this poster describes a workshop being developed at Indiana University, the authors hope this model will prove informative for other institutions looking to create similar workshops pairing data management and visualization. Planning Process •Tools chosen are freely available; two are open source •Team met weekly to discuss learning outcomes, data sources, data analysis techniques, and assessment strategies Some ideas were discarded over the course of planning: •Digital humanities data in HathiTrust (HT) and HT-related software were not publicly available for use, so the authors replaced HT data analysis with that of open humanities data provided by the IU Digital Collection Services. We plan to use the tool Voyant to visualize this data. •“Frameworks for a Data Management Curriculum” (Lamar Soutter Library et al, 2012) course plans were originally intended to be adapted for this workshop. They proved to be too technical and detailed for incorporation into a beginner-level class. Considerations Designing our tutorials •Emphasize analysis over datasets themselves •Future workshops responsive to feedback Finding appropriate data sources •Diversity of available datasets •Chose a wide breadth of examples to fit our expected audience •Criteria for selection: usable format, properly documented, serendipity Assessing the learning outcomes •Difficult in one-off workshops •Self-reporting of understanding less than perfect •Project-based assessment would be ideal References Carlson, Jake R.; Fosmire, Michael; Miller, Chris; and Sapp Nelson, Megan, "Determining Data Information Literacy Needs: A Study of Students and Research Faculty" (2011). Libraries Faculty and Staff Scholarship and Research. Paper 23. http://docs.lib.purdue.edu/lib_fsdocs/23 Lamar Soutter Library, University of Massachusetts Medical School and the George C. Gordon Library, and Worcester Polytechnic Institute. (2012). “Frameworks for a Data Management Curriculum: Course plans for data management instruction to undergraduate and graduate students in science, health sciences, and engineering programs.” Retrieved from http://library.umassmed.edu/data_management_frameworks.pdf Integrating Data Management Literacies with Data Visualization Instruction A One-Shot Workshop DIL Core Competencies mapped to Learning Outcomes DIL Core Competencies Learning Outcome Skills Required Assessment Measure Data Management and Organization Introduction to Databases and Data Formats Data Conversion and Interoperability Understand data management and organization concepts. Identify data types, define data and its lifecycle, and describe how data is used and reused in research. List reasons why data management and organization is important to researchers. Related questions on incoming and outgoing questionnaires. Data Visualization Quality Assurance Design effective data visualizations. Apply Illinsky’s four principles of data visualization. Use Google Refine to clean data in order to assure data quality. Use Sci2 to perform various types of analysis on data sets. Use Gephi to visualize the data. Critique visualizations according to rubric. Introduction to Databases and Data Formats Discovery and Acquisition of Data Data Analysis Find and select appropriate data—and apply proper analysis—to create a visualization that answers a particular research question. Identify research question. Choose appropriate types and formats of data for topical, network, burst, and temporal analysis. Navigate to data sources. Download data in proper format. Analyze data. Successful completion of questionnaire addressing skills needed to answer research question. Cultures of Practice Introduction to Databases and Data Formats Understand how cultures of practice influence the way data may be collected, described, or formatted. Based on intended audience for visualization and source of data, identify culture of practice/discipline. Be able to access information on discipline’s data collection standards [literature search], relevant metadata schema and controlled vocabularies [libraries website and DCC guide], and what tools and formats are common to particular disciplines [literature search]. Successful literature searches (and reading) for data collection and analysis methodologies. Successful access of disciplinary metadata schema. Metadata Data Preservation Save data to IU-supported research storage for both short- and long-term storage. Identify best storage options for short- and long-term data storage. Successfully navigate to appropriate storage solutions, log in. Transfer data from local drives to cloud storage accounts. Questionnaire. Ethics (including citation of data) Data Preservation Handle data and data visualizations ethically. Cite data from other sources in visualizations and documentation. Decide which data to make available, based on sensitivity. Store data on appropriate technologies using safeguards, based on sensitivity. Create visualizations that accurately represent the source dataset (i.e. does not manipulate or skew results). Questionnaire. [In a more in-depth workshop, one idea would be to have students create projects which are then reviewed and scored against a rubric after class ends.] Data Curation and Re-use Ethics (including citation of data) Data Management and Organization Prepare data and visualizations for re-use. Create documentation for others to reference when reusing data that describes methodology for finding, analyzing, and visualizing data. Cite data source and visualization creator in visualization caption(s). Organize and format data appropriately for future processing by tools. Questionnaire. [In a more in-depth workshop, one idea would be to have students create projects which are then reviewed and scored against a rubric after class ends.] Stacy Konkiel, Brianna Marshall & David Edward Polley | Indiana University-Bloomington • Topical • Temporal • Spatial • Network Workshop Specifics • ISI / Web of Knowledge • Open Congress • ICPSR • Open humanities data from IU Tools Data Sources Analyses Contact [email protected] // @skonkiel [email protected] // @nososternlib Download poster and handouts http://hdl.handle.net/2022/16814 This work is licensed under a Creative Commons Attribution 3.0 United States License. https://scholarworks.iu.edu/dspace/handle/2022/16814 !

Slide 5

Slide 5 text

Participants •  Ariel Andrea! •  Barb Sisolak! •  Brooke Williams! •  Cameron Cook! •  Cid Freitag! •  Deb Helman! •  Erin Carrillo! •  Josh Zimmerman! •  Kerry Kresse! •  Morgaine Gilchrist-Scott! •  Sheila Stoeckel!

Slide 6

Slide 6 text

DIL + Related Literacies Data Literacy! Access, assess, manipulate, summarize, and present data! ! Statistical Literacy! Think critically about basic stats in everyday media! ! Information Literacy! Think critically about concepts; read, interpret, evaluate info! ! Data Information Literacy! The ability to use, understand, and manage data! Schield, Milo. "Information literacy, statistical literacy and data literacy." IASSIST Quarterly 28.2/3 (2004): 6-11.!

Slide 7

Slide 7 text

DIL Team Approaches Institution Discipline Approach Purdue University! Electrical and computer engineering! Embedded librarianship! Purdue University! Agricultural and biological engineering! Series of workshops! Cornell University! Natural resources! 6-week mini-course! University of Minnesota! Civil engineering! Hybrid in-person/online course! University of Oregon! Ecology/landscape architecture! One-shot seminar! Carlson, Jake, and Lisa Johnston. Data Information Literacy: Librarians, Data, and the Education of a New Generation of Researchers. !

Slide 8

Slide 8 text

12 DIL Competencies Data Processing and Analysis Data Curation and Re-use Data Management and Organization Data Conversion and Interoperability Data Preservation Data Visualization and Representation Databases and Data Formats Discovery and Acquisition Ethics and Attribution Metadata and Data Description Data Quality and Documentation Cultures of Practice Carlson, Jake, and Lisa Johnston. Data Information Literacy: Librarians, Data, and the Education of a New Generation of Researchers. !

Slide 9

Slide 9 text

Overall Findings •  The competencies were seen as important for students to develop.! •  Students were seen as lacking in these competencies.! •  Assumption that students have or should have acquired the competencies earlier.! •  Lack of formal training for students working with data.! •  Learning is largely self-directed through “trial and error.”! http://www.slideshare.net/asist_org/rdap-15-lessons-learned-from-the-data-information-literacy-project

Slide 10

Slide 10 text

Overall Findings •  Training from advisor tends to occur at point of need, often framed in the context of the immediate issue.! •  Students focus on data mechanics over deeper concepts.! •  Faculty were often unsure of best practices or how to approach the competencies themselves.! •  Lack of formalized policies in the lab.! http://www.slideshare.net/asist_org/rdap-15-lessons-learned-from-the-data-information-literacy-project

Slide 11

Slide 11 text

FIGURE 9.1 ! ! Stages of developing a data information literacy program.! Carlson, Jake, and Lisa Johnston. ! Data Information Literacy: Librarians, Data, and the ! Education of a New Generation of Researchers. !

Slide 12

Slide 12 text

READING GROUP " MEMBER THOUGHTS

Slide 13

Slide 13 text

ERIN CARRILLO Public Services Librarian, Steenbock Library!

Slide 14

Slide 14 text

Interesting takeaways •  Ecology DIL workshop! –  Discipline specific! –  DIL interview! What are the most exciting opportunities for UW? How do we get there? •  Data sharing! –  Competencies (preserving, publishing, citing)! •  Stand alone for credit, or within existing courses! •  Online?!!

Slide 15

Slide 15 text

ARIEL ANDREA Chemistry Librarian, General Library System!

Slide 16

Slide 16 text

Interesting takeaways •  Data information literacy is discipline specific ! – Generalizing DIL makes it less palatable, less relevant for researchers! – One person can not be responsible for helping all of campus – liaisons must be involved! •  Getting DIL practices ingrained in researcher workflows takes time! – Set manageable goals for any new initiatives!

Slide 17

Slide 17 text

What are the most exciting opportunities for UW? How do we get there? •  Campus needs a data repository with support staff! – Could library staff be a part of the effort, promote it, etc! •  Library needs to take ownership of the scholarly publishing/access portion of data management at least! – Professional development for liaison librarians!

Slide 18

Slide 18 text

BROOKE WILLIAMS Resident Librarian for Information Literacy Instruction,! College and Steenbock Libraries!

Slide 19

Slide 19 text

Interesting takeaways •  Librarians should have a place in the data conversation!! •  Data information literacy fits right in with “regular” information literacy! •  There are a lot of people who need this training: not just students, but researchers, lab staff, professors, librarians.!

Slide 20

Slide 20 text

What are the most exciting opportunities for UW? How do we get there? •  1: We’re an R1, so there is a lot of research happening & data being generated on this campus. The libraries can definitely jump in to offer support to those researchers, whether through workshops, one-credit courses, liaison connections, etc. This is a place for us to fill a real need and set a standard.!

Slide 21

Slide 21 text

CAMERON COOK Digital Curation Assistant, SLIS Student!

Slide 22

Slide 22 text

Interesting takeaways •  There’s not a one size fits all template! •  space vs. time vs. community ! •  The idea of failure!

Slide 23

Slide 23 text

What are the most exciting opportunities for UW? How do we get there? •  Shift in culture happening! •  DMPs (eventually, maybe?)! •  Starting small - not ‘DIL’ but focus on manageable competencies! •  Finding hooks in the pieces of the cycle that we work with!

Slide 24

Slide 24 text

SHEILA STOECKEL Director for Teaching & Learning Programs, UW-Madison Libraries!

Slide 25

Slide 25 text

Interesting takeaways •  Learning from our successful models to move forward ! •  Specific competencies vs. concepts! •  Generalization vs. customization (Grad/ Faculty) !

Slide 26

Slide 26 text

What are the most exciting opportunities for UW? How do we get there? •  Leveraging and developing our expertise with data information literacy concepts! – Staff development! – Communication & promotion ! •  Expanding our role in educating students, especially graduate students.! – New conversation with instructors we work with! – Mapping research cycles and curricula for entry points!

Slide 27

Slide 27 text

JOSHUA ZIMMERMAN Linux Systems Administrator, General Library System!

Slide 28

Slide 28 text

Interesting takeaways •  The majority of DIL competencies are not new! •  Many DIL competencies are too broad or domain specific for it to likely be worthwhile to try to introduce them all, at the same time, to all of campus!

Slide 29

Slide 29 text

What are the most exciting opportunities for UW? How do we get there? •  The UW has an amazing opportunity to create exemplary communities of practice with regards to collecting, storing and sharing data! •  We stand to create the opportunity for professionals across campus to cross train and learn about domains and ideas they currently know nothing about! •  We can really only get there through true collaboration across campus!

Slide 30

Slide 30 text

CID FREITAG Program Manager, DoIT Academic Technology!

Slide 31

Slide 31 text

Interesting takeaways •  Intertwined literacies! What are the most exciting opportunities for UW? How do we get there? •  New literacies for students! •  New pedagogies! •  UW-Madison Essential Learning Outcomes! •  ’It takes a village’!

Slide 32

Slide 32 text

systems! education! strategy! policy!

Slide 33

Slide 33 text

No content

Slide 34

Slide 34 text

No content

Slide 35

Slide 35 text

Image courtesy of Flickr user danbri (CC BY)

Slide 36

Slide 36 text

What next? •  Read more about DIL: www.datainfolit.org/ ! •  Come to an RDS meeting! –  February 22, 1:30-3pm - Memorial Library 362! –  May 30, 1:30-3pm – Steenbock Library! –  August 15, 1:30-3pm - Memorial Library 362! –  November 3, 1:30-3pm – Steenbock Library! •  New iteration of an RDM reading group?! •  Tell your AULs and supervisors (or anyone who will listen) that you think this is important!!

Slide 37

Slide 37 text

find these slide decks at:! speakerdeck.com/bmarshall! digital scholarship workshop series + +

Slide 38

Slide 38 text

No content

Slide 39

Slide 39 text

No content

Slide 40

Slide 40 text

Interested in RDS updates? http://connect.ala.org/node/248942

Slide 41

Slide 41 text

Thanks for listening! Brianna Marshall @notsosternlib! [email protected]! ! ! Research Data Services researchdata.wisc.edu! @UWMadRschSvcs!