Using Surveys and Server Data to Understand Users in France and Florida

In this presentation, three universities -- University of Florida (UFL), University Pierre and Marie Curie (UPMC), and University Littoral Cote d'Opale (ULCO) -- will discuss their use of surveys and production server data to better understand how faculty and students are using their respective learning management systems. Each institution is unique, with different populations and programs. Learn how these universities conducted their research, what trends were discovered, and what actions the findings have motivated.

Transcript

1. 1 1 San Diego, CA June 2-7, 2013 Using Surveys and Server Data to Understand Users in France and Florida
2. San Diego, CA June 2-7, 2013 2 A very young university: 20 years old A small university: about 10,000 students Approximately 1000 academics/staff members A distributed university between 4 cities: Boulogne sur Mer, Calais, Dunkerque and Saint-Omer 40km/25miles Université Littoral – Côte d'Opale
3. San Diego, CA June 2-7, 2013 3 ULCO covers the four broad fields of teaching and research except Health Sciences First installation of Sakai CLE: 2009 (2.6) Currently, we use the 2.8.1 version (an update to the 2.9.1 is scheduled for next month) Number of websites (projects/courses) : > 600 ULCO
4. San Diego, CA June 2-7, 2013 4 The university Pierre et Marie Curie Heir of the Faculty of Sciences of Sorbonne Moved from the old buildings on a new campus in the 60ties The largest Sciences and Medicine university in France Ranking first Research Institution in France Ranking first Research Institution in Mathematics in the World 4000 Academic, 4000 support staff 30 000 students (20 000 in Sciences, 10 000 in Medicine)
5. 5 5 San Diego, CA June 2-7, 2013 • Objectives of the study • Sakai use • IT: the feelings from students and teachers
6. San Diego, CA June 2-7, 2013 6 The inquiry Based on a framework established in 2011 by the community Call for answer: From May to June 2012 (UPMC) from June to September (ULCO) Number of students: 330 students (UPMC) 135 students (ULCO) Number of teachers/staff members: 110 (UPMC) 46 (ULCO) Two parts: Sakai tools use (based on the survey and stats from database) General feeling about IT and LMS
7. 7 7 San Diego, CA June 2-7, 2013 7 Sakai at ULCO
8. San Diego, CA June 2-7, 2013 8 A short history Epistemon (first platform): fork of Ganesha (in 2002) July 2010 : Setting up a production server 2010–2011 : Use both Epistemon and Sakai 2011–2012 : Epistemon in archive mode September 2012 : May Epistemon rest in peace... We currently use Sakai CLE 2.8.1
9. 9 San Diego, CA June 2-7, 2013 9 Sakai at UPMC
10. San Diego, CA June 2-7, 2013 10 A longer history WebCT September 2007 : Sakai CLE 2.4.X production +1 : sites +57% +2 : sites +89% +3 : sites +28% +4 : sites +35% +5 up today : +9%
11. 11 11 San Diego, CA June 2-7, 2013 Sakai tools use Database analysis
12. San Diego, CA June 2-7, 2013 12 Active users per month (percentage of peak for academic year) 2011 2012 2013 %
13. San Diego, CA June 2-7, 2013 13 Percentage of sites using announcement per month 2011 2012 2013 %
14. San Diego, CA June 2-7, 2013 14 Use of announcement UPMC ULCO 2011-2012 59 % 72 % 2012-2013 63 % 66 % Number of sites published with announcement : UPMC 81% ULCO 79 % Sites with announcement activity
15. San Diego, CA June 2-7, 2013 15 Percentage of sites using calendar per month 2011 2012 2013 %
16. San Diego, CA June 2-7, 2013 16 More about calendar user UPMC ULCO 2011-2012 18 % 48 % 2012-2013 31% 35 % Number of sites published with calendar : UPMC 41% ULCO 47% Sites with calendar activity
17. San Diego, CA June 2-7, 2013 17 Percentage of sites using LessonBuilder per month 2012 2013 %
18. San Diego, CA June 2-7, 2013 18 Percentage of sites using section info per month 2011 2012 2013 %
19. San Diego, CA June 2-7, 2013 19 Percentage of sites published with n activated tools
20. San Diego, CA June 2-7, 2013 20 Percentage of sites with activity per year based on Resources activity 1/2
21. San Diego, CA June 2-7, 2013 21 Percentage of sites with activity per year based on Resources activity 2/2
22. San Diego, CA June 2-7, 2013 22 Percentage of sites published with n activated tools %
23. 23 23 San Diego, CA June 2-7, 2013 Sakai tools use The survey
24. San Diego, CA June 2-7, 2013 24 None 1 - 2 3 - 6 More than 6 0 10 20 30 40 50 60 Largely used at Bachelor and M1 level (UPMC) Mostly used by Adult Continuous Education (ULCO) Courses are not automatically created: so, for instance, a teacher can use one website for several courses. There's confusion between courses and sakai websites in the survey. Sakai use: students Number of courses in LMS
25. San Diego, CA June 2-7, 2013 25 Between 100-500 simultaneous connections A little more of 'a few times per month' because of several alternate training at ULCO and work placements in June. Sakai use: students Number of connections Every day A few times per week A few times per month 0 5 10 15 20 25 30 35 40 45 50
26. San Diego, CA June 2-7, 2013 26 None 1 – 2 3 – 6 More than 6 0 5 10 15 20 25 30 35 None 1 – 2 More than 2 0 10 20 30 40 50 60 Not all teachers have adopted Sakai: for instance, only 160 teachers @ULCO had created courses. Exceptions: Medicine and Biology (UPMC) and Adult Education (ULCO) When adopted really used Sakai use: teachers Number of courses in LMS
27. San Diego, CA June 2-7, 2013 27 Between 60% and 70% use Sakai during the week (UPMC & ULCO) A majority of them uses Sakai as a major tool Sakai use: teachers connections per day A few time per semester A few times per month A few times per week Every day 0 5 10 15 20 25 30 35 40
28. San Diego, CA June 2-7, 2013 28 To share a calendar To send/receive messages and notifications For assessments and exams For assignments and comments To organize the pedagogical path, to structure the teaching Pouvoir échanger en direct To organize students in groups To follow students progress For distance teaching 0 10 20 30 40 50 60 70 80 Mostly used to communicate @ULCO: only 1 distance course but several courses in the form of an alternated training. Main objectives for teachers Teachers LMS use 1
29. San Diego, CA June 2-7, 2013 29 Tools use: teachers 0 0,1 0,2 0,3 0,4 0,5 0,6 0,7 0,8 0,9 1 2 3
30. San Diego, CA June 2-7, 2013 30 Tools use: students 0 0,1 0,2 0,3 0,4 0,5 0,6 1 1
31. San Diego, CA June 2-7, 2013 31 Resources is the most important tool Drop box is used as a simple ePortfolio. For instance, @ULCO, we use it to collect student works for B2i/C2i* (IT & Internet Certificates) @UPCM: Appreciation of Tests & Quiz, Assessments linked to the use: Skepticism from teachers (control of students) Agreement of students for remote use Tools use http://www.c2i.education.fr/
32. San Diego, CA June 2-7, 2013 32 Internationalization (students) Quality of French Translation A major effort* has been made to translate Sakai (UPMC + ULCO) 1 2 3 4 5 0 5 10 15 20 25 30 *http://qa1-nl.sakaiproject.org/international/
33. 33 33 San Diego, CA June 2-7, 2013 IT and Teaching
34. San Diego, CA June 2-7, 2013 34 LMS: what for? Students expectations 0 0,1 0,2 0,3 0,4 0,5 0,6 0,7 0,8 0,9 The access to documents is the first requirement for students. 1 2
35. San Diego, CA June 2-7, 2013 35 LMS: what for? Teachers expectation 0 0,1 0,2 0,3 0,4 0,5 0,6 0,7 0,8 0,9 The access to documents is the first requirement for teachers too. 1 2
36. San Diego, CA June 2-7, 2013 36 Attitude towards IT IT used: ... ...in the case of Blended learning: 65% at UPMC 74% at ULCO ...as a supplement only: 17% at UPMC 6% at ULCO ...in the case of distance learning : 4% at UPMC 2% at ULCO (but only 1 distance course)
37. San Diego, CA June 2-7, 2013 37 Attitude towards IT Students courseware use 82% students want printable documents 70% want a moderate use of technology 1 2 3 4 5 6 7 8 0 10 20 30 40 50 60 70 80 90 1 2
38. San Diego, CA June 2-7, 2013 38 Conclusion Sakai well adopted at UPMC and at ULCO Considered as a major element of the IT strategy People appreciate its : Flexibility. For instance, one course for many teacher Easiness of use. We don't have any complaint about some difficulties of use. Variety of uses. Researchers use now Sakai after they used them for teaching.