Sergio Luján-Mora, Estela Saquete. Proceedings of the 5th International Conference on Education and New Learning Technologies (Edulearn 2013), p. 6480-6487, Barcelona (Spain), July 1-3 2013. ISBN: 978-84-616-3822-2.
MOOCs (Massive Open Online Courses) have been around us since 2008, when around 2,300 students took part in a course called "Connectivism and Connective Knowledge", organized by the University of Manitoba (Canada). However, 2012 was widely recognized as "The year of the MOOC", because some MOOC initiatives, such as Coursera, Udacity, or edX, gained a world-wide popularity. Many experts consider MOOCs a "revolution in education". However, other experts think is too soon to make such a claim and MOOCs still have to prove their real value. Unfortunately, there are not many research studies on MOOCs.
In this paper, we present some lessons learned from our MOOC on XML (extensible Markup Language). Some features our MOOC included were self-paced learning, an online discussion group, and assessment of learning students progressed through the course. We used Google CourseBuilder as LMS (Learning Management Systems). In our MOOC we had two types of students: official on-campus students and unofficial off-campus students. On-campus students were taught using a blended learning method: a combination of traditional face-to-face classroom with online learning.
Apart from the data gathered from the LMS, we conducted two online surveys to better understand how students learnt. The goal of our study was to discover if there was any correlation between the subject perception of the quality of the course and the learning style of each student.
Firstly, students answered an online survey which goal was to measure the quality of the instructional material. Students had to assess the quality of the audio and the video image, the duration of the videos, the content of the videos, and the difficulty of the quizzes. This survey was a 13-item questionnaire.
Secondly, students answered the Index of Learning Styles, an online survey based on the learning style model formulated by Richard M. Felder and Linda K. Silverman. This model is used to categorize students' learning styles based on the selection of some preferences from a group of four dimensions (active/reflective, sensing/intuitive, visual/verbal, and sequential/global). This survey was a 44-item questionnaire. In this paper we present the results and the conclusions of our study.
Keywords: MOOC, on-line learning, quality assessment
More information: Mixing a MOOC with flip teaching in a traditional classroom
Without a doubt, the year 2012 will be remembered as the year of the MOOCs, the year of the Massive Open Online Courses . Revolution, disruption, earthquake, tsunami, shock, the future of education or the end of an era were some of the adjectives that accompanied the news about MOOCs that appeared in the mass media during that year. In addition, people like Sebastian Thrun, Peter Norvig, Anat Agarwal, Andrew Ng, and Daphne Koller, until then only known in limited circles, became internationally famous, and companies like Coursera, Udacity, and edX day were created allt at once with a strong investment by universities or venture capital funds. MOOCs caught the whole international educational community by surprise.
The MOOCs have been described as a "revolution in education" and the truth is that, if they meet the expectations that they are creating, they will mark the biggest change in the way people teach and learn from the past 500 years.
But what is a MOOC? So far, MOOCs do not differ much from online courses that have existed for years: a syllabus (with course objectives and expected outcomes), a calendar, some educational materials (mainly videos, but also lecture notes and assigned readings), some activities or projects, some quizzes and exams (usually multiple choice exercises) to assess students’ learning, and a forum to discuss with the teacher and other students. So why have MOOCs generated so much interest? Their main interest lies not so much in the courses that are being offered, which are very interesting courses of high quality, but in the huge demand of people wanting to learn that has emerged thanks to them: MOOCs have discovered that there are millions of people around the world eager to learn.
In our society, the society of information and knowledge, knowledge needs are increasing, which causes a massive need of learning and training. These huge learning needs are part of the “lifelong learning”. This massive need for learning and training has been demonstrated by the successful enrolment that many MOOCs have had.
The first MOOC that really had an amazing success was the course "Introduction to Artificial Intelligence" organized in autumn 2011 by Sebastian Thrun, a professor at Stanford University, and Peter Norvig, Google's research director. Some 160,000 people from all over the world signed up for this course on artificial intelligence. The next MOOC that was very successful was the course "Circuits & Electronics" in the spring of 2012, organized by the Massachusetts Institute of Technology (MIT). In this course, more than 120,000 people signed up. The unexpected success of these two courses was the trigger for the current MOOC mania. But what lies behind these staggering numbers? A fashion? A paradigm shift in education?
In this paper, we present some lessons learned from our MOOC on XML (extensible Markup Language). This MOOC is based on a subject of the Master in Application Development and Web Services of the University of Alicante (Spain).
Our MOOC had two groups of students: 30 tuition-paying students from de University of Alicante (official students), and 300 students from the general public who took the online class free of charge (non-official students). With official students we applied the flip teaching or flipped classroom method. Official students had to enrol in the MOOC as the rest of the non-official students and they had to view all the videos and do all the online activities outside of class time. Therefore, we did not have to impart the initial lessons of the subject. This allowed us to have more time inside the class to be used for additional learning-based activities. Besides, we could spend more time interacting with students instead of lecturing.
Apart from the data gathered from the LMS, we conducted two online surveys among the tuition-paying students to better understand how students learnt. The goal of our study was to discover if there was any correlation between the subject perception of the quality of the course and the learning style of each student.
The goal of the first survey was to measure the quality of the instructional material. Students had to assess the quality of the audio and the video image, the duration of the videos, the content of the videos, and the difficulty of the quizzes. This survey was a 13-item questionnaire.
The second survey was the Index of Learning Styles , based on the learning style model formulated by Richard M. Felder and Linda K. Silverman . This model is used to categorize students’ learning styles based on the selection of some preferences from a group of four dimensions (active/reflective, sensing/intuitive, visual/verbal, and sequential/global). This survey was a 44-item questionnaire.
In this paper we present the results and the conclusions of our study. The rest of the paper is structured as follows. In section 2, a brief introduction to MOOCs is provided. In section 3, the flip teaching or flip classroom, the form of blended learning used with our official students is presented. In section 4, the results of the first survey aimed to measure the quality of the course are presented, whereas in section 5 the results of the second survey regarding the learning styles are presented. Finally, the main conclusions are summarized in section 6.
The MOOCs have just born and, therefore, are in a process of transformation and settlement and nobody can categorically say what a MOOC is. But in some way, MOOCs are the natural evolution of OpenCourseWare, first created by the Massachusetts Institute of Technology (MIT) in 2001 . Therefore, it does not surprise that the MIT also leads the development of MOOCs, first with MITx , and then with edX .
The first online course that received the name of MOOC was the course "Connectivism and Connective Knowledge" designed by George Siemens and Stephen Downes at the University of Manitoba (Canada) in 2008. In this 12-week course, 24 fee-paying on-campus students and approximately 2,200 students from the general public were enrolled . Obviously, this course did not have the same success as current MOOCs, but it paved the way for the current MOOCs. The term MOOC was coined during this course by Dave Cormier, from the University of Prince Edward Island (Canada). At the beginning, the first MOOCs had a strong and deep collaborative philosophy (cMOOCs), but this philosophy has evolved to a commercial sense (xMOOCs) .
In “The MOOC model for digital practice” , a clear definition of a MOOC can be found:
A MOOC is an online course with the option of free and open registration, a publicly-shared curriculum, and open-ended outcomes. MOOCs integrate social networking, accessible online resources, and are facilitated by leading practitioners in the field of study. Most significantly, MOOCs build on the engagement of learners who self-organize their participation according to learning goals, prior knowledge and skills, and common interests.
However, it is not entirely clear when a course is or is not a MOOC, but there are a number of features that are typically required for a course to be considered a MOOC:
Since nowadays all of the content of a course can be easily delivered to students online, students can absorb this content whenever they want and listen to it or read it as many times as they need. The actual classroom time can be used to solving out problems or discussing some topics, and there the professor-student interaction should be all about. It is obvious that students can get the facts from books, videos, and other educational resources, but the last part of interacting with somebody, making sure everything is properly connected and understood, should be done in the classroom. This is the idea of the flip teaching or flip classroom or inverted classroom [10, 11], an innovative way of teaching that moves the lecture outside the classroom via technology and moves homework and practice with concepts inside the classroom via learning activities.
In our MOOC, we applied the flip teaching with official face-to-face students. Besides attending the on-campus classes, official students had to enrol in the MOOC as the rest of the non-official students. Official students had to do all the activities proposed in the MOOC, such as viewing all the videos, doing all the online activities, and taking part in the discussions organized in the online forum of the course. All these activities had to be done outside of class time.
The flip teaching offered us some important benefits. We did not have to impart the initial lessons of the subject, because they were taught by online videos. This allowed us to have more time inside the class to be used for additional learning-based activities. Besides, we could spend more time interacting with students, working one-on-one with students in class, instead of lecturing.
At the end of the course, on-campus students had to answer an online survey aimed to measure the quality of the instructional material and the possibilities of this new educational method. Students had to assess the quality of the audio and the video image, the duration of the videos, the content of the videos, and the difficulty of the quizzes. This whole survey, composed of 13 questions, is displayed in Table 1.
There were four types of answers (Table 2). Types 1 (questions from 1 to 5), 2 (questions from 6 to 10), and 3 (questions 11 and 12) were a 5-point Likert scale. Type 4 was an open question.
From the 30 tuition-paying students, 26 students answered this survey. The mean and the standard deviation for each question are showed in the last two columns of Table 1.
In general, students considered the quality of the course was quite good. Therefore, these results encourage us to continue working in this educational method. However, the result of question 10, “Do you think it is possible to independently learn with this course?”, the question most directly related to our educational method, was the worst with a value of 3.3 points, near to a neutral answer.
Students have different levels of motivation and different attitudes about learning. In order to explain these differences, different models have been developed .
The seminal work “Learning and teaching styles in engineering education”  proposed a learning-style model that classifies students according to where they fit on a number of scales pertaining to the ways they receive and process information. Based on this model, a self-scoring web-based instrument called the Index of Learning Styles  that assesses preferences on four scales of the learning style model was developed some years later. This instrument is a 44-item questionnaire.
In order to determine the learning styles of the students of our MOOC, we have applied the Index of Learning Styles to a total number of 24 students, and we have considered the following four dimensions of the test:
Sensing and intuitive learners: What type of information preferably perceives students?
Visual and verbal learners: Through what sensory modality is more effectively perceived the cognitive information?
Active and reflective learners: How students prefer to process the information?
Sequential and global learners: How students progress in their learning?
When the student is balanced is due to the fact that for that dimension both features are useful for the learning process of the student.
The results obtained by our students can be observed in the following figures. We have included a figure for each one of the four dimensions analyzed.
Regarding sensing-intuitive dimension (Figure 1), in our evaluation group, there are no intuitive learners alone, and more than half of the group are sensing students and the other half are balanced. Being balanced in this dimension is very important in order to be an effective learner and problem solver, due to the fact that if a student overemphasizes intuition, he/she may miss important details or make careless mistakes in calculations or hands-on work; whereas if he/she overemphasizes sensing, he/she may rely too much on memorization and familiar methods and not concentrate enough on understanding and innovative thinking.
Regarding visual-verbal dimension (Figure 2), 79% of the students are visual, and none of them resulted as verbal students. So, for helping our group of students it is important to find diagrams, sketches, schematics, photographs, flow charts, or any other visual representation of course material that is predominantly visual. The teacher can provide any videotapes or CD-ROM displays of the course material are available and prepare a concept map by listing key points, enclosing them in boxes or circles, and drawing lines with arrows between concepts to show connections.
In the case of active-reflective dimension (Figure 3), most of them (71%) are balanced in this dimension. This is a very interesting result because a balance of the two is desirable. If a student always acts before reflecting he/she can jump into things prematurely and get into trouble, while if he/she spends too much time reflecting he/she may never get anything done.
Finally, for the case of sequential-global dimension (Figure 4), almost 90% are sequential learners and none of them are considered global. Sequential learners may not fully understand the material but they can nevertheless do something with it (like solve the homework problems or pass the test) since the pieces they have absorbed are logically connected.
Massive Open Online Courses (MOOCs) are open access courses that operate on a vast scale, that are available to anyone and anytime, online, and for free. During the last two years, MOOCs are proving to be extremely popular.
MOOCs can greatly accelerate the introduction of flip teaching in higher education. However, some students can be ill prepared for these new methods of teaching and learning. Therefore, the introduction of these methods should be done gradually. MOOCs can be seen as a supplement to traditional courses, rather a replacement for them. Besides, MOOCs can be a great help to meet the diverse needs of students. And opening up on-campus courses via MOOCs can benefit in-class students by producing a more diverse class for discussion and greatly improved educational resources.
However, there are also some criticisms against MOOCs. Traditional face-to-face education provides some benefits that cannot be easily replicated in online education. For example, in traditional education teachers can observe the progress of students and can help them to resolve problems when necessary. Besides, the personal interaction is completely missed out in a MOOC. Therefore, we think a blended learning approach is the best method because it takes the best of both worlds.
Furthermore, and according to the results of our research, students believe that it is possible to learn autonomously with a MOOC, but they are not completely certain of it. Therefore, this perception confirms our idea that MOOCs can be a good complement of flip teaching.
Finally, the study of the learning styles shows that 79% of our students are visual. Therefore, MOOCs based on an extensive use of videos are a good pedagogical option for this type of students.
 Pappano, L. (2012). The Year of the MOOC. The New York Times, November 2. Internet: http://www.nytimes.com/2012/11/04/education/edlife/massive-open-online-courses-are-multiplying-at-a-rapid-pace.html (accessed May 4 2013)
 Felder, R.M., Silverman, L.K., Soloman, B.A. Index of learning styles (ILS). Internet: http://www4.ncsu.edu/unity/lockers/users/f/felder/public/ILSpage.html (accessed May 13 2013)
 Felder, R.M., Silverman, L.K. (1988). Learning and teaching styles in engineering education. Engineering education, 78(7), 674-681.
 Massachusetts Institute of Technology (2001). MIT to make nearly all course materials available free on the World Wide Web. MITnews, April 4. Internet: http://web.mit.edu/newsoffice/2001/ocw.html (accessed May 2 2013)
 Massachusetts Institute of Technology (2011). MIT launches online learning initiative. MITnews, December 19. Internet: http://web.mit.edu/newsoffice/2011/mitx-education-initiative-1219.html (accessed May 6 2013)
 Massachusetts Institute of Technology (2012). MIT and Harvard announce edX. MITnews, May 2. Internet: http://web.mit.edu/newsoffice/2012/mit-harvard-edx-announcement-050212.html (accessed May 6 2013)
 Mackness, J., Mak, S., & Williams, R. (2010). The ideals and reality of participating in a MOOC. In Proceedings of the 7th International Conference on Networked Learning, May 3-4, pp. 266-274.
 Daniel, J. (2012). Making Sense of MOOCs: Musings in a Maze of Myth, Paradox and Possibility. Journal of Interactive Media in Education, 3, December. Internet: http://www-jime.open.ac.uk/jime/article/view/2012-18 (accessed May 8 2013)
 McAuley, A., Stewart, B., Siemens, G., & Cormier, D. (2010). The MOOC model for digital practice. Internet: https://oerknowledgecloud.org/sites/oerknowledgecloud.org/files/MOOC_Final.pdf (accessed May 9 2013)
 Baker, J. W. (2000). The "classroom flip": Using web course management tools to become the guide by the side. Paper presented at the 11th International Conference on College Teaching and Learning, Jacksonville, FL.
 Lage, M. J., Platt, G. J., & Treglia, M. (2000). Inverting the classroom: A gateway to creating an inclusive learning environment. Journal of Economic Education, 31, 30-43.
 Felder, R.M., Brent, R. (2005). Understanding Student Differences. Journal of Engineering Education, 94(1), 57-72.
More information: Mixing a MOOC with flip teaching in a traditional classroom