On making, tinkering, coding and play for learning: A review of current research

. Although a few researchers have recently focused on the value of making, tinkering, coding, and play in learning, a synthesis of this work is currently missing, creating an unclear path for future research in this area. Compu-tational-making-enhanced activities, framed as activities promoting making, tinkering, coding and play in the learning process, have gained a lot of attention during the last decade. This study provides a review of the existing research in this area, published in academic journals, from 2009 to 2018. We examine learning gains linked to learners’ participation in computational making-enhanced activities in formal and non-formal education settings. We further overview the research methods, the educational level, and the context of the published studies. The review of selected studies has shown that most of the research has been conducted in non-formal and informal education settings, however a shift to formal education has appeared since 2016. Most studies have focused on programming and computer science with middle-school learners. Immediate action is needed to inform the design of computational-making-enhanced activities directly linked to curriculum goals. Given the lack of synthesis of work on computational-making, the review can have considerable value for researchers and practitioners in the field.


Introduction
Current research findings support that making and tinkering activities can help with the development of skills, such as creativity, innovation, problem-solving, programming and computational thinking skills, which constitute the 21 st century skill-set ( Unlike, teaching methods which emphasize the existence of a single answer to a problem, or a determined process to the solution, methods that support making, tinkering, coding and play emphasize on the significance of the process, rather than the result. Also, such way of thinking can promote interdisciplinarity amongst the STEAM do-mains (Science, Technology, Engineering, Arts, and Mathematics), the importance of which has been underlined by many scholars (e.g., Jin, Chong, & Cho, 2012). The movement of making, called "the maker movement" has gained enormous momentum during the last few years, as an active process of building, designing, and innovating with tools and materials for the production of shareable artifacts. Making is a learner-driven educative practice which supports learning, participation, and understanding (Vossoughi & Bevan, 2014). Making is a process of creating something (Hsu, Baldwin, & Ching, 2017), or "the act of creating tangible artifacts" (Rode et al., 2015, p. 8). Others describe making as a strategy in which individuals or groups of individuals are encouraged to create artifacts using software and/or physical objects (Papavlasopoulou, Giannakos, & Jaccheri, 2017).
Tinkering, as a part of making (Vossoughi & Bevan, 2014) is a problem-solving technique and learning strategy, which promotes a practice of improvement and it is associated with experimentation and "trial and error" methods (Krieger, Allen, & Rawn, 2015). As Martinez and Stager (2013) argued, making and tinkering have evolved as a playful approach to solving problems through direct experience, experimentation and discovery. Programming, coding and physical computing are considered as making activities (Hsu et al., 2017) as they allow students to build and rebuild their artifacts (namely their robot), make the program design, code and debug.
Computational-making has been coined by Rode et al. (2015) to describe a combined set of skills that should be taught in STEAM education, namely computational thinking, aesthetics and creativity, visualizing multiple representations, understanding materials, and constructing (Rode et al., 2015). In other words, computational-making can describe making activities which require computation thinking skills and combine crafts with technology.
Play, as a dynamic, active and constructive behavior is naturally infused in all programming, making and tinkering activities. The playful nature of such activities promotes learner's interest (Ioannou, 2018;Vossoughi & Bevan, 2014). According to Martin (2015), learning environments organized based on making and tinkering settings are motivating and can support engagement and persistence and identity development.
Making, tinkering, coding and play activities might be seen as a relatively new practice in education, yet its theoretical roots are set in Papert' s constructionism (Jones, Smith, & Cohen, 2017), which builds upon Piaget's constructivism. Piaget defined knowledge as an experience that can be built through the interaction of the learner with the world, people and things (Ackermann, 2001) which is the experience that making offers to the learner. Similarly, Papert's theory of constructionism asserts that people construct internal knowledge when they design and build their own meaningful artifacts (Papert, 1980). Making is also linked to Vygotsky's social constructivism in that it can support learning and cognitive development through children's interaction with others whilst sharing knowledge (Nussbaum et al., 2009).
Although a few researchers have recently focused on the value of making, tinkering, coding, and play in learning (Krieger et al., 2015;Hsu et al., 2017;Martinez & Stager, 2013), a synthesis of this work is currently missing, creating an unclear path for future research in this area. A recent review of research in the making field was presented by Papavlasopoulou et al. (2017) but authors focused on making studies in extracurricular contexts only. The present review aims to summarize research findings, published from 2009 to 2018, on learning outcomes promoted through making, tinkering, coding and play in formal and non-formal education. The following research questions (RQs) are addressed: RQ1: What types of learning outcomes can be derived from computational-makingenhanced activities? RQ2: What research methods and research design are being used? RQ3: What types of learning contexts for computational making are being used?

Selection of Studies
The subject's range was wide enough, as we searched for studies published in academic journals concerned with making, tinkering, coding and play in education. First, we conducted a search in the following electronic databases: ERIC, JSTOR, Sci-enceDirect, Taylor and Francis Online, Scopus in additional to Google Scholar using the keywords "making", "tinkering", "coding" and "play" (and/in) "education", whilst restring the dates range to 2009-2018. The search initially resulted in a total of n=3116 manuscripts.
By reading all the abstracts, we filtered the manuscripts using three criteria: (1) the study should be empirical. All studies that gathered empirical evidence through quantitative (e.g. surveys) or/and qualitative methods (e.g. interviews, focus groups, experiments) were included. Studies with no empirical findings, including reviews and theoretical perspectives were excluded (e.g., excluded review paper by Papavlasopoulou, 2017), (2) the study should involve computational-making-enhanced activities, as defined in the introduction of this work (i.e., evidence of "computation"). Studies referred to making activities without any computational elements were excluded (e.g., a study conducted by Alekh et.al., 2018), (3) the study should present learning outcomes, including outcomes on conceptual knowledge, attitudes and skills. Studies with no explicit reference to learning outcomes were excluded (e.g., Cohen, Jones, & Smith, 2018). After applying the above-mentioned criteria, we concluded with 57 manuscripts.

Categorizing the Studies
We thoroughly read the 57 manuscripts and coded (i.e., open coding) the basic information derived from each work. A first round of open coding for learning outcomes was conducted, aiming to examine the types of learning outcomes derived from the computational-making-enhanced activities (RQ1). Based on evidence from 15% of studies, we identified three major categories of learning outcomes namely, content knowledge outcomes, attitudes, and 21 st -century skills; these categories were then used for coding the rest of the studies. In a second round of coding, we coded for the types of research methods used (RQ2); in this case, we categorized the studies as qualitative, quantitative or mixed research methods whilst we recorded the sample size and age of the participants. Last, in a third round of coding we coded for formal and non-formal/informal learning context in which the computational-makingenhanced activities took place (RQ3). The coding was done by two researchers (authors) working closely together.

Learning Outcomes
The empirical findings on learning outcomes were organized in terms of content knowledge, attitudes, and 21 st -century skills. Some of the studies reported outcomes in more than one category.

Content Knowledge.
As P21 Framework (Partnership for 21st Century Learning, 2015) states, content knowledge refers to key subjects, such as science, mathematics, economics, arts, geography, world languages etc. Learning of programming or other computer science knowledge is also coded in this category. The results demonstrated that computational-making-enhanced activities were mostly linked to knowledge gains in programming and computer science. Fewer studies were concerned with science and engineering or arts and literacy. Major findings about knowledge gains are summarized in Table 1 and briefly discussed below.
To provide an example, in the study of Blikstein (2013) middle-and high-school students experienced digital design fabrication in FabLabs in schools. The authors found that through making, students had the opportunity to come across several concepts in engineering and science in highly engaging and meaningful ways. Furthermore, Kafai, Lee, Searle, and Fields (2014), conducted a study in an e-textile computer science class with high school students; based on the analysis of project artifacts and interviews, the authors found that the experience promoted learning through making concerning circuitry and debugging. Students' engagement with simple computational circuits using e-textiles materials was also examined by Peppler (2013). This mixed-method research (pre and post-tests, surveys, interviews, journals, artifacts, and videotaped observations) took place in a summer workshop with children aged 7-12 years old and documented that students' understanding of key circuitry concepts was significantly increased through making. Another study with high school participants conducted by Searle, Fields, Lui, and , indicated that learning with e-textiles helped the students create a link between coding and making that contributed to their learning in computer science. Last but not least, Burke and Kafai (2012) found that middle school students learned the fundamentals of both programming and storytelling through making and tinkering and emphasized the potential of the connection between coding and writing. Underrepresented students learned concepts of programming and understanding software, that would prepare them for computer science courses. Learning gains were improved when students built the human hearing (biology) system without guidance. 12 Qiu Children learned about emerging technologies (electronics). 19 Peppler, K., & Glosson, D.
Students had significant gains in understanding of functional circuits. 20 Litts Gains in students' understanding of circuitry were noted. 21 Worsley and Blikstein (2014) Principle-based reasoning was associated with better quality designs and better engineering mechanism's understanding. 22 Blikstein, P. (2013) Via digital fabrication the students experienced learning gains in computation and mathematics 23 Hartry Students learned concepts about robotics, programming.
Attitudes. Students' attitudes towards learning can be measured through assessment of the perceived levels of interest, challenge, choice, and enjoyment, which are dimensions linked to motivation and engagement. Self-efficacy is also an attitude concerned with perceived beliefs in the individual capacity for specific achievements. In line with findings by Vossoughi and Bevan (2014) and Martin (2015) about making and tinkering activities promoting learners' interest, most of the studies reported positive effects on students' attitudes (see Table 2).
An indicative study comes from Chu et al. (2015), conducted with elementary school students in 3 rd , 4 th and 5 th grades. Students used arts and craft materials, and electronics components to build a theatre kit. The results indicated that making lead to more robust learning for children as they sought to acquire STEM-knowledge to make the technological things of their interest. Similarly, results from a study conducted by Posch and Fitzpatrick (2012) in four workshops in Vienna, suggested that making in a FabLab can increase students' interest about learning emerging technologies. Another study with children (between 4-11 years old) working in an informal science learning environment with their parents indicated that the STEAM learning through making and tinkering nurtured learning both in personal interest and in concepts learned, en-hanced engagement, and reinforced previous knowledge and basic motor skills (Moriwaki et al., 2012). Table 2. Major findings about attitudes.
The acceptance of challenges was increased. Increased interest and engagement incidents occurred. The activity's easiness and usefulness significantly affected students' intention to participate. 18 Garneli Self-efficacy and self-identity improved.  Table 3). Most of the studies reported skills from the first category (i.e., learning & innovation skills). In some cases, making appeared as a 21 st -century skill itself.
To provide some examples, in Harnett et al. (2015), undergraduate students engaged in making activities demonstrating increased competence in problem-solving and project-planning activities. Also, a study with adults (Perner-Wilson, Buechley, & Satomi, 2011), demonstrated that the participants were able to construct personally meaningful artifacts and that the approach made the technology more understandable allowing them to leverage existing skills to learn something new. The study also revealed that handcrafting technology fostered the realization of personal artifacts and afforded novel designs through the process of making. In a research conducted with children, in five out-of-school workshops (Posch & Fitzpatrick, 2012), the researchers reported that 10-14 years old children were able to transfer learned skills and experiences in other projects.

Type of research methodology
In terms of methodology, 30 studies were qualitative, 20 were mixed-method studies and seven were quantitative (see Fig. 1). In terms of sample size, 23 studies involved fewer than 20 participants, 17 studies involved more than 21 but less than 50, six studied involved more than 50 people but fewer than 100, and another six studies involved more than 101 participants (Table 4). Most work has been done with middle school students; less work deals with younger or older learners (Table 5).

Educational context
Directly linked to the "maker movement", computational-making-enhanced activities have mostly taken place in informal and non-formal settings (e.g., libraries, science festivals, and museums). The general aim was to encourage students to design, experiment, create, explore and play with technological tools. Yet, since approximately 2016 (2018 only partially covered due to the time of conducting this review), there seems to be a growing interest in formal education (see Fig. 2

Discussion
The present review focused on making, tinkering, coding and play activities (i.e., computational-making-enhanced activities) for teaching and learning in formal and non-formal/informal learning settings. Below, we discuss the results of our review in relation to the initial research questions.
In terms of types of learning outcomes derived from computational-makingenhanced activities (RQ1), most of the studies in the review reported positive learning outcomes, namely outcomes on content knowledge, attitudes and skills. This is consistent with previous work arguing that making and tinkering are "potentially powerful contexts for learning" (Bevan et al., 2015, p.21). As Vossoughi and Bevan (2014) also noted, such activities open space for learners to pursue personal interests and can broaden participation for many students.
In terms of research methods (RQ2) the review revealed that most of the studies in this area (computational-making) tend to use qualitative or mixed methodology. As the investigation of learners' attitudes or skills is a quite complex issue, the use of qualitative measures was deemed more suitable in most studies (Kafai et.al., 2014;Harnett et.al., 2015) helping to understand issues of depth with computationalmaking. Yet, we now have enough evidence of the value of computation making, allowing for scaling-up the impact and measurement via quantitative studies. Quantitative methodology has only recently been used in computational making research, to document improvements in students' grades in formal education studies (e.g., Litts et. al., 2017).
Non-formal and informal contexts were most common for computational-makingenhanced activities (RQ3), especially in year 2013. That could be justified by the Maker Movement's appearance (2009-2013) as a new trend in museums, makerspaces, hackerspaces, fablabs, after-school clubs, etc. Yet, since 2016 only two studies were found to have been conducted in non-formal/informal contexts, in contrast to the 16 studies conducted in formal education. This indicates that educators might be interested in computational-making-enhanced activities, yet empirical evidence in curricular areas is lacking.
The review revealed some open issues that are worth exploiting in the future. First, while a growing number of efforts in computational-making-enhanced activities in formal education is being recorded in the last three years, the design of learning activities and overall classroom implementation are not explicitly addressed in these studies. There is an immediate need for educative content and teaching/learning procedures linked to curriculum goals. Second, computational-making-enhanced activities have been mostly linked to content knowledge's gains in programming and computer science. Less attention has been given to science and engineering or arts and literacy. Possibilities and gains in these other domain areas are worth exploring and assessing. Third, most studies have been done with students in secondary education. There seems to be a need for more studies covering the spectrum of leaners in K-12 and up to higher education. Finally, most of the studies appear to aim at testing of making, tinkering, coding and play as a method for teaching and learning, yet the learning goals and design of computational-making tasks are not explicitly discussed in the research manuscripts. Studies which inform the design of computational-making-enhanced activities in relation to curriculum goals and expected learning outcomes are in need.

Conclusion
The present review demonstrates that the contribution of computational-makingenhanced activities in education is significant. Almost all the studies in the review, have indicated positive learning outcomes, often in more than one category (knowledge, attitudes and 21 st -century skills). The focus has been on programming and computer science whilst the field should be exploited in engineering, arts and literacy. During the last three years empirical work has shifted from informal/nonformal education to formal education. This indicates the growing interest of researchers and educators to integrate computational-making-enhanced in the school classroom. Yet, immediate action is needed to inform learning design and the design of computational-making-enhanced activities directly linked to curriculum goals. Most of the empirical research studies were conducted in secondary-school education, while more work is needed with younger or older leaders. Although a few researchers have recently focused on the value of making, tinkering, coding, and play in learning, a synthesis of this work is currently missing, creating an unclear path for future research in this area. Therefore, the review can have considerable value in guiding future researchers and practice in the field.