Ten tools for practice learning.

L. Rowitz

DOI: https://doi.org/10.1097/00124784-200407000-00014

2004-07-01

Journal of Public Health Management and Practice

Abstract:

What problem does this paper attempt to address?

10 Steps to 10 + Questions:Interviews with the Authors of Ten Steps to Complex Learning

SHENG Qunli,WANG Wenzhi,WEI Zhihui

DOI: https://doi.org/10.3969/j.issn.1007-2179.2012.04.002

2012-01-01

Abstract:We have witnessed a transformation in the international studies of instructional design.The field was de-centralized or multi-centralized rather than limited in its cradle land,United States.Researchers from other countries made great contributions and started to play leading roles.This interview with Professor Van Merriёnboer and Professor Kirschner,top researchers from the Netherlands,who are internationally renowned in the fields of instructional design and educational technology.Their theories focused on the work of learning and ten steps developed and improved continuously by their research team in the past two decades,especially in their co-authored book Ten Steps to Learning: A Systematic Approach to Four-Component Instructional Design.The authors summarized the characteristics of the model as follows: The model focused on the integrated and complex learning,based on learning theory,used flexible design approaches to solve the three common problems in education and training,namely,compartmentalization,fragmentation,and the transfer paradox,contributed to the revival of instructional design,and met the need of education in the ever-changing knowledge societies. learning design presented a new method of instructional design.And it is noticeable that Merrill's Five-star Instructional Design(First principles of instruction) and Van Merriёnboer's Complex Learning Design(Four-Component Instructional Design) were coincidentally published in Educational Technology: Research Development(ETRD) in 2002.And it was not only one or two individual theories or models;actually,it was a new trend of instructional design powered by common interests and pursuits,with a promising prospect. This paper was based on the two e-mail interviews with Van Merriёnboer and Kirschner.And their well-claimed book Ten Steps to Learning: A Systematic Approach to Four-Component Instructional Design has been translated into Chinese by Qunli Sheng et al.and published by Fujian Education Press(Series of Contemporary Instructional Design Frontiers,July 2012).We believe that Learning Design is one of the best books ever published in the field of instructional and training design.It provides the latest progress in academic research and valuable guidance on practical improvement in a well-structured,lucid,and attractive text. Jeroen J.G.Van Merriёnboer is professor of Learning and Instruction at the Department of Educational Development and Research of Maastricht University in the Netherlands,and Research Program Director of the Graduate School of Health Professions Education.He holds a Ph.D.degree in instructional technology from the University of Twente.Van Merriёnboer specializes in cognitive architecture and instruction,instructional design for complex learning,holistic approaches to instructional design,and adaptive e-learning applications.He published over 150 scientific articles in the area of learning and instruction.He is also an associate editor of the journal Learning and Instruction and serves on the board of highly ranked scientific journals.His award-winning monograph Training Cognitive Skills(1997) describes his four-component instructional design model for complex skills training and offers a systematic,research-based approach to designing environments for complex learning.He was declared world leader in educational technology by Training Magazine and received the international contributions award from the International Council of the Association for Educational Communications and Technology. Paul A.Kirschner is professor of Educational Psychology at the Centre of Learning Sciences and Technologies(CELSTEC) at the Open University of the Netherlands,and the head of the research programme Learning and Cognition.He is also Scientific Director of the Netherlands' Laboratory for Lifelong Learning(NeLLL).He is an internationally recognized expert in his field.His areas of expertise include lifelong learning,computer-supported collaborative learning,designing electronic and other innovative learning environments,open educational resources,media-use in education,development of teacher extensive(distance) learning materials,use of practicals for the acquisition of cognitive skills and competencies,design and development of electronic learning and working environments,and innovation and the use of information technology educational systems.
On Designing Better Tools for Learning APIs

Adrian Kuhn,Robert DeLine

DOI: https://doi.org/10.1109/SUITE.2012.6225476

2014-02-06

Abstract:Modern software development requires a large investment in learning application programming interfaces (APIs). Recent research found that the learning materials themselves are often inadequate: developers struggle to find answers beyond simple usage scenarios. Solving these problems requires a large investment in tool and search engine development. To understand where further investment would be most useful, we ran a study with 19 professional developers to understand what a solution might look like, free of technical constraints. In this paper, we report on design implications of tools for API learning, grounded in the reality of the professional developers themselves. The reoccurring themes in the participants' feedback were trustworthiness, confidentiality, information overload and the need for code examples as first-class documentation artifacts.

Software Engineering
Learning as a Generative Activity

Logan Fiorella,Richard E. Mayer

DOI: https://doi.org/10.1017/cbo9781107707085

2015-01-01

Abstract:During the past twenty-five years, researchers have made impressive advances in pinpointing effective learning strategies (namely, activities the learner engages in during learning that are intended to improve learning). In Learning as a Generative Activity: Eight Learning Strategies that Promote Understanding, Logan Fiorella and Richard E. Mayer share eight evidence-based learning strategies that promote understanding: summarizing, mapping, drawing, imagining, self-testing, self-explaining, teaching, and enacting. Each chapter describes and exemplifies a learning strategy, examines the underlying cognitive theory, evaluates strategy effectiveness by analyzing the latest research, pinpoints boundary conditions, and explores practical implications and future directions. Each learning strategy targets generative learning, in which learners actively make sense out of the material so they can apply their learning to new situations. This concise, accessible introduction to learning strategies will benefit students, researchers, and practitioners in educational psychology, as well as general readers interested in the important twenty-first-century skill of regulating one's own learning.
The Learning Power of Testing

Richard G. Kunkel

DOI: https://doi.org/10.1111/jlse.12140

2024-02-08

Journal of Legal Studies Education

Abstract:Abstract For many professors, testing is primarily a tool for assessing the learning of students. However, research into the “testing effect” has established the value of testing also as a learning tool, not just as an assessment tool. This article provides an overview of this research and also of my own experiences in using a variety of testing approaches. Based on these experiences, the article offers a process for adopting testing as a learning tool, along with a review of design choices. By increasing their use of testing in business law instruction, business law professors will improve learning.
Tools Fail: Detecting Silent Errors in Faulty Tools

Jimin Sun,So Yeon Min,Yingshan Chang,Yonatan Bisk

2024-06-27

Abstract:Tools have become a mainstay of LLMs, allowing them to retrieve knowledge not in their weights, to perform tasks on the web, and even to control robots. However, most ontologies and surveys of tool-use have assumed the core challenge for LLMs is choosing the tool. Instead, we introduce a framework for tools more broadly which guides us to explore a model's ability to detect "silent" tool errors, and reflect on how to plan. This more directly aligns with the increasingly popular use of models as tools. We provide an initial approach to failure recovery with promising results both on a controlled calculator setting and embodied agent planning.

Computation and Language,Artificial Intelligence,Machine Learning
Creating Reusable Learning Object Strategy ——Cisco Systems’ Research

Yuan Xiaofen,Sheng Qunli

DOI: https://doi.org/10.3969/j.issn.1672-0008.2008.05.004

2008-01-01

Abstract:This paper mainly introduces Cisco Systems’ Research of "Creating Reusable Learning Object Strategy", including the concept, interior structure and building principle of Reusable Learning Object(RLO)and Reusable Information Object(RIO), the creation process of Reusable Learning Object and the structural designing of course, Module and Lesson.
When Is Practice Testing Most Effective for Improving the Durability and Efficiency of Student Learning?

Katherine A. Rawson,John Dunlosky

DOI: https://doi.org/10.1007/s10648-012-9203-1

IF: 8.24

2012-07-31

Educational Psychology Review

Abstract:Although summative testing is often maligned within educational communities, practice testing is one of the most well-established strategies for improving student learning. Despite the wealth of empirical evidence that testing can enhance learning, teachers and students underutilize practice testing as a learning strategy. Accordingly, a high-level goal of this paper is to advocate for increased use of practice testing as a means for improving student learning. To this end, we discuss prior research establishing the generality of test-enhanced learning as well as prior research that points to conditions under which practice testing is particularly effective. We then summarize some recent research that explores schedules of practice testing that will not only produce durable learning, but will do so most efficiently. To briefly foreshadow, a particularly effective schedule involves practicing retrieval until target information is correctly recalled once during initial learning and then relearned to one correct recall in three to four subsequent sessions. Finally, we argue that exploring both criteria—durability and efficiency—can be valuable for evaluating the utility of learning techniques, and we offer some basic prescriptive conclusions for students and educators as well as recommendations for future research.

psychology, educational
An Approach To Using Existing Online Education Tools To Support Practical Education On Moocs

Yanchun Sun,Zijian Qiao,Dejian Chen,Chao Xin,Wenpin Jiao

DOI: https://doi.org/10.1109/COMPSAC.2016.49

2016-01-01

Abstract:MOOCs are popular for online education because of its convenience and excellent educational resources. At present, MOOCs just provide very limited online practical environments such as online tests, quizzes and online judge etc., but they have not provided students with some dynamic and operable online practical environments, such as interactive education tools etc. Online education tools can satisfy the needs of online practicing, mainly because of its abundance, interactivity and convenience, but MOOCs have not made full use of these online tools yet.The paper proposes an approach to using existing online education tools to support practical education on MOOCs by two enhancements: educational resources development and real-time collaborative learning. The key to the approach is operation reuse, which involves recording, optimizing and replaying user operations on existing online educations tools. Based on the approach, we develop an education platform called Smart Web Tutor. Case study is performed to analyze user experience, and the results show that our approach contributes to students' learning, especially for real-time collaborative learning. Also, some suggestions from students are inspiring to further increase the utility and user experience of our approach and education platform.
One Learning and Teaching Tool for Preliminary Virtual Instrument Course

Yongkai Fan,Tianze Sun,Xiaolong Fu,Jun Lin,Yangyi Sui

DOI: https://doi.org/10.1007/978-3-540-72588-6_97

2007-01-01

Abstract:This paper presents one teaching and leaning assistant tool with the purpose of reinforcing both teaching process and learning process for introductory virtual instrument course. This tool has two main ends: from the teacher's viewpoint, the tool gives preliminary introductory information and foundational theory related the course which will help reinforce lecture and laboratory session, therefore, teacher can save time to pay more attention to personalized education for different student; from the students' viewpoint, it providing a leaning environment which equipped with help, collaborative learning group, communication tool, all of those which can facilitate their personal work and make them more motivated to involved in course session.
Helping coaches apply the principles of representative learning design: validation of a tennis specific practice assessment tool

Lyndon Krause,Damian Farrow,Machar Reid,Tim Buszard,Ross Pinder

DOI: https://doi.org/10.1080/02640414.2017.1374684

IF: 3.9428

2017-09-14

Journal of Sports Sciences

Abstract:Representative Learning Design (RLD) is a framework for assessing the degree to which experimental or practice tasks simulate key aspects of specific performance environments (i.e. competition). The key premise being that when practice replicates the performance environment, skills are more likely to transfer. In applied situations, however, there is currently no simple or quick method for coaches to assess the key concepts of RLD (e.g. during on-court tasks). The aim of this study was to develop a tool for coaches to efficiently assess practice task design in tennis. A consensus-based tool was developed using a 4-round Delphi process with 10 academic and 13 tennis-coaching experts. Expert consensus was reached for the inclusion of seven items, each consisting of two sub-questions related to (i) the task goal and (ii) the relevance of the task to competition performance. The Representative Practice Assessment Tool (RPAT) is proposed for use in assessing and enhancing practice task designs in tennis to increase the functional coupling between information and movement, and to maximise the potential for skill transfer to competition contexts.

sport sciences
The Right Tool for the Job: Matching Active Learning Techniques to Learning Objectives

Sarah A. Jacobson,Luyao Zhang,Jiasheng Zhu

DOI: https://doi.org/10.48550/arXiv.2205.03393

2022-07-13

Abstract:Active learning comprises many varied techniques that engage students actively in the construction of their understanding. Because of this variation, different active learning techniques may be best suited to achieving different learning objectives. We study students' perceptions of a set of active learning techniques (including a Python simulation and an interactive game) and some traditional techniques (like lecture). We find that students felt they engaged fairly actively with all of the techniques, though more with those with a heavy grade weight and some of the active learning techniques, and they reported enjoying the active learning techniques the most except for an assignment that required soliciting peer advice on a research idea. All of the techniques were rated as relatively effective for achieving each of six learning objectives, but to varying extents. The most traditional techniques like exams were rated highest for achieving an objective associated with lower order cognitive skills, remembering concepts. In contrast, some active learning techniques like class presentations and the Python simulation were rated highest for achieving objectives related to higher order cognitive skills, including learning to conduct research, though lectures also performed surprisingly well for these objectives. Other technique-objective matches are intuitive; for example, the debate is rated highly for understanding pros and cons of an issue, and small group discussion is rated highly for collaborative learning. Our results support the idea that different teaching techniques are best suited for different outcomes, which implies that a mix of techniques may be optimal in course design.

General Economics,Human-Computer Interaction,Computational Finance,Applications,Computation
Ten Timeless Tips for Keeping on Top of Teaching Technology

Devereaux A. Poling,Frank M. LoSchiavo

DOI: https://doi.org/10.1177/0098628313514182

2013-12-31

Teaching of Psychology

Abstract:We provide tips for helping psychology faculty effectively seek, select, and place new technology into pedagogical practice. We also provide tips to help psychology departments position themselves for a future that includes teaching technologies that have not yet been created. Instead of discussing today’s top innovations in teaching (which may lose favor in a few years), and instead of predicting future trends in teaching technology (which is nearly impossible, given the pace of innovation), we provide psychology faculty and their departments with strategies for keeping up with teaching technology, no matter what form future technologies may take. These tips will serve educators over the long run, even as today’s technological advances become obsolete.

psychology, multidisciplinary,education & educational research
Tools for the improvement of organizational learning processes in innovation

Petra C. de Weerd‐Nederhof,Bernice J. Pacitti,Jorge F. da Silva Gomes,Alan W. Pearson

DOI: https://doi.org/10.1108/13665620210449164

2002-12-01

Journal of Workplace Learning

Abstract:Learning is an essential part of innovation, including the need to internalize and disseminate information and to reduce the duplication of research activities, both technological and organizational. Using a theoretically based framework that places emphasis on the interpretative dimension of organizational learning and centers on learning processes, descriptive accounts of organizational learning in the context of R&D‐intensive companies were produced. From these case studies, specific learning tools or mechanisms were identified: job rotation, innovation process planning (activities, responsibilities, networks, sharing assumptions) and (product innovation) project review. Overall findings point to an organizational learning process which involves a high degree of parallelism and depends on the knowledge base of the organization.
The principle of reflexive practice

Yoram Reich

DOI: https://doi.org/10.1017/dsj.2017.3

2017-01-01

Design Science

Abstract:‘Practice what you preach’ is a phrase occasionally used to refer to those not acting as they want others to act. There are countless opportunities in professional work and daily life to bring such criticism upon ourselves. While the subject is broad, this study focuses on the application of this idea in research practice, and more specifically in design research. One point of departure is the question: ‘how should we practice research if its results are products just like other products?’ The Principle of Reflexive Practice (PRP) states that considering the outcome of design research or research itself as a product, many design principles, tools, methods or knowledge are applicable to design research. A corollary of the principle is that in order to succeed in contemporary research environments, design researchers would gain significant benefit such as improving the success rate of their research projects, if they exercise design methods and tools in designing their research. By exercising these methods, researchers would gain quick and rich feedback about the methods they develop; they would become aware of issues that require users’ perspective that could not be possible without their own practical use. The PRP makes participants in design research aware of the reflexive opportunity in studying design that could be mobilized to advancing their practice and making their research results more effective. Notwithstanding, adopting the PRP is not easy; therefore, it is presented as a challenge to design research. Four examples of using the PRP as a guiding principle in research are presented to demonstrate its importance and benefits.
Seal-Tools: Self-Instruct Tool Learning Dataset for Agent Tuning and Detailed Benchmark

Mengsong Wu,Tong Zhu,Han Han,Chuanyuan Tan,Xiang Zhang,Wenliang Chen

2024-05-14

Abstract:This paper presents a new tool learning dataset Seal-Tools, which contains self-instruct API-like tools. Seal-Tools not only offers a large number of tools, but also includes instances which demonstrate the practical application of tools. Seeking to generate data on a large scale while ensuring reliability, we propose a self-instruct method to generate tools and instances, allowing precise control over the process. Moreover, our Seal-Tools contains hard instances that call multiple tools to complete the job, among which some are nested tool callings. For precise and comprehensive evaluation, we use strict format control and design three metrics from different dimensions. Therefore, Seal-Tools can serve as a new benchmark to evaluate the tool-calling ability of LLMs. Finally, we evaluate several prevalent LLMs and our finetuned model on Seal-Tools. The results show that current systems are far from perfect. The code, data and experiment results are available at

Computation and Language
ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenarios

Junjie Ye,Guanyu Li,Songyang Gao,Caishuang Huang,Yilong Wu,Sixian Li,Xiaoran Fan,Shihan Dou,Qi Zhang,Tao Gui,Xuanjing Huang

2024-01-14

Abstract:Existing evaluations of tool learning primarily focus on validating the alignment of selected tools for large language models (LLMs) with expected outcomes. However, these approaches rely on a limited set of scenarios where answers can be pre-determined, diverging from genuine needs. Furthermore, a sole emphasis on outcomes disregards the intricate capabilities essential for LLMs to effectively utilize tools. To tackle this issue, we propose ToolEyes, a fine-grained system tailored for the evaluation of the LLMs' tool learning capabilities in authentic scenarios. The system meticulously examines seven real-world scenarios, analyzing five dimensions crucial to LLMs in tool learning: format alignment, intent comprehension, behavior planning, tool selection, and answer organization. Additionally, ToolEyes incorporates a tool library boasting approximately 600 tools, serving as an intermediary between LLMs and the physical world. Evaluations involving ten LLMs across three categories reveal a preference for specific scenarios and limited cognitive abilities in tool learning. Intriguingly, expanding the model size even exacerbates the hindrance to tool learning. These findings offer instructive insights aimed at advancing the field of tool learning. The data is available att

Computation and Language,Artificial Intelligence
The Art & Science of Learning Design

DOI: https://doi.org/10.1007/978-94-6300-103-8

2015-01-01

Abstract:We live in an era defined by a wealth of open and readily available information, and the accelerated evolution of social, mobile and creative technologies. The provision of knowledge, once a primary role of educators, is now devolved to an immense web of free and readily accessible sources. Consequently, educators need to redefine their role not just “from sage on the stage to guide on the side” but, as more and more voices insist, as “designers for learning”. The call for such a repositioning of educators is heard from leaders in the field of technology-enhanced learning (TEL) and resonates well with the growing culture of design-based research in Education. However, it is still struggling to find a foothold in educational practice. We contend that the root causes of this discrepancy are the lack of articulation of design practices and methods, along with a shortage of tools and representations to support such practices, a lack of a culture of teacher-as-designer among practitioners, and insufficient theoretical development. The Art and Science of Learning Design (ASLD) explores the frameworks, methods, and tools available for teachers, technologists and researchers interested in designing for learning Learning Design theories arising from findings of research are explored, drawing upon research and practitioner experiences. It then surveys current trends in the practices, methods, and methodologies of Learning Design. Highlighting the translation of theory into practice, this book showcases some of the latest tools that support the learning design process itself.
Instruments of value: using the analytic tools of public value theory in teaching and practice

Jorrit de Jong,Scott Douglas,Mariafrancesca Sicilia,Zoe Radnor,Mirko Noordegraaf,Peter Debus

DOI: https://doi.org/10.1080/14719037.2016.1192162

IF: 6.004

2016-08-25

Public Management Review

Abstract:The tools of public value management – such as the strategic triangle and the public value account – are increasingly used by scholars and practitioners alike. At the same time, some confusion remains regarding their functionality in action. Based on our experiences with these tools in classrooms and boardrooms, we analyse how these instruments help to explore and structure different dimensions of public management challenges. We propose a set of ‘principles of application’, detailing under what conditions public value tools are most likely to be helpful, and suggest a course of action for strengthening, connecting and extending the current tool box.

management,public administration
Training College Students to Use Learning Strategies: A Framework and Pilot Course

Mark A. McDaniel,Gilles O. Einstein,Emily Een

DOI: https://doi.org/10.1177/1475725721989489

2021-02-24

Abstract:The use of effective study strategies is important for academic achievement, yet research indicates that students often use relatively ineffective learning strategies. Though potent strategies to promote durable learning exist, there is a lack of theoretical and empirical work on how to train students to self-regulate use of these strategies successfully. We summarize a novel framework to do so: the knowledge, belief, commitment, and planning ( KBCP) framework. The assumptions are that learners must develop knowledge about a strategy and how to use it, believe that the strategy is effective for the individual learner, commit to the strategy, and create an action plan for carrying it out. We then describe an example of the KBCP framework as applied to a college course on teaching students effective learning strategies and self-regulation of these strategies in their college coursework. Lectures on specific learning strategies conveyed knowledge about the strategies, in-class demonstrations illustrated their efficacy (to support belief), and assignments required students to develop a plan for applying them to their courses and to implement the plan (to ensure commitment). Discussion focuses on the implications of including training in how to use learning strategies in psychology courses and curricula, and on the possible extension of such training to the teaching of other psychology content.
Teaching Skills 1

Karen Bearss,Cynthia R. Johnson,Benjamin L. Handen,Eric Butter,Luc Lecavalier,Tristram Smith,Lawrence Scahill

DOI: https://doi.org/10.1093/med-psych/9780190627812.003.0009

2018-07-01

Abstract:This session provides parents with step-by-step procedures for teaching skills that increase a child’s independence and promote positive behavioral change.

Ten tools for practice learning.

10 Steps to 10 + Questions:Interviews with the Authors of Ten Steps to Complex Learning

On Designing Better Tools for Learning APIs

Learning as a Generative Activity

The Learning Power of Testing

Tools Fail: Detecting Silent Errors in Faulty Tools

Creating Reusable Learning Object Strategy ——Cisco Systems’ Research

When Is Practice Testing Most Effective for Improving the Durability and Efficiency of Student Learning?

An Approach To Using Existing Online Education Tools To Support Practical Education On Moocs

One Learning and Teaching Tool for Preliminary Virtual Instrument Course

Helping coaches apply the principles of representative learning design: validation of a tennis specific practice assessment tool

The Right Tool for the Job: Matching Active Learning Techniques to Learning Objectives

Ten Timeless Tips for Keeping on Top of Teaching Technology

Tools for the improvement of organizational learning processes in innovation

The principle of reflexive practice

Seal-Tools: Self-Instruct Tool Learning Dataset for Agent Tuning and Detailed Benchmark

ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenarios

The Art & Science of Learning Design

Instruments of value: using the analytic tools of public value theory in teaching and practice

Training College Students to Use Learning Strategies: A Framework and Pilot Course

Teaching Skills 1