Digital Manipulatives: New Toys to Think With

Mitchel Resnick, Fred Martin, Robert Berg, Rick Borovoy, Vanessa Colella, Kwin Kramer, Brian Silverman
MIT Media Laboratory
20 Ames Street
Cambridge, MA 02139

To be published in the proceedings of the CHI '98 conference

Abstract

In many educational settings, manipulative materials (such as Cuisenaire Rods and Pattern Blocks) play an important role in children's learning, enabling children to explore mathematical and scientific concepts (such as number and shape) through direct manipulation of physical objects. Our group at the MIT Media Lab has developed a new generation of "digital manipulatives" -- computationally-enhanced versions of traditional children's toys. These new manipulatives enable children to explore a new set of concepts (in particular, "systems concepts" such as feedback and emergence) that have previously been considered "too advanced" for children to learn. In this paper, we discuss four of our digital manipulatives -- computationally-augmented versions of blocks, beads, balls, and badges.

Introduction

Walk into any kindergarten, and you are likely to see a diverse collection of "manipulative materials." You might see a set of Cuisenaire Rods: brightly colored wooden rods of varying lengths. The colors and lengths of the rods are carefully chosen to engage children in explorations of arithmetic concepts and relationships. Children discover that each brown rod is the same length as two purples -- or four reds. On the next table, you might see a set of Pattern Blocks. Children can use these polygon-shaped tiles to create mosaic-like patterns -- and, in the process, learn important geometric concepts.

As children build and experiment with these manipulative materials, they develop richer ways of thinking about mathematical concepts such as number, size, and shape. But there are many important concepts that are very difficult (if not impossible) to explore with these traditional manipulative materials. In particular, traditional manipulatives generally do not help children learn concepts related to dynamics and systems. Usually, these concepts are taught through more formal methods -- involving manipulation of abstract symbols, not physical objects. As a result, these concepts are accessible only to older students, with more mathematical expertise.

This paper discusses a new breed of manipulative materials that we call "digital manipulatives." These new manipulatives -- with computational power embedded inside -- are designed to expand the range of concepts that children can explore through direct manipulation, enabling children to learn concepts that were previously considered "too advanced" for children. The paper begins with a brief history of the educational uses of manipulative materials, then discusses several digital manipulatives that our research group has developed.

Learning with Manipulative Materials

The idea that physical objects might play an important role in the learning process is a relatively new idea. Until the 19th century, formal education focused almost exclusively on lectures and recitations. One of the first advocates for "hands-on learning" was the Swiss educator Johann Heinrich Pestalozzi (1746-1827). Pestalozzi asserted that students need to learn through their senses and through physical activity, arguing for "things before words, concrete before abstract" [12].

Friedrich Froebel, who created the world's first kindergarten in Germany in 1837, was very influenced by Pestalozzi's ideas. Froebel's kindergarten was filled with objects for children to play with. Froebel developed a specific set of 20 "gifts" -- physical objects such as balls, blocks, and sticks -- for children to use in the kindergarten. Froebel carefully designed these gifts to help children recognize and appreciate the common patterns and forms found in nature. Froebel's gifts were eventually distributed throughout the world, deeply influencing the development of generations of young children. Indeed, Frank Lloyd Wright credited his boyhood experiences with Froebel's gifts as the foundation of his architecture [2].

Maria Montessori extended Froebel's ideas, developing materials for older children and inspiring a network of schools in which manipulative materials play a central role. In an effort to create an "education of the senses" [10], Montessori developed new materials and activities to help children develop their sensory capabilities. Montessori hoped that her materials would put children in control of the learning process, enabling them to learn through personal investigation and exploration.

Jean Piaget provided an epistemological foundation for these educational ideas. Piaget theorized that children must first construct knowledge through "concrete operations" before moving on to "formal operations" (e.g., [13]). During the past decade, a new wave of research has suggested that Piaget, if anything, understated the importance of concrete operations. Sherry Turkle and Seymour Papert, for example, have argued for a "revaluation of the concrete," suggesting that "abstract reasoning" should not be viewed as more advanced than (or superior to) concrete manipulations [22].

Today, manipulative materials are well-established in the classroom, especially in the early grades. Education journals are filled with papers on ways of using manipulative materials in the classroom -- papers with colorful titles such as "Lima Beans, Paper Cups, and Algebra" [8] and "Activities to Grow On: Buttons, Beads, and Beans" [5].

Digital Manipulatives

Different manipulative materials engage children in different types of thinking. According to an old saying: "Give a person a hammer, and the whole world looks like a nail." Similarly, give a child Cuisenaire Rods, and arithmetic relationships become more salient for the child. Give a child Pattern Blocks, and geometric relationships become more salient.

Our goal in designing new "digital manipulatives" is to make a new set of concepts salient for children. Our basic strategy is to embed computational and communications capabilities in traditional children's toys. By using traditional toys as a starting point, we hope to take advantage of children's deep familiarity with (and deep passion for) these objects. At the same time, by endowing these toys with computational and communications capabilities, we hope to highlight a new set of ideas for children to think about.

In particular, we believe that children, by playing and building with these new manipulatives, can gain a deeper understanding of how dynamic systems behave. Until recently, dynamic systems have been studied primarily at the university level, using advanced mathematical techniques like differential equations. Computer-based modeling environments -- such as Stella [20], StarLogo [15], and Model-It [7] -- have made it easier for pre-college students to model and explore systems phenomena (such as feedback and emergence). We expect that digital manipulatives will make these ideas accessible to even younger students, enabling students to explore these ideas through direct manipulation of familiar physical objects. Such explorations would not be possible with traditional (non-computational) manipulative materials. Computation and communication capabilities play a critical role: they enable physical objects to move, sense, and interact with one another -- and, as a result, make systems-related concepts more salient to (and manipulable by) children.

Our development of digital manipulatives can be seen as part of a broader trend within the CHI community. CHI researchers have long recognized the value of providing users with "objects" to manipulate, but they have traditionally focused on "virtual objects" -- as in object-oriented languages and direct-manipulation graphical interfaces. It is only in recent years that CHI researchers have shifted attention to physical objects. In research efforts variously described as "ubiquitous computing," "computer-augmented environments," and "things that think," researchers are now exploring ways of adding computational capabilities to everyday objects ranging from notepads and desktops to eyeglasses and shoes [4, 6, 24, 25].

Our research on digital manipulatives is part of this trend, but it focuses explicitly on the use of objects to support learning and education. Our primary goal is not to help users accomplish some task faster or more effectively, but rather to engage them in new ways of thinking. In short, we are interested in Things That Think only if they also serve as Things To Think With.

This research can be viewed as an extension of our previous work on LEGO/Logo [14], a robotics construction kit commercialized by the LEGO toy company and now used in more than 20,000 schools in the United States. With LEGO/Logo, children can write computer programs to control their LEGO constructions. Elementary-school students have used LEGO/Logo to build and program a wide assortment of creative machines, including a programmable pop-up toaster, an automated amusement park, and a machine that sorts LEGO bricks according to their lengths. In these projects, students build with an enhanced set of LEGO parts (including motors and sensors), connect their constructions to a personal computer (using wires and an interface box), then write Logo computer programs to control the actions of their constructions.

In LEGO/Logo, wires are both a practical and conceptual nuisance, limiting not only what children can build but also how they think about their constructions. In our new work with digital manipulatives, we get rid of the wires and embed computational capabilities directly in the toys themselves. We continue to use Logo as the primary programming environment. But Logo programs can be downloaded directly into these new toys (typically via infrared communication), so that the toys function autonomously.

The next four sections describe digital manipulatives that we have created by adding computation to four traditional children's toys -- blocks, beads, balls, and badges. These projects are in varying stages of development. Some of these new manipulatives have already been used extensively by children; others are still in the early prototype stage.

Blocks

We began our work on digital manipulatives by embedding computation in LEGO bricks -- creating Programmable Bricks [9, 16]. Each Programmable Brick has output ports for controlling motors and lights, and input ports for receiving information from sensors (e.g., light, touch, and temperature sensors). To use a P-Brick, a child writes a Logo program on a personal computer, then downloads the program to the P-Brick. After that, the child can take (or put) the P-Brick anywhere; the program remains stored in the P-Brick.

Figure 1. Two elementary-school students test the behaviors of their Programmable Brick "creature."

In our initial work in schools, students have used Programmable Bricks to create autonomous "creatures" that mimic the behaviors of real animals (Figure 1). For example, one group of fifth-grade students created a LEGO dinosaur that was attracted to flashes of light, like one of the dinosaurs in Jurassic Park. To make the dinosaur move toward the light, the students needed to understand basic ideas about feedback and control. The program compared readings from the dinosaur's two light-sensor "eyes." If the dinosaur drifted too far to the left (i.e., more light in the right eye), the program made it veer back to the right; if the dinosaur went too far right (more light in the left eye), the program corrected it toward the left.

This type of feedback strategy is typically not taught until university-level courses. But with the right tools, fifth graders were able to explore these ideas. The students also considered the similarities (and differences) between animals and machines. Were their LEGO creatures more like animals? Or more like machines? They compared their robots' sensors to animal senses, and they discussed whether real animals have "programs" like the ones they wrote for their robotic creatures [17].

Our newest Programmable Bricks, called Crickets, are roughly the size of children's Matchbox cars and action figures (Figures 2 and 3). Each Cricket contains a Microchip PIC processor and is capable of two-way infrared communications. Children can use Crickets to create communities of robotic creatures that interact with one another. We have found that children, by teaching their creatures to communicate with one another, can learn general principles about communication. When a child programs a Cricket-based creature to communicate with a second creature, the child must have a good model of what the second creature already "knows." The general lesson: to communicate well, you must develop a model of your audience. This idea might seem obvious, but it is often ignored in interactions among people, and thus is an important lesson for children to learn.

Figure 2. A Cricket (with LEGO figure to show scale)

Figure 3. Creature with two built-in Crickets, which communicate with one another to synchronize their motion

Recently, we have begun a new science-education initiative using Crickets [18]. Many science-education researchers emphasize the importance of children developing their own scientific investigations (rather than carrying out pre-scripted experiments, as is common in many classrooms). We go a step further, encouraging students to use Crickets to create their own scientific instruments to carry out their investigations. For example, two elementary-school girls used Crickets to build a bird feeder that keeps track of the birds that visit. When a bird lands, it pushes a touch sensor, which triggers a LEGO mechanism, which depresses the shutter of a camera, taking a picture of the bird. Our initial studies indicate that students, by building their own scientific instruments, not only become more motivated in science activities, but also develop critical capacities in evaluating scientific measurements and knowledge, make stronger connections to the scientific concepts underlying their investigations, and develop deeper understandings of the relationship between science and technology.

Beads

In recent years, beads have become increasingly popular among children, especially young girls. There are entire stores with nothing but bins of beads of varying colors and sizes. Children string beads together to create colorful necklaces and bracelets.

With traditional beads, children create colorful but static patterns. Our Programmable Beads (Figure 4) are designed to engage children in creating dynamic patterns. Each Programmable Bead has a built-in microprocessor and light-emitting diode (LED), and it communicates with its neighboring beads by simple inductive coupling. String beads together in different ways and you get different dynamic patterns of light. Some beads pass the light to the next bead along the string, other beads reflect the light back, still others "swallow" the light. Some beads pass the light with a particular probability. A slight change in the behavior or placement of one of the beads can lead to an entirely different pattern of activity in the overall collection.

Figure 4. A necklace of Programmable Beads

Children can work with the beads at two different levels. For starters, they can string together pre-programmed beads (each with a fixed behavior), and observe the dynamic lighting patterns that arise from the interactions. More advanced users can write new programs and download them into the beads.

A string of Programmable Beads can be viewed as a physical instantiation of a one-dimensional cellular automata [21]. In cellular automata, each cell changes its state based on the states of its neighboring cells. Cellular automata have proved to be a rich framework for exploring "emergent phenomena"; simple rules for each cell can lead to complex and unexpected large-scale structures. But cellular automata seem best suited as a tool for mathematicians and computer aficionados, not for children. The idea of writing "transition rules" for "cells" is not an idea that most children can relate to. Programmable Beads allow children to explore ideas of decentralized systems and emergent phenomena in a more natural way, through the manipulation of physical objects.

We believe that Programmable Beads can provide a meaningful and motivating context for children to begin thinking about probabilistic behaviors. Imagine a bead that passes the light to the next bead half of the time but reflects the light back to the previous bead the other half of the time. By stringing a set of these beads together, children can explore random-walk behaviors. What if you then add a bead that passes the light three-quarters of the time and reflects it just one-quarter of the time? How will that change the overall dynamic pattern? Most children (indeed, most people) have poor intuitions about such systems. Our hypothesis is that children who grow up playing with Programmable Beads will develop much richer intuitions about probabilistic behaviors.

Programmable Beads also provide a context for children to learn about "programming paradigms." There are two very different ways to think about programming the beads. Paradigm 1: Children can program the behaviors of the beads themselves, telling each bead to turn its light off or on based on its neighbors' lights. Paradigm 2: Children can program a "process" that jumps from bead to bead (e.g., turn on this bead's light for two seconds, then jump two beads down the string and turn on that light for three seconds). The important point is not for children to learn which of these paradigms is better (in fact, neither is inherently better). Rather, the important lesson is that there are often multiple approaches for describing behaviors, each with its own advantages.

Balls

Probably the most popular of all children's toys is the ball. How could computation possibly improve the ball? We are exploring that question with our BitBall -- a transparent, rubbery ball (about the size of a baseball) with a Cricket, accelerometer, and colored LEDs embedded inside.

To customize a BitBall (Figure 5), a child writes a program on a desktop computer (using a modified version of Logo), then downloads the program to the BitBall via infrared communication. A child can program a BitBall to turn on its LEDs based on its motion, as detected by the accelerometer. One child, for example, might program a BitBall to flash its red light whenever it undergoes a sharp acceleration or deceleration (i.e., whenever it is thrown or caught). Another child might create a ball that "wants" to be played with: If the ball doesn't experience any sharp accelerations for a certain period of time, it begins flashing its lights in an effort to attract someone to play with it. We have found that children are quick to attribute intentionality to the BitBall, even when it is running the simplest of programs. When children program the BitBall themselves, they develop a better understanding of how seemingly-intentional behaviors can arise from just a few simple rules.

Figure 5. The BitBall

Since the BitBall (via its Cricket) can send and receive infrared signals, children can also program BitBalls to communicate with other electronic devices. For example, students have programmed the BitBall to send its acceleration data to a MIDI synthesizer in real time, in an effort to "hear the motion" of the ball (with, for example, acceleration mapped onto pitch).

BitBalls can also be used in scientific investigations. A BitBall can store its acceleration data and later upload the data to a desktop computer for analysis. For example, students have dropped a BitBall from the top of a building, then used the acceleration data to figure out the height of the building. Such investigations can lead to a deeper understanding of kinematics. One group of students (in this case, university students) threw a BitBall in the air and graphed the acceleration data in an effort to find the top of the trajectory. They discovered that there was no change in acceleration while the ball is in flight, so it was impossible to determine the top of the trajectory from acceleration data alone. The students had previously studied gravity and acceleration in physics class, but they were not able to apply their classroom knowledge to this real-world context. We believe that experience with the BitBall will help students develop an understanding of acceleration that they can more easily transfer to new contexts.

It is important to note that the BitBall is significantly different from most commercial toys with embedded electronics. Some companies, for example, sell yo-yos that turn on a light while they are moving. We believe that such toys are different from the BitBall along an important dimension. The light-up yo-yo is pre-programmed to always do the exact same thing. It is a one-trick toy. The BitBall gives much greater flexibility and creative power to children. With the BitBall, children themselves decide how the toy should behave.

Badges

Many children like to wear badges (such as a sheriff's badge) and buttons with slogans. Our Thinking Tags are based on these traditional badges, but they have built-in electronics so that they can communicate with one another (via infrared communication) -- and also change their displays based on those communications.

We first developed the Thinking Tags (Figure 6) for a conference (for adults) at the Media Laboratory. The Thinking Tags served as name tags, but each tag also contained information about the interests and opinions of its wearer. When two people met, their badges exchanged information and turned on lights to show how much the two people had in common. In this way, the badges acted as a conversational prop to get people talking with one another. Other research labs have also developed "smart badges" (e.g., [23]), but our Thinking Tags are different in an important way: While other badges are designed to support interaction between people and machines (e.g., to track the location of a person within a building), our Thinking Tags are designed to facilitate communication among people. And, indeed, the Thinking Tags have proved successful as a catalyst for conversation [1].

Figure 6: Thinking Tags

More recently, we have begun to use Thinking Tags in educational applications with pre-college students. In particular, we have organized "participatory simulations" in which students themselves play roles within simulations [3, 19]. For example, some students have used Thinking Tags to simulate the spread of an epidemic, with an electronic "virus" jumping from one student's Thinking Tag to another. Some students start as the (unknowing) carriers of the disease, while others are immune to the disease. Over time, more and more students become "infected" with the disease. The challenge is for the students to develop theories to explain the spread of the virus. Does the disease have a latency period? Is transmission probabilistic? Are some people more susceptible than others? As part of their analysis, students can get additional data from their Thinking Tags, which keep track of who each person has interacted with and when. Often, the students "rerun" the simulation, resetting their badges to their initial states and testing a different set of interactions.

Students, of course, could do similar explorations with on-screen computer simulations. But we have found that the first-person nature of the Thinking-Tag activities provides a more meaningful framework for students to investigate systems concepts (at least initially). In particular, the Thinking-Tag activities encourage "collaborative theory building," in which groups of students work together to develop and test new theories.

We have run similar activities using somewhat different metaphors. In one case, we explained that ideas (or "memes") could jump from one badge to another. Some people were "resistant" to new ideas; others were active carriers. The goal was to help people develop a better understanding of how ideas spread through a population -- and also to engage them in thinking about the similarities (and differences) between the spread of disease and the spread of new ideas.

Our latest version of the Thinking Tag has a built-in two-line display, so that people can display text messages on their badges. In one of our participatory simulations, each person was able to store up to seven memes on their badge. When you met another person, your badge interacted with the other person's badge and "decided" which of your memes to display to the other person -- based on which memes the other person had previously seen and selected. Meanwhile, if you saw a meme you liked on another person's badge, you could simply push a button on your own badge and add the meme to your personal collection. The badges collected data so that students could later analyze the patterns of social interaction and meme propagation. Social scientists have long been interested in these types of patterns, but they have lacked the tools needed for rigorous data collection and analysis. Thinking Tags fill that gap.

This type of activity is very different from traditional science-education activities. Science is usually taught as a process of detached observation of phenomena, not active participation within phenomena. We believe, however, that role-playing can play a powerful role in science education -- especially in the study of systems-related concepts. Our preliminary analysis indicates that participatory simulations (supported with Thinking Tags) leads to a richer learning experience than is possible with traditional computer-simulation activities -- or with traditional group activities without computer support.

Looking Ahead

We view these new blocks, beads, balls, and badges not as a set of separate projects, but as an integrated family. The same underlying software environment is used for programming all of these new toys, and the toys are designed to communicate and interact with one another. A BitBall, for example, can send information (via infrared) to the Thinking Tags -- in effect, using the Thinking Tags as a remote display peripheral. Our goal is to create a unified "community of things" that children can use in a wide variety of explorations and design activities.

Our work with digital manipulatives is still in the preliminary stages. Our plan is to conduct more in-depth empirical studies of how and what children learn through their interactions with digital manipulatives. In particular, we plan to investigate: What types of programming paradigms and interfaces are needed to help children program digital manipulatives? Are children able to understand how and why patterns arise from interactions among the digital manipulatives (e.g., the emergent lighting patterns that arise along a necklace of Programmable Beads) -- and, if not, what new tools and support materials should we provide to help children make sense of those patterns? In what ways do the "surface features" of our digital manipulatives (e.g., the packaging for the beads) influence how children use them? In what ways do we need to rethink classroom organization and practices if we want to use digital manipulatives in classroom settings?

We expect that these studies will yield ideas for the redesign of our current digital manipulatives -- and the design of new ones. More broadly, we hope that these studies will help us to develop a richer theoretical framework for understanding the role of physical objects (and, in particular, computationally-enhanced physical objects) in the learning process.

Acknowledgments

The Programmable Bricks and Crickets have been developed primarily by Fred Martin, Brian Silverman, and Robbie Berg. The Programmable Beads have been developed primarily by Kwin Kramer and Rick Borovoy. The BitBalls have been developed primarily by Kwin Kramer, Robbie Berg, Fred Martin, and Brian Silverman. The Thinking Tags have been developed primarily by Rick Borovoy, Fred Martin, Vanessa Colella, Brian Silverman, and Kwin Kramer. Mitchel Resnick has supervised the projects and developed the conceptual framework of "digital manipulatives." This research has been supported by generous grants from the LEGO Group, the National Science Foundation (grants 9358519-RED and CDA-9616444), and the MIT Media Laboratory's Things That Think and Digital Life consortia.

References

1. Borovoy, R., McDonald, M., Martin, F., and Resnick, M. (1996). Things that blink: Computationally augmented name tags. IBM Systems Journal 35, 3, 488-495.

2. Brosterman, N. (1997). Inventing Kindergarten. New York: Harry N. Adams Inc.

3. Colella, V., Borovoy, R., and Resnick, M. (1998). Participatory Simulations: Using Computational Objects to Learn about Dynamic Systems. Demonstration session, Proceedings of CHI '98, ACM Press.

4. Eisenberg, M., Mackay, W., Druin, A., Lehman, S., and Resnick, M. (1996). Real Meets Virtual: Blending Real World Artifacts with Computational Media. Panel session, Proceedings of CHI '96, ACM Press.

5. Gonzolis, A. (1992). Activities to Grow On: Buttons, Beads, and Beans. Instructor 101, 7, 51.

6. Ishii, H., and Ulllmer, B. (1997). Tangible Bits: Towards Seamless Interfaces between People, Bits, and Atoms. Paper session, Proceedings of CHI '97, ACM Press.

7. Jackson, S., Stratford, S., Krajcik, J., and Soloway, E. (1996). A Learner-Centered Tool for Students Building Models. Communications of the ACM 39, 4, 48-49.

8. Loewen, A.C. (1991). Lima Beans, Paper Cups, and Algebra. Arithmetic Teacher 38, 8, 34-37.

9. Martin, F. (1994). Circuits to Control: Learning Engineering by Designing LEGO Robots. Doctoral Dissertation. Cambridge, MA: MIT Media Laboratory.

10. Montessori, M. (1912). The Montessori Method. New York: Frederick Stokes Co.

11. Papert, S. (1980). Mindstorms: Children, Computers, and Powerful Ideas. New York: Basic Books.

12. Pestalozzi, H. (1803). ABC der Anschauung, oder Anschauungs-Lehre der Massverhaltnisse. Tubingen, Germany: J.G. Cotta.

13. Piaget, J. (1972). The Principles of Genetic Epistemology. New York: Basic Books.

14. Resnick, M. (1993). Behavior Construction Kits. Communications of the ACM 36, 7, 65-71.

15. Resnick, M. (1994). Turtles, Termites, and Traffic Jams. Cambridge, MA: MIT Press.

16. Resnick, M., Martin, F., Sargent, R., and Silverman, B. (1996). Programmable Bricks: Toys to Think With. IBM Systems Journal 35, 3, 443-452.

17. Resnick, M., Bruckman, A., and Martin, F. (1996). Pianos Not Stereos: Creating Computational Construction Kits. Interactions 3, 6, 41-50.

18. Resnick, M., Berg, R., Eisenberg, M., Turkle, S., and Martin, F. (1996). Beyond Black Boxes: Bringing Transparency and Aesthetics Back to Scientific Instruments. Proposal to the National Science Foundation. Available from MIT Media Laboratory.

19. Resnick, M., and Wilensky, U. (1997). Diving into Complexity: Developing Probabilistic Decentralized Thinking through Role-Playing Activities. Journal of the Learning Sciences 7, 2.

20. Roberts, N., Anderson, D., Deal, R., Garet, M., and Shaffer, W. (1983). Introduction to Computer Simulation: A System Dynamics Modeling Approach. Reading, MA: Addison-Wesley.

21. Toffoli, T., and Margolus, N. (1987). Cellular Automata Machines. Cambridge: MIT Press.

22. Turkle, S., and Papert, S. (1990). Epistemological Pluralism. Signs 16, 1, 128-157.

23. Want, R., Hopper, A., Falcao, V., and Gibbons, J. (1992). The Active Badge Location System. ACM Transactions on Information Systems 10, 1, 91-102.

24. Weiser, M. (1991). The Computer for the 21st Century. Scientific American 265, 3, 94-104.

25. Wellner, P., Mackay, W., and Gold, R. (1993). Computer Augmented Environments: Back to the Real World. Communications of the ACM 36, 7, 24-26.