MAS 962 Special Topics in Media Technology Cooperative Machines

Fall 2003
This course examines the issues, principles, and challenges toward building machines that cooperate with humans and with other machines. Philosophical, scientific, and theoretical insights into this subject will be covered, as well as how these ideas are manifest in both natural and artificial systems (e.g. software agents and robots). Course grade will be based on weekly student assignments and presentations, participation in lively class discussion, and a final term project.

Professor Cynthia Breazeal

H-Level Credit (12-0-0)

Course email list

cooperative-machines@media.mit.edu

Grading

  • Summaries / critiques 25%
  • Class participation / presentations 25%
  • Term Project / paper 50%

Weekly readings

  • Two components: summary and critique
  • One page per reading maximum
  • Due at noon, XXXX before each class

Readings can be downloaded from the course website, below.

Student presentation of readings

  • Presentation assignments made by XXX of each week
  • 30 minutes per presentation followed by 30 minutes of discussion per paper.

Student presentations should include summary of work, critique, and connections to other relevant literature. The presenter is expected to include material from papers outside of those assigned by the class reading list, such as looking up key papers from the cited references.

Term Project

  • Analytical paper with original perspectives on literature, OR build and evaluate computational model, and connect to literature
  • Proposals due the 7th week: October 20th
  • Final project presentations on 13th week : December 1
  • Final conference style paper (8 page max) due 13th week: December 1

Readings

Week 0: Introduction to course

Week 1: Philosophy

B. Malle & J. Knobe (2001), "The Distinction between Desire and Intention: A Folk-Conceptual Analysis." In Malle, Moses and Baldwin (eds.) Intention and Intentionality. MIT Press. Chapter 2.

M. Bratman (1990), "What is intention?" In Cohen, Morgan and Pollack (eds.) Intentions in Communication. MIT Press. Chapter 2.

D. Dennett (1987), "Three kinds of intentional psychology." In The Intentional Stance. MIT Press. Chapter 3.

Week 2: Development of Theory of Mind

A. Meltzoff & R. Brooks (2001) '"Like Me" as a Building block for understanding other minds: bodily acts, attention and intention.' In Malle, Moses & Baldwin (eds) Intention and Intentionality. MIT Press. Chapter 8.

Meltzoff and J. Decety (2003) "What imitation tells us about social cognition: a rapproachment between developmental psychology and cognitive neuroscience." Phil. Trans. R. Soc. London B 358. pp 491—500.

S. Baron Cohen (1991), "Precursers to a Theory of Mind: Understanding Attention in Others." In A. Whiten (ed) Natural Theories of Mind. Blackwell. Chapter 16.

H. Wellman (1991), "From Desires to Beliefs: Acquisition of a Theory of Mind." In A. Whiten (ed.) Natural Theories of Mind. Blackwell. Chapter 2.

Week 3: Models of Theory of Mind

A. Gopnick & H. Wellman (1992), "Why the Child's Theory of Mind Really Is a Theory." Mind and Language 7(1-2), pp 145-171

S. Nichols, S. Stich, A. Leslie and D. Klein (1996), "Variations of off-line simulation." In Carreuthers and Smith (eds.) Theories of Theories of Mind. Cambridge University Press. Chapter 4.

A. Goldman (2001), "Desire, Intention, and the Simulation Theory." In Malle, Moses and Baldwin (eds.) Intention and Intentionality. MIT Press. Chapter 10.

Week 4: Reading behavior, reading minds

D. Baldwin & L. Moses (1994), "Early understanding of referential intent and attentional focus: evidence from language and emotion." In C. Lewis and P. Mitchell (eds.) Children's Early Understanding of Mind. Lawrence Erlbaum Assoc. Chapter 7.

A. Woodward, J. Sommerville and J. Guajardo (2001), "How infants make sense of intentional action." In Malle, Moses, and Baldwin (eds.) Intention and Intentionality. MIT Press. Chaper 7.

D. Povinelli (1996), "Chimpanzee theory of mind? The long road to strong inference." In P. Carruthers and P. Smith (eds.) Theories of Theories of Mind. Cambridge University Press. Chapter 18.

B. Gleissner, A. Meltzoff, H. Bekkering (2000), "Children's coding of human action: cognitive factors influencing imitation in 3 year olds." Developmental Science 3(4), pp. 405-414.

Week 5: Toward Machines with ToM

M. Mataric (2000). "Getting Humanoids to Move and Imitate". In IEEE Intelligent Systems:18-24, Jul 2000.

B. Scassellati (2000). "Theory of Mind for a Humanoid Robot," In Proceedings of the first IEEE/RSJ International Conference on Humanoid Robotics. Cambridge, Ma.

C. Breazeal, D. Bushbaum, J. Gray, B. Blumberg (2004). "Learning from and about others: towards using imitation to bootstrap the social competence of robots." In review Artificial Life.

Week 6: Collaborative Systems

B. Gross (1996). "Collaborative Systems." 1994 AAAI Presidential Address. 2(17), pp. 67-85.

B. Grosz and C. Sidner (1986), "Attention, Intentions, and the Structure of Discourse", Computational Linguistics, 12(3), pp 175—202.

J. Allen, D. Byron, M. Dzikovska, G. Ferguson, L. Galescu and A. Stent (2001), "Towards conversational human-computer interaction." In AI Magazine 22(4), pages 27-38, Winter, 2001.

Week 7: Theory of collaborative dialog

P. Cohen & H. Levesque (1990), "Intention is Choice with commitment." Artificial Intelligence 42(2-3), pp. 213-361.

B. Grosz & C. Sider (1990) "Plans for Discourse." In Cohen, Morgan, Pollack (eds) Intentions in Communication. MIT Press. Chapter 20.

D. Sullivan, A. Glass, B. Grosz, and S. Kraus (1999), "Intention reconciliation in the context of teamwork: an initial empirical investigation." In Klusch, Shehory, Weiss (eds) Cooperative Information Agents III, Lecture Notes in Artificial Intelligence. Vol 1652. Springer-verlag. Pp 149-162.

Barbara Grosz and Sarit Kraus. 1999. "The Evolution of SharedPlans." In Foundations and Theories of Rational Agencies, A. Rao and M. Wooldridge, eds. pp. 227-262.

Week 8: Recognizing intentional structure in discourse

K. Lochbaum (1998), "A collaborative planning model for intentional structure." Computational Linguistics 4(24) pp.525-571.

F. Quek, D. McNeill, R. Bryll, S. Duncan, X. Ma, C. Kirbas, K. McCullough, R. Ansari (2002), "Multimodal human discourse: gesture and speech." ACM transactions on computer human interaction 9(3), pp 171-193.

J. Cassell, Y. Nakano, T. Bickmore (2001), "Non-verbal cues for discourse structure." In Proceedings of the association for computational linguistics, July 2001. Telouse, France.

Week 9: Plan recognition in discourse

D. Litman & J. Allen (1990) "Discourse processing and commonsense plans." In Cohen, Morgan, and Pollack (eds.) Intentions in Communication. MIT Press. Chatper 17.

Lesh, N., Rich, C., Sidner, C.L. (1999) "Using plan recognition in human-computer collaboration." In Proceedings of the International Conference on User Modelling (UM-99),

N. Lesh, C. Rich, and C. Sidner (2001), "Collaborating with focused and unfocused users under imperfect communication." In Proceedings of the international conference on User Modelling. Springer Verlag, pp. 64—73.

Week 10: Machines that express intent

F. de Rosis, C. Pelachaud, I. Poggi, V. Carofiglio and B. De Carolis (2003) "From Greta's Mind to her Face: Modelling the Dynamics of Affective States in a Conversational Embodied Agent." International Journal of Human-Computer Studies, E Hudlicka and M Mc Neese (Eds). 59, 81-118, 2003

J. Cassell and H. Vilhjalmsson (1999), "Fully embodied conversational avatars: making communicative behaviors autonomous." Autonomous Agents and Multi-agent Systems 2 pp 45—64.

S. Carberry, L. Lambert, and L. Schroeder (2002), "Toward recognizing and conveying an attitude of doubt via natural language." Applied Artificial Intelligence, 16(7), pp. 495-517.

Week 11: Robot teams

H. Jones & P. Hinds (2002), "Extreme Work Teams: using SWAT teams as a model for coordinating distributed robots". In Proceedings of CSCW 2002.

P. Stone & M. Veloso (1999), "Task Decomposition, Dynamic Role Assignment, and Low-Bandwidth Communication for Real-Time Strategic Teamwork." Artificial Intelligence, 110(2), pp 241-273.

M. Veloso, P. Stone & M. Bowling (1998) "Anticipation: A Key for Collaboration in a Team of Agents." In Proceedings of the third international conference on autonomous agents.

Week 12: Human computer/robot collaboration

C. Rich, C. Sidner and N. Lesh (2001) "Collagen: Applying Collaborative Discourse Theory to Human-Computer Interaction." AI Magazine. Winter 2001. pp 15-25

J. Rickel, N. Lesh, C. Rich, C. Sidner, and A. Gertner (2002), "Collaborative Discourse Theory as a Foundation for Tutorial Dialog." In Proceedings of the 6th International Conference on Intelligent Tutoring Systems. Springer Verlag, pp 512-551.

H. Jones & S. Rock (2002), "Dialog-based human-robot interaction for space construction teams." In Proceedings of IEEE Aerospace Conference proceedings, Big Sky, MT.

Week 13: Student presentations of term projects