CALO

CALO is an artificial intelligence project that attempts to integrate numerous AI technologies into an assistant that learns to help manage your office environment.

Overview

CALO is one of the most ambitious artificial intelligence projects in US history. Funded by the Defense Advanced Research Projects Agency (DARPA) under its [http://www.darpa.mil/ipto/programs/pal/vision.htm Personalized Assistant that Learns] program, this five-year contract brings together 300+ researchers from 25 of the top university and commercial research institutions, with the goal of building a new generation of cognitive assistants that can reason, learn from experience, be told what to do, explain what they are doing, reflect on their experience, and respond robustly to surprise. SRI International is the lead integrator responsible for coordinating the effort to produce an assistant that can live with and learn from its users, provide value to them, and then pass a yearly evaluation that measures how well the system has learned to do its job.

CALO is an acronym for "Cognitive Assistant that Learns and Organizes". The name was inspired by the Latin word "calonis," which means "soldier’s servant", a reference to Radar O'Reilly in the MASH TV series.

CALO Functions

CALO assists its user with six high-level functions:

# "Organizing and Prioritizing Information": As the user works with email, appointments, web pages, files, and so forth, CALO uses machine learning algorithms to build a queryable model of who works on which projects, what role they play, how important they are, how documents and deliverables are related to this, etc.
# "Preparing Information Artifacts": CALO can help its user put together new documents such as PowerPoint presentations, leveraging learning about structure and content from previous documents accessed in the past.
# "Mediating Human Communications": CALO provides assistance as its user interacts with other people, both in electronic forums (e.g. email) and in physical meetings. If given access to participate in a meeting, CALO automatically generates a meeting transcript, tracks action item assignments, detects roles of participants, and so forth. CALO can also put together a "PrepPak" for a meeting containing information to read ahead of time or have at your fingertips as the meeting progresses.
# "Task Management": CALO can automate routine tasks for you (e.g. travel authorizations), and can be taught new procedures and task by observing and interacting with the user.
# "Scheduling and Reasoning in Time": CALO can learn your preferences for when you need things done by, and help you manage your busy schedule.
# "Resource allocation": As part of Task management, CALO can learn to acquire new resources (electronic services and real-world people) to help get a job done.

CALO Evaluation

Every year, the CALO system, after living with its user for a period of time, is given an achievement-style test of 153 "administration assistant" questions, primarily focused on what it has learned about the user's life. Evaluators measure how well CALO's performance on these questions improves year-over-year, and how much of CALO's performance is due to "learning in the wild" (new knowledge, tasks, and inferences it has been able to acquire on its own, as opposed to function or knowledge hard-wired into the system by a developer).

References

In the first four years of the project, CALO-funded research has resulted in more than five hundred publications across all fields of artificial intelligence. Here are several:

* "A* Based Joint Segmentation and Classification of Dialog Acts in Multiparty Meetings", Matthias Zimmermann, Yang Liu, Elizabeth Shriberg, and Andreas Stolcke. Proceedings of the IEEE Speech Recognition and Understanding Workshop, Cancun, 2005. [http://www.calosystem.org/publications/abasedjointsegment.html]

* "Active Preference Learning for Personalized Calendar Scheduling Assistance", Melinda T. Gervasio, Michael D. Moffitt, Martha E. Pollack, Joseph M. Taylor, and Tomas E. Uribe. Proceedings of the 2005 International Conference on Intelligent User Interfaces, 2005. [http://www.calosystem.org/publications/activepreflearning.html]

* "Activity recognition and abnormality detection with the switching hidden semi-Markov model", T. Duong, H. Bui, D. Phung, and S. Vekatesh. IEEE International Conference on Computer Vision and Pattern Recognition, 2005. [http://www.calosystem.org/publications/activityrecognition.html]

* "Analysis of Privacy Loss in Distributed Constraint Optimization", Rachel Greenstadt, Jonathan P. Pearce and Milind Tambe. Copyright 2006, American Association for Artificial Intelligence. [http://www.calosystem.org/publications/analysisprivacyloss.html]

* "Asimovian Multiagents: Applying Laws of Robotics to Teams of Humans and Agents", Nathan Schurr, Pradeep Varakantham, Emma Bowring, Milind Tambe, and Barbara Grosz. [http://www.calosystem.org/publications/asimovianmultiagents.html]

* "Balancing Formal and Practical Concerns in Agent Design", David Morley and Karen Myers. Proceedings of AAAI Workshop on Intelligent Agent Architectures: Combining the Strengths of Software Engineering and Cognitive Systems, 2004. [http://www.calosystem.org/publications/balancingformal.html]

* "Bibliometric Impact Measures Leveraging Topic Analysis", Gideon S. Mann, David Mimno, and Andrew McCallum. JCDL’06, June 11–15, 2006, Chapel Hill, North Carolina, USA. [http://www.calosystem.org/publications/bibliometricimpact.html]

* "Building an Intelligent Personal Assistant", Karen Myers. AAAI Invited Talk, July 2006. [http://www.calosystem.org/publications/buildingintelligent.html]

* "Can Modeling Redundancy In Multimodal, Multi-party Tasks Support Dynamic Learning?" Edward C. Kaiser. CHI 2005 Workshop: CHI Virtuality 2005, Portland, OR., USA, April 3, 2005. [http://www.calosystem.org/publications/canmodelingredundancy.html]

* "A Case Study in Engineering a Knowledge Base for an Intelligent Personal Assistant", Vinay K. Chaudhri, Adam Cheyer, Richard Guili, Bill Jarrold, Karen Myers, and John Niekarasz. Technical Report. SRI International, 2006. [http://www.calosystem.org/publications/casestudyengineering.html]

* "A Cognitive Framework for Delegation to an Assistive User Agent", K. Myers and N. Yorke-Smith. Proceedings of AAAI 2005 Fall Symposium on Mixed-Initiative Problem Solving Assistants, Arlington, VA, November 2005. [http://www.calosystem.org/publications/cognitiveframework.html]

* "Collective Multi-Label Classification", Nadia Ghamrawi and Andrew McCallum. CIKM’05, Bremen, Germany. [http://www.calosystem.org/publications/collectivemultilabel.html]

* "Composition of Conditional Random Fields for Transfer Learning", Charles Sutton and Andrew McCallum. Proceedings of HLT/EMNLP, 2005. [http://www.calosystem.org/publications/compofconditional.html]

* "Deploying a Personalized Time Management Agent", P. Berry, K. Conley, M. Gervasio, B. Peintner, T. Uribe, and N. Yorke-Smith. Proceedings of the Fifth International Joint Conference on Autonomous Agents and Multi Agent Systems (AAMAS’06) Industrial Track, Hakodate, Japan, May 2006. [http://www.calosystem.org/publications/deployingpersonalized.html]

* "Design and Implementation of the CALO Query Manager", Jose-Luis Ambite, Vinay K. Chaudhri, Richard Fikes, Jessica Jenkins, Sunil Mishra, Maria Muslea, Tomas Uribe, Guizhen Yang. Innovative Applications of Artificial Intelligence, July 2006. [http://www.calosystem.org/publications/designandimplement.html]

* "Fewer Clicks and Less Frustration: Reducing the Cost of Reaching the Right Folder", X. Bao, J.Herlocker, and T. Dietterich. 2006 International Conference on Intelligent User Interfaces. 178-185. Sydney, Australia. [http://www.calosystem.org/publications/fewerclicks.html]

* "Group and Topic Discovery from Relations and Text", Xuerui Wang, Natasha Mohanty, and Andrew McCallum. LinkKDD2005 August 21, 2005, Chicago, Illinois, USA. [http://www.calosystem.org/publications/grouptopicdiscovery.html]

* "Hierarchical Hidden Markov Models with General State Hierarchy", H. Bui, D. Phung, and S. Venkatesh. Proceedings of AAAI, 2004. [http://www.calosystem.org/publications/hierarchhiddenmarkov.html]

* "A Hybrid Learning System for Recognizing User Tasks from Desktop Activities and Email Messages", J. Shen, L. Li, T. Dietterich, and J. Herlocker. 2006 International Conference on Intelligent User Interfaces, 86-92. Sydney, Australia. [http://www.calosystem.org/publications/hybridlearning.html]

* "IRIS: Integrate. Relate. Infer. Share." Adam Cheyer, Jack Park, and Richard Giuli. Workshop on The Semantic Desktop - Next Generation Personal Information Management and Collaboration Infrastructure at the International Semantic Web Conference (ISWC2005). 6 November 2005, Galway, Ireland. [http://www.calosystem.org/publications/irisintegrate.html]

* "More Than Words Can Say: Using Prosody to Find Sentence Boundaries in Speech", Y. Liu and E. Shriberg (2006). 4th ASA/ASJ Joint Meeting Lay Language Papers. Popular version of paper IaSC2, 4th ASA/ASJ Joint Meeting, Honolulu, HI. [http://www.calosystem.org/publications/morethanwords.html]

* "Multi-Conditional Learning: Generative/Discriminative Training for Clustering and Classification", Andrew McCallum, Chris Pal, Greg Druck, and Xuerui Wang. AAAI, 2006. [http://www.calosystem.org/publications/multicondlearning.html]

* "Multi-Criteria Evaluation in User-Centric Distributed Scheduling Agents", P.M. Berry, M. Gervasio, B. Peintner, T. Uribe, and N. Yorke-Smith. AAAI Spring Symposium on Distributed Plan and Schedule Management, Mar 2006. [http://www.calosystem.org/publications/multicritieriaeval.html]

* "Online Query Relaxation via Bayesian Causal Structures Discovery", Ion Muslea and Thomas J. Lee. Proceedings of the Twentieth National Conference on Artificial Intelligence (AAAI 2005), Pittsburgh, Pennsylvania, 2005. [http://www.calosystem.org/publications/onlinequeryrelax.html]

* "Populating the Semantic Web", Kristina Lerman, Cenk Gazen, Steven Minton, and Craig A. Knoblock. Proceedings of the AAAI 2004 Workshop on Advances in Text Extraction and Mining, 2004. [http://www.calosystem.org/publications/populatingsemanticweb.html]

* "A Portable Process Language", Peter E. Clark, David Morley, Vinay K. Chaudhri, and Karen L. Myers. In Workshop on the Role of Ontologies in Planning and Scheduling, Monterey, CA; June 7, 2005. [http://www.calosystem.org/publications/portableprocess.html]

* "A Probabilistic Model of Redundancy in Information Extraction", D. Downey, O. Etzioni, and S. Soderland. [http://www.calosystem.org/publications/probabilisticmodel.html]

* "Recovery from Interruptions: Knowledge Workers? Strategies, Failures and Envisioned Solutions", Simone Stumpf, Margaret Burnett, Thomas G. Dietterich, Kevin Johnsrude, Jonathan Herlocker, and Vidya Rajaram. Institution: Oregon State University Corvallis, OR [http://www.calosystem.org/publications/recoveryfrominterruptions.html]

* "Semi-Supervised Text Classification Using EM", Kamal Nigam, Andrew McCallum, and Tom M. Mitchell. [http://www.calosystem.org/publications/semisupervisedtext.html]

* "Skeletons in the Parser: Using Shallow Parsing to Improve Deep Parsing", M. Swift, J. Allen, and D. Gildea. [http://www.calosystem.org/publications/skeletonsinparser.html]

* "The SPARK Agent Framework", David Morley and, Karen Myers. Proceedings of the Third Int. Joint Conf. on Autonomous Agents and Multi-Agent Systems (AAMAS-04), New York, NY, pp. 712-719, July 2004. [http://www.calosystem.org/publications/sparkagentframe.html]

* "Speaker Overlaps and ASR Errors in Meetings: Effects Before, During, and After the Overlap", Ozgur Cetin and Elizabeth Shriberg. Proceedings of the IEEE ICASSP, Toulouse, 2006 [http://www.calosystem.org/publications/speakeroverlaps.html]

* "Task Management under Change and Uncertainty: Constraint Solving Experience with the CALO Project", P. Berry, K. Myers, T. Uribe, and N. Yorke-Smith. Proceedings of CP'05 Workshop on Constraint Solving under Change and Uncertainty, Sitges, Spain, October 2005. [http://www.calosystem.org/publications/taskmanagement.html]

* "Temporal Planning with Preferences and Probabilities", R. Morris, P. Morris, Khatib, L. and N. Yorke-Smith. Proceedings of ICAPS'05 Workshop on Constraint Programming for Planning and Scheduling, Monterey, CA, June 2005. [http://www.calosystem.org/publications/temporalplannning.html]

* "To Transfer or Not to Transfer", M. T. Rosenstein, Z. Marx, L. P. Kaelbling, and T. G. Dietterich. NIPS 2005 Workshop on Transfer Learning, Whistler, BC. [http://www.calosystem.org/publications/totransferornot.html]

* "Transfer Learning with an Ensemble of Background Tasks", Z. Marx, M. T. Rosenstein, L. P. Kaelbling, and T. G. Dietterich. NIPS 2005 Workshop on Transfer Learning, Whistler, BC. [http://www.calosystem.org/publications/transferlearningensemble.html]

External links

* [http://www.calosystem.org/ CALO Project Homepage]
* [http://www.darpa.mil/ipto/programs/pal/pal.asp DARPA PAL Program]
* [http://www.cra.org/CRN/articles/nov02/darpa.html DARPA's Cognitive System Vision]