Paul Mc Kevitt

Although there has been much progress in developing theories, models and systems in the areas of Natural Language Processing (NLP) and Vision Processing (VP) there has up to now been little progress on integrating these two subareas of Artificial Intelligence (AI). This book contains a set of edited papers on recent advances in the theories, computational models and systems of the integration of NLP and VP. The volume includes original work of notable researchers: Alex Waibel outlines multimodal interfaces including studies in speech, gesture and points; eye-gaze, lip motion and facial expression; hand writing, face recognition, face tracking and sound localization in a connectionist framework. Antony Cohen and John Gooday use spatial relations to describe visual languages. Naoguki Okada considers intentions of agents in visual environments. In addition to these studies, the volume includes many recent advances from North America, Europe and Asia demonstrating the fact that integration of Natural Language Processing and Vision is truly an international challenge.

Recent Advances Volume IV

Integration of Natural Language and Vision Processing

Seán Ó Nualláin

Conn Mulvihill

Language, vision and music: what common cognitive patterns underlie our competence in these disparate modes of thought? Language (natural & formal), vision and music seem to share at least the following attributes: a hierarchical organisation of constituents, recursivity, metaphor, the possibility of self-reference, ambiguity, and systematicity. Can we propose the existence of a general symbol system with instantiations in these three modes or is the only commonality to be found at the level of such entities as cerebral columnar automata? Answers are to be found in this international collection of work which recognises that one of the basic features of consciousness is its MultiModality, that there are possibilities to model this with contemporary technology, and that cross-cultural commonalities in the experience of, and creativity within, the various modalities are significant. With the advent of Intelligent MultiMedia this aspect of consciousness implementation in mind/brain acquires new significance. (Series B)

Selected Papers from the 8th International Workshop on the Cognitive Science of Natural Language Processing, Galway, Ireland, 1999

Language, Vision, and Music

Peter Norvig

Stephen J. Hegner

In this international collection of papers there is a wealth of knowledge on artificial intelligence (AI) and cognitive science (CS) techniques applied to the problem of providing help systems mainly for the UNIX operating system. The research described here involves the representation of technical computer concepts, but also the representation of how users conceptualise such concepts. The collection looks at computational models and systems such as UC, Yucca, and OSCON programmed in languages such as Lisp, Prolog, OPS-5, and C which have been developed to provide UNIX help. These systems range from being menu-based to ones with natural language interfaces, some providing active help, intervening when they believe the user to have misconceptions, and some based on empirical studies of what users actually do while using UNIX. Further papers investigate planning and knowledge representation where the focus is on discovering what the user wants to do, and figuring out a way to do it, as well as representing the knowledge needed to do so.

Intelligent Help Systems for UNIX

Robert L. Wilensky

In this international collection of papers there is a wealth of knowledge on artificial intelligence (AI) and cognitive science (CS) techniques applied to the problem of providing help systems mainly for the UNIX operating system. The research described here involves the representation of technical computer concepts, but also the representation of how users conceptualise such concepts. The collection looks at computational models and systems such as UC, Yucca, and OSCON programmed in languages such as Lisp, Prolog, OPS-5, and C which have been developed to provide UNIX help. These systems range from being menu-based to ones with natural language interfaces, some providing active help, intervening when they believe the user to have misconceptions, and some based on empirical studies of what users actually do while using UNIX. Further papers investigate planning and knowledge representation where the focus is on discovering what the user wants to do, and figuring out a way to do it, as well as representing the knowledge needed to do so. There is a significant focus on natural language dialogue where consultation systems can become active, incorporating user modfelling, natural language generation and plan recognition, modelling metaphors, and users' mistaken beliefs. Much can be learned from seeing how AI and CS techniques can be investigated in depth while being applied to a real test-bed domain such as help on UNIX.

Paul Mc Kevitt

Books

Your next favorite book is out there