Augmented Reality as a Design Tool for Maintenance Applications

N. Zenati(1*), N. Zerhouni(2)

(1) Development Centre of Advanced Technology, Algeria
(2) Laboratoire d'Automatique de Besançon UMR CNRS 6596, France
(*) Corresponding author

DOI's assignment:
the author of the article can submit here a request for assignment of a DOI number to this resource!
Cost of the service: euros 10,00 (for a DOI)


One of the main weaknesses with traditional computing is the fact that the numerical world of the computer is decoupled from the user’s real world. The application of Augmented Reality (AR) can provide interactive systems in which real objects and computer data are combined in a cohesive way. This new paradigm has many potential applications in various fields, in particular in the maintenance domain. It allows the user to see computer generated virtual objects superimposed to the real world through the see-through Head Mounted Display (HMD). The technician of maintenance, when using this system, can interact with the virtual world and have additional information, such as instruction for performing maintenance tasks in form of text messages, images, 3-D models of pieces or audio such as speech instruction. In this paper, we propose a design process of the maintenance system focused on the analysis of the interaction between the user, the system and the real world. This area is based on the UML notation. The use of UML represents our ergonomic and software design process basis for AR systems. This process also is based on ergonomic characteristics study within a UML system description and on the hybrid PAC-Amodeus model architecture adaptation for the AR systems.
Copyright © 2017 Praise Worthy Prize - All rights reserved.


Augmented Reality; Maintenance; Human-Computer-Interaction; V-Model; PAC-Amodeus Architecture

Full Text:



R T. Azuma., A Survey of Augmented Reality, Dans la revue Presence: Teleoperators and Virtual Environments, Vol.4, pp. 355-385, 1997.

W.E.Mackay, Augmented Reality: Linking real and virtual worlds - A new paradigm for interacting with computers, In Proceedings of AVI’98, ACM Conference on Advanced Visual Interfaces, l'Aquila, Italy, New York: ACM Press, 1998. Available from Internet:

U. Bockholt, A. Bisler, M. Becker, W. Muller-Wittig, and G. Voss, Augmented Reality for Enhancement of Endoscopic Interventions, In Proc. of IEEE Virtual Reality, March 2003, pp. 97–101.

B.Schwald, and all, STARMATE: Using Augmented Reality technology for computer guided maintenance of complex mechanical elements, e2001 Conference, Venice-Italy, October 2001, pp.17-19.

B. Schwald & B. de Laval, Training and Assistance to Maintenance in an augmented Reality environment, Proceedings of the 10th International Conference on Human-Computer Interaction, Vol.3 Cognitive, Social and Ergonomic Aspects Mahwah, New Jersey: Lawrence Erlbaum, 2003, pp. 1121-1125.

B.Schwald, & Laval, An Augmented Reality System for Training and Assistance to Maintenance in the Industrial Context, Journal of WSCG’2003, pp. 425-432, 2003.

H.Thomas, W.Piekarski and B.Gunther, Using augmented reality to visualize architecture designs in an outdoor environment, International Journal of Design Computing Special Issue on Design Computing on the Net (DCNet), Vol.2, 2000.

D.Drascic, Streoscopic vision and augmented reality, Scientific computing & Automation, pp. 31-34, Juin1993.

Z.Szalavari, E.Eckstein, M.Gervautz, Collaborative Gaming in Augmented Reality, Acte du symposium Virtual Reality Software and Technology, pp. 195-204, 1998.

P. Fuchs, G. Moreau, B. Arnaldi, J.M. Burkhardt, A. Chauffaut, S. Coquillart, S. Donikian, T. Duval, J. Grosjean, F. Harrouet, E. Klinger, D. Lourdeaux, D. Mellet d'Huart, A. Paljic, J. P. Papin, P. Stergiopoulos, J. Tisseau, I. Viaud-Delmon, Le Traité de la réalité virtuelle, deuxième édition, (Les Presses de l’Ecole des Mines de Paris, deuxième édition, 2 volumes, ISBN 2-911762-47-9 et 2-911762-48-7, 915 pages, 2003).

W. Curtis, D. Mizell, P. Gruenbaum, and A. Janin, Several devils in the details Making an ar application work in the airplane factory, In First IEEE International Workshop on Augmented Reality, Bellevue, Washington, 1999, pp. 47–60.

G. Baratoff and H. Regenbrecht. Developing and applying ar technology in design, production, service, and training. In Augmented and Virtual Reality in Manufacturing, pp.207–236, London, UK, 2004.

J. Kustaborder and R. Sharma. Experimental evaluation of augmented reality for assembly training. In Proceeding of the 2nd IEEE International Workshop on Augmented Reality, San Francisco, USA, 1999.

N. Navab, Industrial augmented reality(iar): Challenges in design and commercialization of killer apps. In IEEE International Symposium on Mixed and Augmented Reality, pp.2–6, Tokyo, Japan, 2003.

L. Nigay, et J. Coutaz, Software architecture modelling: Bridging Two Worlds using Ergonomics and Software Properties, Formal Methods in Human-Computer Interaction, (Ed), Palanque et Paterno, (Springer Verlag, 1997, 49-73).

S. Feiner, B MacIntyre, D Seligmann. Knowledge-Based Augmented Reality, Communication de l’ACM n°7, 1993, pp. 53-61.

D.Reiners, D.Stricker, G.Klinker, S.Muller, Augmented Reality for Construction Tasks: Doorlock Assembly, The 1st International Workshop on Augmented Reality (IWAR’98), San Francisco, Nov. 1998, pp. 31-46.

Alt, T., Edelmann, M., et al. Augmented Reality for Industrial Applications – A New Approach to Increase Productivity. Proceedings of the 6th International Scientific Conference on Work With Display Units, 2002.

B.Schwald, Laval, An Augmented Reality System for Training and Assistance to Maintenance in the Industrial Context, Journal of WSCG, Vol. 11, No. 3, 2003, pp. 425-432.

G.Klinker, O.Creighton, A.H.Dutoit, R.Kobylinski, C.Vilsmeier, B.Brugge, Augmented Maintenance of Powerplants: A Prototyping case study of a mobile AR system, IEEE and ACM International Symposium on Augmented Reality (ISAR'01) October 29 - 30, 2001, New York, pp. 124-137

S.Goose, S.Guven, X.Zhang, S.Sudarsky, N.Navab, Mobile 3D Visualization an Interaction in an Industrial Environment. In Stephanidis C. (Eds), Universal Access in HCI, Inclusive Design in the Information Society, Proc. of HCI International, 22-27 June 2003, Crete, Greece, London : Lawrence Erlbaum Associates, 2003, vol. 4, pp. 379-383.

J.-Y. Didier, D. Roussel, M. Mallem, S. Otmane, S. Naudet, Q.-C. Pham, S. Bourgeois, C. Mégard, C. Leroux, et A. Hocquard. Amra : Augmented reality assistance in train maintenance tasks. Dans Workshop on Industrial Augmented Reality (ISMAR’05), Vienne, Autriche.

L. Nigay, Conception et modélisation logicielles des systèmes interactifs : application aux interfaces multimodales, thèse de doctorat en informatique, Grenoble, 1994.

W. Royce, Managing the development of large software systems, Actes de la conférence IEEE Western Electronic Show Convention (WESTCON), 1970, pp. 1-9).

B. Boehm, Software Engineering Economics, (Prentice-Hall, 767 pages, 1981).

J. McDermid, K. Ripkin, Life Cycle Support in the ADA environment, (Cambridge University Press, 259 pages, 1984).

C. Gram, G. Cockton, Design Principles for Interactive Software, (Chapman & Hall, 248 pages, 1996).

M.Green, Report on Dialogue Specification Tools, Journal, User Interface Management Systems (UIMS), Eurographics Seminars, (Springer-Verlag, 1985, pp. 9-20).

L. Bass, R. Faneuf, R. Little, N. Mayer, B. Pellegrino, S. Reed, R. Seacord, S. Sheppard, et M. Szczur, A Metamodel for the Runtime Architecture of an Interactive System, Journal, ACM Special Interest Group Computer-Human Interface, Vol.24, n°1, pp.32-37, 1992.

G. Krasner, et S. Pope, A Cookbook for Using the Model-View-Controller User Interface Paradigm in Smalltalk-80, Journal of Object Oriented Programming (JOOP), Vol.1, n° 3, pp.26-49., 1988.

J. Coutaz, L. Nigay, D. Salber, Agent-Based Architecture Modelling for Interactive Systems, in: P. Palanque, D. Benyon (Eds.), Critical Issues in User Interface Engineering, (Springer-Verlag, London, 1995, 191-209).

J. Coutaz, PAC, an Object Oriented Model for Dialog Design, in: H.-J. Bullinger, B. Shackel (eds.), Human-Computer Interaction – INTERACT’87, (Elsevier Science Publishers BV, 1987, 431-436).


  • There are currently no refbacks.

Please send any question about this web site to
Copyright © 2005-2019 Praise Worthy Prize