Augmented Reality (AR) gains increased attention as a
means to provide assistance for different human activities.
Hereby the suitability of AR does not only depend on the
respective task, but also to a high degree on the respective
device. In a standardized assembly task, we tested
AR-based in-situ assistance against conventional pictorial
instructions using a smartphone, Microsoft HoloLens and
Epson Moverio BT-200 smart glasses as well as paper-based
instructions. Participants solved the task fastest using the
paper instructions, but made less errors with AR assistance
on the Microsoft HoloLens smart glasses than with
any other system. Methodically we propose operational
definitions of time segments and other optimizations for
standardized benchmarking of AR assembly instructions.