CAPFF: A Context-Aware Assistant for Paper Form Filling

Abstract

This paper introduces a context-aware system, named CAPFF, for helping people in filling paper forms, mainly in two contexts: 1) people have no idea of what should be filled in certain form fields; 2) people are not aware of the mistakes they are likely to commit in entering information, which may violate data entry constraints. In the offline phase, CAPFF provides a tool to build the knowledge about a given form, and such knowledge includes instructions, field-level examples, and constraints among form fields. In the online phase, when people set out to fill a paper form, the video camera of the system determines the position of the pen and then provides assistance, based on the user's form filling context. We evaluated CAPFF's performance through 450 paper form filling activities, and the results show that the proposed CAPFF is effective in terms of both accuracy and response time.