Automatic generation of the mid-fidelity prototype based on hand-drawn sketch

Abstract:

Generating digital mid-fidelity prototypes from hand-drawn sketches is a necessary step in User Interface design, which requires a lot of time and energy for designers. In order to solve the problem, this paper proposes an automatic method for generating mid-fidelity prototypes based on object detection and heuristic rules, and implements an automatic tool based on this method. Firstly, an object detection model SA-FRCNN based on the Shuffle Attention (SA) mechanism is proposed to detect components in hand-drawn sketches; and then, heuristic rules are proposed to optimize the layout of the detected results. Experiments show that our method can improve the detection accuracy of hand-drawn sketches by 2.3% compared with the baseline model; in addition, our tool can effectively improve the efficiency of prototyping.