D-Note: Computer-Aided Digital Note Taking System on Physical Book

It is convenient for people to take notes directly on book pages while reading. But for public books, such as those borrowed from library, direct marking is inappropriate and forbidden. To solve this problem, we propose D-Note, a new computer-aided digital note taking system. D-note registers and distinguishes book page according to its visual features. It recognizes hand interactions on page with a depth image from Kinect. Meanwhile it gets user operation intentions by speech recognition and dynamically creates a page-related digital note. The experiments and user study show that D-note is a worthwhile way to protect books and a good reading assist.