concept annotation task in category machine learning

This is an excerpt from Manning's book Human-in-the-Loop Machine Learning MEAP V09. Login to get full access to this book.

Try to keep all the components of an annotation task on the screen so that annotators don’t have to scroll. Also, try to keep all the elements (instructions, input fields, item being annotated) in the same place for each annotation. If your items come in very different sizes, then use tables and columns and other layout choices to make sure that the input fields and the item don’t move around or become lost when different sizes are present.

Figure 11.3: An example of ”tab order”, showing the order in which hitting “tab” will change the focus from one element to the next in the example interface from Figure 11.1. There are nine “clickable” elements in this interface that would be part of the default order of focus for web-based interfaces. But only four of these elements are input fields for the annotation task, so the task could be improved by explicitly defining the tab order.