IBM Cloud Docs
Troubleshooting the ground truth editor

Troubleshooting the ground truth editor

Find out what to do if you have questions or need help. Where to go for help depends on the type of issue you are having.

Access issues

  • If you cannot access the Knowledge Studio instance, then work with the workspace owner to ensure that he has invited you to join the workspace.
  • If you can get to the Knowledge Studio instance, but do not see any workspaces listed, then work with the administrator or manager of the workspace to resolve the issue. The administrator, which is a person with the Admin role, or manager, which is a person with the Project Manager role in Knowledge Studio, must 1.) associate you with an annotation set and 2.) create a task that assigns you to annotate the documents in the set. You will not see the workspace listed on the Knowledge Studio home page until someone has performed these actions.

Using the ground truth editor

First, review the information in Annotating documents. If you still have questions about how to use the ground truth editor, check one of the developer communities, which are linked to from the bottom of the table of contents. If you can't find the answer to your question, post the question yourself.

Annotation decisions

Can't decide which entity type to assign to an ambiguous term?

  • If the workspace has annotation guidelines, refer to them. The purpose of the guideline is to help you answer just such types of questions. If you know there are guidelines but cannot find them, then ask the workspace administrator to add a link to the annotation guidelines from the ground truth editor. If there is no guideline, consider starting one. The first entry can address the question you are debating now, and can describe the resolution that you come to. This entry will save time for the next human annotator who stumbles upon the same issue.
  • Discuss the question with other human annotators involved in the workspace, and try to decide together on the optimal solution. This type of discussion is expected and beneficial to the workspace overall. It will encourage you to all follow the same methodology as you annotate the documents.

Related information