![](https://csdnimg.cn/release/download_crawler_static/88890784/bg7.jpg)
Best Practices for Managing Data Annotation Projects
7
those needs. Background on the industry, user personas, and workflow should be provided. It may also be useful
for the stakeholders to create wireframes and talk to the target users directly to better understand their
expectations and desires.
Significance of the End Goal
In addition to establishing the desired functionality, stakeholders should discuss any existing alternatives and the
expected business impact of the project. Discussing current solutions to the problem being addressed will help
the stakeholders understand what can be done better, how those improvements can be achieved, and the value
of those improvements. In addition, discussing the potential business impact of the end goal will give the
stakeholders an understanding of the overall importance of the project and how that can affect the available
resources and ultimate timeline for the project.
Measuring Success
Stakeholders should agree on how to determine whether the project has been successful. For example, they
should agree on what the project’s milestones are, such as requirements for a minimum viable product.
Stakeholders should also discuss any applicable metrics, like precision and recall, that will be used for
performance evaluation. To be meaningful, metrics should always be aligned with user expectations. Making
milestones and metrics requirements explicit at the outset of the project will help manage stakeholders’
expectations and inform the design of the annotation project.
Select Methods for Regular and Clear Communication
The key stakeholders in an annotation project should agree on methods for regular and clear communication.
• Methods that work well include Scrum, Kanban or the Dynamic Systems Development Method.
• At a minimum, the stakeholders should establish a shared project roadmap, backlog of issues, and regular
meetings for the annotation project.
The annotation project manager should have the authority to manage the project roadmap and backlog, as well
as to determine meeting agendas because he or she will best understand any issues that arise.