guidelines
1 Introduction In this document, we explain relevance rating guidelines for video search on Apple TV. If you are not familiar with the Apple TV app, please refer to https://www.apple.com/apple-tv-app/ for an overview and basic information about this app. 1.1 The importance of your work as a Rater Each of the judgements you complete will be used to build and improve artificial intelligence systems such as search algorithms and machine learned rankers that power the user experience for Apple TV users. Your attention to detail, research and language skills as well as your cultural knowledge of the market are all critical to the success of our projects. Your judgements should represent those of an Apple TV user who is using the Search feature. Ask yourself if you would be content with the results returned for a particular search query. Is there a significant relationship between the query and content returned? Would you be content if you see this content appea...