7

7 Embedding Analysis and Design A representative of SeTTY Images Inc. reaches out to you about their latest project. They acquired a set of images and annotated, some of them with additional attributes such as related Wikidata concepts, location, photographer, etc. Their goal is to provide a search service through which their clients can query some attribute to find related images. They consult you as an embedding expert to check if an embedding-based approach would be viable and to devise such a system. What are the benefits of an embedding-based approach over a database-query-based solution? 3.0p a 8.Op b Describe an embedding-based search system for the given task. How would you represent their data, what exactly would you embed, which embedding model(s) would you use? Justify your answers and explain your rationale if you create a new embedding model or adapt an existing one. 4.Op How does your system answer a search query consisting of an attribute ("tag") and a value ("Zurich" or "wd:Q72")? 5.Op d After a while SeTTY Images collected ratings for some of their images (integers from 1 to 10). How would you predict ratings for the remaining images using the system you already set up