Swiss Chemical Company

Developing multi-modal tool to enable transformation of image or text description into an fully-fledged perfume

Challenge

• Complexity of developing tool with very little labelled data and to handle the fuzzy nature of of matching images and text to perfumes

Solution

• Used pre-trained transformer models to understand text and images
• Produced semantic joint embedding to link text and images to perfume descriptors
• Generative models either created a new perfume or suggested a matching one from existing range

Business impact

• Tool was a POC and achieved its aim of showing the feasibility of such an approach
• Showed to the C-level management and founders of company which praised the tool
• Stepping stone for potential future project building on this initial POC