SemanticCollage: Enriching Digital Mood Board Design with Semantic Labels

DIS 2020

Janin Koch^a   Nicolas Taffin^b   Andrés Lucero^a   Wendy E. Mackay^b

^a Aalto University, Finland  ^bUniversité Paris-Saclay, Inria, CNRS, France

Abstract

---

Designers create inspirational mood boards to express their design ideas visually, through collages of images and text. They find appropriate images and reflect on them as they explore emergent design concepts. After presenting the results of a participatory design workshop and a survey of professional designers, we introduce SemanticCollage, a digital mood board tool that attaches semantic labels to images by applying a state-of-the-art semantic labeling algorithm.
SemanticCollage helps designers to 1) translate vague, visual ideas into search terms; 2) make better sense of and communicate their designs; while 3) not disrupting their creative flow. A structured observation with 12 professional designers demonstrated how semantic labels help designers successfully guide image search and find relevant words that articulate their abstract, visual ideas. We conclude by discussing how SemanticCollage inspires new uses of semantic labels for supporting creative practice.

Materials

---

You can find and use the Code on Github

Here is the submitted video companion:

Publication

---

BibTeX:
@inproceedings{SemanticCollage,
title={SemanticCollage: Enriching Digital Mood Board Design with Semantic Labels},
author={Koch, Janin and Taffin, Nicolas and Lucero, Andr{\'e}s and Mackay, Wendy},
booktitle={Proceedings of the Designing Interactive Systems Conference 2020 (DIS '20)}, year={2020}, organization={ACM} }

Contact

---

For questions and further information, please contact: Janin Koch.