Robotic Painting using Semantic Image Abstraction

Tools

Stroh, Michael; Paetzold, Patrick; Berio, Daniel; Leymarie, Frederic Fol; Kehlbeck, Rebecca and Deussen, Oliver. 2025. 'Robotic Painting using Semantic Image Abstraction'. In: ACM/EG Expressive Symposium - WICED: Eurographics Workshop on Intelligent Cinematography and Editing - Artworks, Posters, Demos. London, United Kingdom 11 - 12 May 2025. [Conference or Workshop Item]

Preview

Text
exw20251070.pdf - Published Version
Available under License Creative Commons Attribution.
Download (5MB) | Preview

Official URL: https://expressive.graphics/2025/

Abstract or Description

We present a novel image segmentation and abstraction pipeline tailored to robot painting applications. We address the unique challenges of realizing digital abstractions as physical artistic renderings. Our approach generates adaptive, semantics-based abstractions that balance aesthetic appeal, structural coherence, and practical constraints inherent to robotic systems. By integrating panoptic segmentation with color-based over-segmentation, we partition images into meaningful regions corresponding to semantic objects while providing customizable abstraction levels we optimize for robotic realization. We employ saliency maps and color difference metrics to support automatic parameter selection to guide a merging process that detects and preserves critical object boundaries while simplifying less salient areas. Graph-based community detection further refines the abstraction by grouping regions based on local connectivity and semantic coherence. These abstractions enable robotic systems to create paintings on real canvases with a controlled level of detail and abstraction.

Item Type:

Conference or Workshop Item (Paper)

Identification Number (DOI):

https://doi.org/10.2312/exw.20251070