arthew0

← back

Colors

Colors — forms, computervision, audiovisual, openframeworks, python, unrealengine

year
2021—2024
type
series
tools
Unreal Engine, OpenCV, Python, TouchDesigner
role
author
description
Meta-project: colour perception after Kandinsky — palette layers, flow maps and machine-vision studies of Deepened Impulse.

Series of works on Kandinsky’s ideas of form and colour perception, mainly from Concerning the Spiritual in Art.


Theory

Colors: flowcv table1 — forms, computervision, audiovisual, openframeworks, python, unrealengine Colors: flowcv table2 — forms, computervision, audiovisual, openframeworks, python, unrealengine

Notes on colour motion in perception.

Second kind of motion: yellow and blue… If one draws two circles of equal size and paints one yellow and the other blue, after a short focus the yellow circle radiates, moves from the centre and almost visibly approaches the viewer, while the blue circle gains a concentric motion and recedes.

More in Concerning the Spiritual in Art.

Machine-vision analysis of paintings

Colors: dep — forms, computervision, audiovisual, openframeworks, python, unrealengine

Colors: photo 2021 05 05 15.34.49 — forms, computervision, audiovisual, openframeworks, python, unrealengine

Colors: photo 2021 05 05 15.34.44 — forms, computervision, audiovisual, openframeworks, python, unrealengine

Contour analysis

A non-trivial task — and Kandinsky’s writings still feel relevant. OpenCV-style tools can estimate motion directions (demo), but they follow edges inside the image; colour motion is not obtained that way.

Colors: texture flow demo 01 — forms, computervision, audiovisual, openframeworks, python, unrealengine Colors: texture flow demo 03 — forms, computervision, audiovisual, openframeworks, python, unrealengine Colors: flow map wrong — forms, computervision, audiovisual, openframeworks, python, unrealengine

Extracting the main palette

Colors: dep — forms, computervision, audiovisual, openframeworks, python, unrealengine Colors: 0 — forms, computervision, audiovisual, openframeworks, python, unrealengine

Split the painting into layers so each colour has its own dynamics. Classify the palette so human-perception rules can drive motion (yellow outward, blue inward, …). For each of ~7 colours, build a region in the FlowMap.

Colors: flow cv layers — forms, computervision, audiovisual, openframeworks, python, unrealengine

Direction map

Colors: 5 1 — forms, computervision, audiovisual, openframeworks, python, unrealengine Colors: 5 2 — forms, computervision, audiovisual, openframeworks, python, unrealengine Colors: 5 3 — forms, computervision, audiovisual, openframeworks, python, unrealengine Colors: flowmap impulser — forms, computervision, audiovisual, openframeworks, python, unrealengine

Motion vectors look right

Colors: flow map good — forms, computervision, audiovisual, openframeworks, python, unrealengine

Applying the map

Flow of «Deepened Impulse» — no colour
Based on a fragment of Kandinsky’s Deepened Impulse

Working with colour

Flow of «Deepened Impulse» — colour
Based on a fragment of Kandinsky’s Deepened Impulse