Image 3 Image 3 Image 3 Image 3 Image 3

QUANTIFYING MOVEMENTS

In this experiment, I used an accelerometer sensor connected to an arduino to collect data from movements and convert them into RGB pixel values to create images. The objective of this experiment is inspired by my previous experiment, which is to quantify something that cannot be quantified, which in this case, is our movements and interactions (memories).

To do this, I used an accelerometer sensor with the arduino and p5js to convert the collected data into pixel data, where it can create images and videos of each movement I have captured. For us these movements can be counted in moments of seconds or minutes; whereas for a computer, it can be counted as arrays of numerical data.






MOTION TO PIXELS

I recorded 5 simple movement that naturally come in our everyday movements, such as writing, reading, walking and eating, in a short period of time with the sensor on my hand. The captured movement are then converted into pixel values, presented as images and recording videos.

Hover over the image

Book Thumbnail Hover Image
Book Thumbnail Hover Image
Book Thumbnail Hover Image
Book Thumbnail Hover Image
Book Thumbnail Hover Image





Hugging

Book Thumbnail

Drawing

Book Thumbnail

Rubbing Hands

Book Thumbnail

Flipping Book

Book Thumbnail

Brushing Teeth

Book Thumbnail

VISUAL EXPLORATION 1

For this visual exploration, I tried fixing the X and Y position to create a whole image without blank spots to see what it would look like if I just compare their colors. I found the results interesting as I can see how some movements are smoother than the others by looking at the color gradients. Actions such as hugging and flipping the book has a more smoother transitions compared to actions such as brushing and rubbing.






VISUAL EXPLORATION 2

In this visual exploration, I used other images for its color values and matching it with the mapped values from the movement data. The idea behind it was to "sample my memory" using images of my childhood photos to reconstruct a new image that maybe could resemble these memories I had.

Some outcomes here are created with images I took from the internet as well for testing. I display them as well because they look visually interesting.

Although the results were quite abstract, I found this particular experiment enjoyable as it felt like I was using the sensor as more like a brush tool or like painting when interacting with the sensor.

Book Thumbnail Hover Image
Book Thumbnail Hover Image
Book Thumbnail Hover Image
Book Thumbnail Hover Image
Book Thumbnail Hover Image
Book Thumbnail Hover Image
Book Thumbnail Hover Image
Book Thumbnail Hover Image
Book Thumbnail Hover Image