interaction design – Matte Lim https://archive.mattelim.com Design Tech Art Mon, 29 May 2023 06:54:55 +0000 en-US hourly 1 https://wordpress.org/?v=6.2.3 https://archive.mattelim.com/wp-content/uploads/2022/04/mattelim8.png interaction design – Matte Lim https://archive.mattelim.com 32 32 Text-GPT-p5 https://archive.mattelim.com/work/text-gpt-p5/ Mon, 29 May 2023 02:14:35 +0000 https://archive.mattelim.com/?post_type=work&p=791

Text-GPT-p5 is a generative p5.js editor / REPL that takes user text prompts, turns them into p5.js code using OpenAI GPT 3.5, and immediately displays the sketch within the window.

I got into programming through Arduino and Processing. I’ve always thought about how to lower the barriers for people to start programming. With GPT, we can now turn plain text into code, allowing people to start coding without knowing code. Text-GPT-p5 takes this further by evaluating the code directly and displaying it; users can also edit the generated code and see the changes immediately.

Text-GPT-p5 is open source – please explore and create your own version: https://github.com/mattelim/text-gpt-p5-app

Text-GPT-p5 in action

]]>
Massaged Mirrors https://archive.mattelim.com/work/massaged-mirrors/ Tue, 19 Jul 2022 02:56:31 +0000 https://archive.mattelim.com/?post_type=work&p=740 Massaged Mirrors is a collection of interactive browser-based webcam artwork that investigates how digital technology mediates our self-image.

Play with it on Replit ↗

The title is a play on the intentionally misspelled title of Marshall McLuhan’s seminal book. Humans are very fascinated by our own likeness; one of the earliest fictional work about this is the Greek myth of Narcissus. The project utilizes the underlying technologies used by everyday software and popular apps (including artificial intelligence and machine learning algorithms) to consider how they shape our perception.

Improvements such as the use of better machine-learning image segmentation tools (e.g. mediapipe) are in the pipeline. More works may be developed in the future. The project is built using web technologies as well as javascript libraries like p5.js, ml5, and jQuery; it is live on Replit.

GIF animations of two “mirrors” that are powered by Machine Learning (ml5)

Find out more about my art practice on Luke Warme ↗

]]>
Pixel Pointillism https://archive.mattelim.com/work/messaged-mirrors/ Mon, 12 Apr 2021 03:16:00 +0000 https://archive.mattelim.com/?post_type=work&p=594 Pixel Pointillism is a camera-based web app about the phenomenon of optical mixing.

Pixel Pointillism is a web app that converts the user’s camera feed into eight component colors through dithering. The user can save the dithered image or download an instruction grid for making a pointillist painting of themselves.

The project started as a teaching tool for middle school students when I was a teacher at Hwa Chong Institution. The phenomenon of optical mixing is not straightforward and Pixel Pointillism helps people learn the concept by creating an artwork of themselves.

Try the app on a microsite built on Replit ↗

digital (color) → digital (characters) → physical (print dotted using markers)
the “painting” in different stages of completion

More works in the series are currently being developed.

Find out more about my art practice on Luke Warme ↗

]]>
Rush Hour https://archive.mattelim.com/work/rush-hour/ Sun, 12 Apr 2020 02:24:16 +0000 https://archive.mattelim.com/?post_type=work&p=585

Rush Hour is an interactive art installation about pace and perception. It was a collaboration with filmmaker Victor Gan.

In 2006, a study confirmed that Singaporeans are the fastest walkers on the planet.

This finding confirms Singapore’s reputation as a nation full of competitive go-getters egged on by its meritocratic system. While being faster, stronger and better seems perfectly desirable, is there an underside to this speed? How much faster can – and should – we go?

Rush Hour is an interactive installation that responds to the walking speed of the participant. The video shows working adults in the business district during rush hour, which connects our local phenomenon to larger narratives of capitalism and the global economy.

Rush Hour was exhibited at “aedge ; (semicolon)” at SOTA Gallery in 2020.

The participant steps onto a step sensor. The slow-motion video changes in real-time based on her/his steps. When s/he walks faster, the figures in the video become more blurred. When s/he stops walking, the video reverts back to clarity.

Visual Portfolio, Posts & Image Gallery for WordPress

Find out more about my art practice on Luke Warme ↗

]]>
Yara | YaraIrix https://archive.mattelim.com/work/yara-yarairix/ Fri, 12 Apr 2019 01:10:09 +0000 https://archive.mattelim.com/?post_type=work&p=574 [source]

Yara approached sparkpluck in 2019 to work on the development of Yaralrix. I am under an NDA for the project, below is an excerpt from Yara’s press release:

The YaraIrix system includes a free-to-download-app (for Android & iOS), which uses the smartphone camera to determine Nitrogen demands of different crops in early growth stages. For later growth stages, the app is supplemented by two hardware options (a smartphone clip and a Bluetooth N-Tester).

I am credited as an inventor on the patent for the project. View the patent on the European Patent Register ↗

Find out more about Yaralrix from Yara’s press release ↗

]]>
60 Second Counts https://archive.mattelim.com/work/60-second-counts/ Fri, 12 Apr 2019 00:41:15 +0000 https://archive.mattelim.com/?post_type=work&p=564

60 Second Counts is an interactive art installation about time and timing.

There are two distinct words for time in Greek: kairos and chronos. Kairos refers to a subjective time that is felt by the individual through circadian rhythms, breaths and heartbeats, whereas chronos refers to an objective time measured in hours, minutes and seconds. 60 Second Counts attempts to reconcile subjective and objective time by getting audiences to record their own “minutes”.

60 Second Counts was shown at “aedge: Time and Space” at the SOTA gallery in 2019.

The participant goes into a booth and interacts with a single button. S/he goes through a process of clicking the button sixty times to record her/his interpretation of one minute. The resulting “minute” is projected on the screen as a blinking dot, along with “minutes” by eleven other individuals. Each “minute” starts with a red dot.

Visual Portfolio, Posts & Image Gallery for WordPress

Find out more about my art practice on Luke Warme ↗

]]>
EZ-Link | Stored Value https://archive.mattelim.com/work/stored-value/ Tue, 11 Apr 2017 15:09:56 +0000 https://archive.mattelim.com/?post_type=work&p=545

Stored Value is a collaboration between sparkpluck and EZ-Link, a company that creates contactless smart cards that are used primarily for public transportation in Singapore.
Description

EZ-Link cards store not only money but also record passenger’s trips around Singapore. Stored Value is a metaphor for a Singaporean collective memory that emerges from the sum of passengers’ journeys, which are each represented by the everyday sounds that we hear.

Stored Value explores the tacitness of Singaporean identity. It captures everyday sounds that people pay little attention to because of how ordinary they are. Yet, when decontextualized, they evoke specific memories that tie us to shared experiences that form a national identity.

Stored Value was exhibited at Singaplural and SHINE Festival in 2017.

The participant taps an EZ-Link card (stored value card) on the replica of a public bus fare deductor. Instead of the usual beep, the “deductor” responds by playing a uniquely Singaporean sound and also becomes illuminated, showing a graphic.

When multiple “deductors” are activated, a mix of sounds are played in concert, creating an immersive soundscape. The sounds are repeatedly played, fading in volume with time.

]]>
Drawbot https://archive.mattelim.com/work/drawbot/ Sat, 11 Apr 2015 09:02:56 +0000 https://archive.mattelim.com/?post_type=work&p=490

Drawbot is my final project for Prof. Andy Law’s Computing Physically class in my junior year at RISD.

Drawbot is a wireless pen plotter robot that has no work area limitations. This is unlike most pen plotters in both the open-source community and the commercial sector. It is more broadly speaking an exploration into tetherless, free-roaming digital fabrication tools. Potential applications of Drawbot include sail-making and road painting.

Drawbot was exhibited at the RISD Senior Show in 2016.

The user converts a vector graphic file into gcode using the open-source software Inkscape. The user then runs a Processing program that transmits the gcode via bluetooth to Drawbot.

Find out more about the process behind the work on Behance ↗

]]>