Voice to emoji
Interaction design - Individual - 1 week - School project 2025
Task:
Use an AI tool in a way that surprises. Make something funny or subversive or emotional or unexpected.
Result:
I have explored how AI understands messages, especially how it can transcribe voicemails and add tone with emojis, something I didn’t know was possible.
What I have learned:
With Matt Webb leading the project we explored co-agency, how humans and AI can prompt and influence each other. I learned how to design with AI as a collaborator and use different tools for specific tasks. As Matt said, in the future either you tell the machine what to do or it tells you.
It can be understood in different ways. It might seem realistic and clear, but it could also be sarcastic or ironic. Without context, short texts are easy to misunderstand, especially talking with people you dont know well.
This happens when reading, but also with voicemails. They are quick and easy to send, but not always easy to listen to, especially if you can’t have the sound on.
transcribed automatically,
with tone included to avoid
misunderstandings?
This could be a great feature for SMS,
Snapchat, or even your keyboard!
I have explored various AI tools in my research, but for this creation, I used ChatGPT, Claude, and p5.
- ChatGPT+ transcribed voicemails and analyzed tone (At first, ChatGPT understood tone, irony, and sarcasm well, but over time, it became less precise. Still, I was surprised by how well it understood the meaning behind messages)
- Claude provided code to demonstrate how this could be implemented as a real feature
- p5 was used to prototype and code the concept