Engaging with Large Language Models through Tangible Experiences:
Part I: AIncense
▲
Harnessing the power of traditional rituals for the emerging technologies.
▼
AIncense is a praying device powered by ChatGPT, designed to amplify self-motivation through psychological suggestion.
AIncense integrates the comprehensive capabilities of ChatGPT to revolutionize and expand our perception of religious authority. This innovative platform empowers users to foster a routine of self-empowerment and inspiration. Whether making a wish, confessing, or navigating daily life, AIncense provides a unique space for personal reflection and growth.
AIncense 2.0
(Locally deployed LLM)
In Fall 2024, I had a chance to revisit this project, and made a hardware design that truly enables this interaction. With the support from MIT HAN Lab, I was able to make a smart incense that locally communicates with Large Language. Please click the following links to see detail for the 2nd Iteration:
Incense PCB Iterations
Part II: MIT HAN Lab Local Voice Assistant
A modular design for edge computing
This device envisions how modularity works for edge computing hardware. The base computing module is powered by Nvidia Jetson Orin Nano, while the top module could be easily changed according to the need. Here presents a speakerphone module as example.
The client and technical support for this project is MIT HAN Lab, founded by Professor Song Han. HAN lab stands at the forefront of cutting-edge research, encompassing a wide spectrum of topics from LLM and genAI to TinyML and hardware design.
Technology
This voice assistant and TinyChat computer uses the TinyChatEngine software from MIT HAN Lab. It runs Meta's latest LLaMA-2 model at 30 tokens / second on NVIDIA Jetson Orin Nano and can easily support different models and hardware. For more details on the software side please visit MIT HAN Lab. All of Tinychat computer's hardware are custom designed except the keys. We wanted to craft the most compact interface for portability and personalization
Design Decision:
Off-the-shelf speaker module
Some design decisions were made as we (Spatial Dynamics, a local industrial design consultancy studio who commissioned me for this project) only had one week to deliver the prototype.
For instance, we disassembled an existing speakerphone product from Amazon, and integrated the speakerphone unit into our design. Although using existing component raised certain limitations, this saved us quiet a lot time from building the hardware from scratch.
Due to time constraint, we decided to use SLS / FDM print for the prototypes, and use an external usb-c cable to power and communicate with the speakerphone unit.
Part III: Tiny Chat Computer
For: MIT HAN Lab
Project team: Quincy Kuang, Lingdong Huang, Kai Zhang, MIT HAN Lab
Private personal computing
This integration enables powerful technologies to operate locally, fortifying the safeguarding of personal privacy. "TinyChat" emerges as a pioneering project to explore this very concept. We crafted the TinyChat computer with a design reminiscent of classic computers, both as a tribute to the original idea of a "personal computer" and as a reminder of their historical aesthetics. This raises an interesting query: as AI software evolves, might it also transform the physical form of computers themselves?
All of TinyChat computer's hardware are custom designed except the keys. We wanted to craft the most compact interface for portability, personalization, and of course, the ultimate retro look.
