top of page
Screen Shot 2020-02-16 at 7.23.43 PM.png

Project
Present

Building present in the open,

one week at a time.

Progress update

Bring interfaces to
the 
real world

Explore ways to bring on-screen experience to a shared space where
people can interact with the internet on top of physical objects.

My first focus will be on books.

Latest Updates

Week X

06/2020

Thanks for checking out! Moving regular updates to subscribed friends only for now. Will post more as we make more progress. Stay tuned >:)

Historical Updates

Detect book cover

Week 11 

04/26/2020

Hi friends! I'm finally catching up the slack! ( sentimental stuff here - was slightly lost for a while after knowing the complexity of this project + reading it's time to build. This project can be very useful if done right, else super useless)

​

Product side - Revisited long term vision. Instead of steer deep into one specific use case, expand interactions to accommodate more possible use cases. (more to come next week)

Hardware side - Stable, even though I am aware now that my pi + pi-camera are crap for real time processing. :( 
 

Software side - Done real time book framing! Turns out it's super basic. Next will be the hard part - make sure it's agnostic to various lighting situation and cover complexity. Need to re-prioritize cover vs inline annotation code next week.

​

Recruit - Can't do this alone! If you're interested in hacking this possible future, let me know!

IMG_8437_edited.jpg

Onboarding animation

Just so you know how ridiculous

the current set up is.

Product vision journal ->

Week 6

03/15/2020

Hi friends, didn't do Pioneer update this week. Decided to move away from Pioneer to straightly focus on building instead + take care of other aspects of life, such as corona crisis world.
 

Software side -
Made great progress on computer vis. :) 

Screen Shot 2020-03-15 at 1.44.55 AM.png
Screen Shot 2020-03-14 at 11.13.39 PM.pn
Screen Shot 2020-03-14 at 10.48.40 PM.pn

Week 5

03/08/2020

Hi friends, welcome to another week of update. This week, we've made big progress on building out annotation use case. Exciting things coming.

​

Product side - Developing annotation use case, will show more later. For brief sketch, see about. Started a team, and mood board.


Hardware side - Considering new clamp for holding the device.
 

Software side - Explored web client! Also, made progress on object detection. Next step is to make it real time.

Screen Shot 2020-03-09 at 1.03.38 AM.png
Screen Shot 2020-03-09 at 1.05.10 AM.png

Week 4

03/01/2020

Hope you all have a great leap day!

I hear you on the feedback on being more clear in my progress update, so I decided to write out the details in paragraph.

 

Product side - answering some questions about "why do you do this project?", "what do you mean by bringing interfaces to books" at About page. TLDR: this is an exploratory project on improving my own reading experience, and if it works, maybe it could help improve others' experience too.

Hardware side - designed and 3D printed a case for the device! (HUGE thank you to Work hard, play hard@NB for helping me out) Why we need a case? Because it takes time to reposition the camera and projector - having a case will stabilizes the movement and enables me to go into software dev mode faster! This is 1st iteration. 2nd iteration is in the pipeline.

​

Software side - did a tutorial on simple shape recognition, and read a ton of documentation on the openCV methods. (see my learning log) Now I understood (in general sense) how shape recognition works -- next step is to apply my learning to the camera script, so the camera can recognize where the book is.

Drew out what information 

will be projected on books

Top view of the device: 

camera projector offset is important. That's why we need a case.

IMG_7509.HEIC

3D model of the case

Screen Shot 2020-03-02 at 12.18.34 AM.pn

3D printing

IMG_7502%202_edited.jpg

Case refinement plan

IMG_7508.HEIC

Learning shape recognition algo

IMG_7469.HEIC
Screen Shot 2020-03-02 at 12.23.22 AM.pn

Projector/camera stable setup

Week 3

02/23/2020

Hardware

Completed stable set up


Software
Wrote basic camera script: read from desk

Wrote basic projector script: project frame
 

Product

Got feedback on use cases - uncovered     challenge: people don't read on desk 

Started exploring input devices

Testing bounding box

IMG_7359_edited.jpg
IMG_7393_edited.jpg

Camera stream running

IMG_7377.jpg

Projecting program from pi

IMG_7383.jpg

Week 2

02/16/2020

Hardware

Set up clamp and mounted projector
Received camera

Product

Created this website
Continue adding use cases for books

Booting up the pi

7598CBA5-4479-4A93-A336-B8BE2B47469F.JPG

Setting up pi

IMG_7254.jpg

Clamp mounted

with laser projector

IMG_7266_edited.jpg

Bookmark use case

IMG_7255_edited.jpg
IMG_7139_edited.jpg

Week -22

08/01/2019

Started last summer. Toyed with 

a bunch of faulty projectors. Took me a 

while to understand what needs to be done.

​

(turns out it's nothing new under the sun!)

IMG_8392.HEIC

Week -510

2010

"Sixth Sense on youtube, dope!"
- 2010 Tinnei's diary


The video: 
https://www.youtube.com/watch?v=YrtANPtnhyg

EF013F48-6043-4A8D-A272-04E161D94F1F.JPG
157182A8-50BE-471C-8F0E-71D4FA26F0EF.JPG

Future updates

will be added here

Feel free to check back if you're interested in following along my progress. 

Alternatively, you can also send

me a note so I know you exist!

Thank you for stopping by! Have a great day!

bottom of page