Hard hard user interfaces.

-
Started as someone doing ActionScript in Macromedia Flash I got into Human-Computer-Interaction after watching Jeff's Hann's multi-touch work. That's the power of a really cool demo that inspired the birth of NUIGroup community which spawned 1000s of makers all around the world making their own projector camera multitouch systems. All of it became mainstream once Apple released the iPhone to the world, and also gave birth to my interest in human-centered engineering. I spent some 10 years after that playing with sensors, haptics, and gestural interfaces through multiple input modalities but nothing stuck as much as multi-touch did. Thanks to Apple's execution. Everyone's phone/tablet interaction is default multitouch. (unless you have a visual impairment). Primsense evolved into Kinect, then came Wiimote, Leap but nothing stuck.  for speech, it was Amazon's Alexa. Latest news , that its going to lose Amazon 10B.  Like I am writing this post through my keyboard a...
Post a Comment

Proposed an idea for GSoC 2009

-
Proposed an Idea for Google Summer of Code to port Google SketchUp to Multitouch. Users would be able to do 3D modeling with Simple and intuitive gestures. An Extension Module that would allow Google SketchUp to receive TUIO and hence allow manipulations via Multitouch gestures.

Abstract

Lack of a CAD software that could be used via Multitouch has been the motivating factor behind this proposal. Eversince I used the Sketches application on iPhone –which enables 2D drawing using Multitouch, I felt like doing something similar on my FTIR setup. Adding multitouch ability to an easy to use CAD/modeling software - Google SketchUp would not only make the design process intuitive but also add a lot to the usability factor.
The reason behind choosing Google SketchUp and not start developing something from scratch is due to its easy to start UI. By experience I’ve felt that Google SketchUp is one of the easiest and widely used surface modeling tools around- what’s impressive about it - its patented Push-Pull technique, being free to use and support for both Windows and OSX environments. Hence, the idea is simple - to develop an extension with new gesture-sets for Google SketchUp that’d ease the modeling procedure via Multitouch. An additional Bimanual Gesture support that’d allow an IR Pen and hand simultaneously has also been proposed as an add-on.


Development/Plan

Google SketchUp comes with a powerful Ruby API and a C++ SDK. The plugins for Google SketchUp are written as Ruby scripts that are interpreted by Google SketchUp. Also, there is a Ruby TUIO Client implementation by Collin Harris to start up with.
The procedure would be to create ruby scripts with gestures defined for specific tasks that would map to two primary tasks – 1. Workspace navigation and 2. Drawing.

This shall keep the interface intuitive and not let the end user get confuse the SketchUp during the Drawing and navigation gesture.
A new toolbar menu set will be created which shall contain two sets. This has a certain advantage over the traditional mouse system since it’d minimize the need to access the toolbar repeatedly for specific tasks :
SET 1 - Camera Movements/Workspace Navigation- This includes Gestures to ZOOM-IN , ZOOM-OUT, PAN , AND ORBIT and taking measurements
• Rotation of workspace/model in 3D – Orbit Tool
• Panning – Single touch drag
• Tapping initial and final point to make measurements

SET 2 - Drawing- This shall enable drawing using gestures via SketchUp- The tentative plan for the gestures has been described in the text and mockups below
• Select Square Option and use four fingers to enlarge rectangle. SketchUp would take care of the approximations when user intends to draw a square.
• Select Line Option and tap at two points on screen to create a line segment in between.
• Select Circle Option to draw circle using Multitouch by manipulating radius using MT



The Complete PDF for the Proposal can be accessed here

Comments

Post a Comment

Popular posts from this blog

NZM-SEC Superfast express that took my '35 hours'

-
Image
I usually cover my long distance travels by air- for it saves time, and is less tiring (and was affordable in the past).  Call it naivety or my callous attitude, but I completely forgot the fact that its hard to fetch a cheap ticket when your travel plans are made just a day in advance. Owing to recent price inflations and my last minute plans I decided to cover my return journey from Delhi to Hyderabad via train. The decision was taken a day before I wanted to return, i.e. 19th May, high time when there are summer holidays in India. The night before I stood in the train line, with my father and brother, to fetch tatkal tickets. The process is hard- the HTTP fetch request by IRCTC works like a lucky draw). Hence, my attempt ended up futile.  So I decided I'll jump on the train, painful decision-no tickets, no seats, just that. The beginning. I left my home at 7PM. Reached Kshitij's place. Had dinner there- met Surbhi, Sonia aunty and uncle there. Kshitij's mo...
Read more

Ideas

-
Image
Multiple ideas I was thinking about that could be used to improve people's lives- make new experiences happen, and tap into the unknown -- Sound Glasses. The user wears the glass and looks at a painting. A large painting. And the system gives audio feedback on the parts highlighted based on an audio command 'Tell me more'. Technology: Pre-calibrated system. Easy Or multiple paintings and it starts speaking about what you're looking at. Audio annotations. Leave specific audio snippets at places. ' User looks at certain objects 'drops' audio snippets' Later. Someone else could visit and listen to them. e.g. 'please clean this wall' 'this is Fluid interfaces demo area, find a student to help you out' 'This is where Media Lab started its first group' Audio post-its Inkharvester- presented as a hack(goes to indie inventors)- discussed with Harshit. http://penn.m...
Read more

discordant yet musical whistles

-
My house in Delhi has a guard that walks around and whistles all night to keep the thieves away. I am still amused by the fact how the entire street comes together and contributes and hires the guard, instead of complaining and waiting for the Govt. to solve their issues, which is slow as heck. Its like a citizen contributed and distributed parallel police with evolving protocol, when the systems don't work well. Atleast it keeps the societal interaction intact and neighbors talk, which i believe is a good thing- communities being vocal about their issues. writing this at 3AM while everyone sleeps and guard is awake. 
Read more