Hard hard user interfaces.

-
Started as someone doing ActionScript in Macromedia Flash I got into Human-Computer-Interaction after watching Jeff's Hann's multi-touch work. That's the power of a really cool demo that inspired the birth of NUIGroup community which spawned 1000s of makers all around the world making their own projector camera multitouch systems. All of it became mainstream once Apple released the iPhone to the world, and also gave birth to my interest in human-centered engineering. I spent some 10 years after that playing with sensors, haptics, and gestural interfaces through multiple input modalities but nothing stuck as much as multi-touch did. Thanks to Apple's execution. Everyone's phone/tablet interaction is default multitouch. (unless you have a visual impairment). Primsense evolved into Kinect, then came Wiimote, Leap but nothing stuck.  for speech, it was Amazon's Alexa. Latest news , that its going to lose Amazon 10B.  Like I am writing this post through my keyboard a...
Post a Comment

Future work

-
Post midterm tasks

1. We were working on mouse_event Function (http://msdn.microsoft.com/en-us/library/ms646260(VS.85).aspx) for the possible events that MultitouchSU DLL can inject into the SketchUp windows simply by specifying {LBUTTON UP|DOWN} {MBUTTON UP|DOWN}{RBUTTON UP|DOWN}{MOUSEMOVE x,y}.

This indeed is pretty raw, but I thought good enough for the first version. We could have got more sophisticated later with something like "Click(Left|Middle|Right count)" and "MouseMove( 0|Left|Middle|Right, x, y, rate)" etc.

This is an example how it'll be done, (http://code.google.com/p/eventrelay/source/browse/trunk/devel/MSWrunmacro.cpp?r=113)
at Function (void MSW_ProcessMacro::InjectNamedMouseMacro(string& namedMacroStr)) .
A MOVEMOUSETO(x,y) function will have to be added.
For now according to discussion with the mentor, we'll not go with this strategy. Another method that is using the require in the DLL loader script to invoke a gesture recognizer script.
Got some exams to catch up, the coding work should take place post 13th.


A TUIO gesture recognition module based on the Ruby API will sit between the current DLL and the SketchUp's UI-At this stage before we tryout writing the functional code, a medium level view has to be taken. So -Camera Classes of SketchUp - Geometry Classes -and Entity Class of Sketchup.
e.g. Entity.entityID The entityID method is used to retrieve a unique ID assigned to an entity. Now SketchUp's Received TUIO will be interpreted as gestures.
Other SketchUp classes I am looking at
1. http://code.google.com/apis/sketchup/docs/ourdoc/inputpoint.html
2. The nextFrame method of the Animation interface.

Comments

Post a Comment

Popular posts from this blog

NZM-SEC Superfast express that took my '35 hours'

-
Image
I usually cover my long distance travels by air- for it saves time, and is less tiring (and was affordable in the past).  Call it naivety or my callous attitude, but I completely forgot the fact that its hard to fetch a cheap ticket when your travel plans are made just a day in advance. Owing to recent price inflations and my last minute plans I decided to cover my return journey from Delhi to Hyderabad via train. The decision was taken a day before I wanted to return, i.e. 19th May, high time when there are summer holidays in India. The night before I stood in the train line, with my father and brother, to fetch tatkal tickets. The process is hard- the HTTP fetch request by IRCTC works like a lucky draw). Hence, my attempt ended up futile.  So I decided I'll jump on the train, painful decision-no tickets, no seats, just that. The beginning. I left my home at 7PM. Reached Kshitij's place. Had dinner there- met Surbhi, Sonia aunty and uncle there. Kshitij's mo...
Read more

Ideas

-
Image
Multiple ideas I was thinking about that could be used to improve people's lives- make new experiences happen, and tap into the unknown -- Sound Glasses. The user wears the glass and looks at a painting. A large painting. And the system gives audio feedback on the parts highlighted based on an audio command 'Tell me more'. Technology: Pre-calibrated system. Easy Or multiple paintings and it starts speaking about what you're looking at. Audio annotations. Leave specific audio snippets at places. ' User looks at certain objects 'drops' audio snippets' Later. Someone else could visit and listen to them. e.g. 'please clean this wall' 'this is Fluid interfaces demo area, find a student to help you out' 'This is where Media Lab started its first group' Audio post-its Inkharvester- presented as a hack(goes to indie inventors)- discussed with Harshit. http://penn.m...
Read more

discordant yet musical whistles

-
My house in Delhi has a guard that walks around and whistles all night to keep the thieves away. I am still amused by the fact how the entire street comes together and contributes and hires the guard, instead of complaining and waiting for the Govt. to solve their issues, which is slow as heck. Its like a citizen contributed and distributed parallel police with evolving protocol, when the systems don't work well. Atleast it keeps the societal interaction intact and neighbors talk, which i believe is a good thing- communities being vocal about their issues. writing this at 3AM while everyone sleeps and guard is awake. 
Read more