View cmoore tmp
Community
Community Showcase Video.. on homepage....
Feeds of all the related blogs and community activity on homepage
Bring back NUI.TV
Community iPhone/Google contest for community (win an iphone/shirts)
Community enhancements (updated web site… tutorials...)
Software
Tracking
Merge (MTLib/Touchlib/OpenTouch) efforts/strengths
Documentation of ongoing Touchlib (objects/components and demos (AS3))
Dynamic thresholding for Touchlib
GPU accelerated blob tracking (GPUCV vs OPENCV)
Hand Recognition/Finger Tracking (DI)
Transport
Touchlib Binary socket driver to other applications (Flash/WPF/Cocoa)
Touchlib to CocoaTouch via TUIO
C#/TUIO Wii Remote Library (for use in tabletop environment, limited 4 blobs per remote)
C#/TUIO Touchlib Library (WPF/Silverlight) (Project utilizing M$.. “Deep Zoom")
Clients
Touch OS - A rapid prototyping environment for testing multi-modal applications (Flash/WPF)
Touch API - A standardized communication layer (XML/Binary Socket or Internal)
Standardized Touch Event system across development platforms (should events be considered phases)
Physical Object Tracking API (Fidicuals/RFID/Bluetooth/wUSB) aka (Device Awareness)
Gesture Recognition/Configuration (XML dictionary) (context driven)
Radial Menu System (XML Pie Menus) (context driven)
Tweening/Animation/Physics Engines
View States (2D-3D Space/Time)
Scene Manager (ZUI/Grid Manager/Sorting) (arranges object’s XYZ) (psudo 3D)
On Screen Keyboard
Standard GUI Elements (Button/wheels/knobs/sliders/Default Adobe Components)
Canvas (ObjectContainer/Zoom/Filter Lenses)
Cursor Tools (Rect and Freedraw Lalso/ Precise Selection/Transform Tool/Text Selection)
Task Manager (Resource Management/Garbage Collection)
System Settings (Stored as SOL)
Flash Security Manager
Local Object Storage (100k by default)
Gesture Clipboard (Copy/Cut/Paste)
Execute/Load local system resources (fscommand)
Application Stacking (using two applications at once to get desired result ( think matrix ))
Object Library (image, video, audio, text, keyboard, spectrum… )
Web APIs (youtube, yahoo, wiki, etc...)
Web Browser (AIR Webkit browser or C++ firefox)
Hardware
Wii Remote support in touchlib (use wii sensor for FTIR or DI)
Multi-Projection/Camera installation and calibration guidelines (algorithms, tools and tutorials)
An external light sensor outside table that touchlib could read (dynamic light environments)
Arduino / Make Controller
NUI Notes
STAG (Speech/Touch and Gestures) Expanded
So… How can we detect and track human attributes…
Proximity
Accelerometers
Ambient Light
Touch Tracking
Air Tracking
Eye Tracking
Laser Tracking
Posture Recognition
Sequence Recognition (double or triple tap)
Finger Chording
Gestures Recognition
Speech Recognition
Neural Activity (brain tracking)
(Detection VS Tracking VS Recognition)
(Direct VS Indirect)
