Home > Design > blogs
Is eye tracking out of reach for web and RIA developers? I think for the most part today cost and lack of knowledge are the two biggest barriers for your average web developer when considering usability testing via eye tracking.
Cost is the easiest factor to examine. Eye trackers are generally in the $30,000 USD range, this of course to buy the whole set up. Alternatively, you could hire a company that already has the equipment, and specialized in using and providing you a report. This is probably quicker but still not cheap.
Of course you could go DIY and set up your own low cost eye tracker, but seems like it would be even harder. There are other solutions like Scrutinizer which simulates your foveal vision, CrazyEgg which gives heatmaps of clicks on a site or RobotReplay which can replay an entire user session as if you were watching over their shoulder.
Lack of knowledge is a bit fuzzier as it falls into two major categories: 1) lack of expertise in using an eye tracker and 2) lack of understanding of the benefits.
Eye tracking equipment is quite sophisticated and can be finicky to set up. Furthermore, once a user is instrumented you still have to know how to conduct a proper usability test. Even once you have the test results back you may not know what to do with them or how interpret them.
According to a post on why AdaptivePath doesn’t use eye tracking:
“First, lack of availability of it and familiarity with it as a research tool.
Second, I find it difficult to interpret the data”
One of the factors with lack of understanding the benefits may also be a result of designers who are a little over confident in their own abilities. In the AdaptivePath post one person states that any good designer should be able to figure where a users eyes will be drawn.
“I think a good information designer could have devised the flow of the eye on the UI on their own.”
Based on my understanding of vision and the brain, which is limited, that seems unlikely. Sune one of the commenters echoes this with:
“Information designers are NOT able to anticipate eye movements, not even for very simple stimulus. As part of my thesis some years ago I did an experiment, where this was evident. Experienced web designers were asked to predict the typical gaze path, and this was compared against the actual eye movement pattern. There were no correlation.”
Still this coming from AdaptivePath one of the leading web UX and design companies today, they even coined the term Ajax!
I haven’t been involved in any eye tracking studies myself but I will be working with usability expert and eye tracking researcher from Simon Fraser University this summer to determine the correlation between eye tracking, usability and some of the low cost web tools available today. So I’ll keep this thread going.
Let’s figure this out and push back on guys like Jakob Nielsen who are slamming RIAs and Web 2.0 because of a few early examples that didn’t make the cut in terms of usability.
What process or tools do you use for usability testing?
- comments: 4
- eyetracking
- research
- usability
- ux
- tags:
Comments
4 Comments
Leave a comment
Stay Connected
 InsideRIA Atom Feed
InsideRIA Design Atom Feed
InsideRIA Newsletter
↑ Put InsideRIA News on Your Site
Search InsideRIA
News & Events
Latest Features
Tag Cloud
- .net
- 3d
- actionscript
- adam flater
- adobe
- air
- air api
- air cookbook
- air resources
- air xml webkit
- ajax
- ajaxworld
- alertthingy
- amp
- analytics
- ant
- antipattern
- api
- appengine
- apple
- april fools day
- aptana
- architecture
- asp
- away3d
- aws
- bad usability calendar
- benchmarking
- berlin
- beta
- bitmaps
- blazeds
- blendmode
- book
- browserplus
- cairngorm
- camp
- career
- chart
- cloud
- code
- code generation
- coldfusion
- command design pattern
- communication
- community
- compiler
- component
- compression
- conference
- cs4
- curl
- customer
- cuzillion
- dare
- data
- datavisualization
- dbunit
- ddlutils
- debug
- decompiler
- deep zoom
- degrafa
- design
- design patterns
- desktop
- development
- diary
- dionalmaer
- drawing api
- dreamweaver
- drupal
- ejb 3.0
- elixir
- embedded jboss
- encryption
- europe
- event
- excerpt
- experience
- ext
- externalinterface
- eyetracking
- features
- filters
- fireworks
- fitc
- flash
- flash10
- flashforward
- flashplayer
- flex
- Flex
- flexbuilder
- flexunit
- form factor
- framework
- friendfeed
- gadget
- gears
- gesture
- googledocs
- googlegears
- graphics
- graphics mask
- guimark
- hosting
- how-to
- html
- ia
- ie
- ie8
- igoogle
- interaction
- interface
- interview
- iphone
- iphonedevcamp
- j2ee
- jakob
- java
- javafx
- javaone
- javascript
- javase
- javase6
- jaxer
- jms
- job
- joyent
- keynote
- languages
- lcds
- learning
- lffs
- library
- licensing
- linux
- listen
- livecycle data services
- madrid
- map
- marketing
- math
- maturity
- maven
- memory
- merapi
- mesh
- metrics
- microsoft
- mikepotter
- mix08
- mobile
- model locator design pattern
- mono
- mozilla
- mvc
- mxmlc
- neilson
- nio
- nitro
- nitrolm
- offline
- onairbustour
- onairtour
- onairtoureurope
- ontologies
- oop
- open source
- OpenFlux
- openscreen
- opensource
- orm
- papervision3d
- paris
- pattern
- pattern mining
- performance
- php
- podcast
- portable
- preload
- pricing
- prism
- Processing
- profiler
- protagonize
- push
- rails
- release
- research
- resources
- ria
- ria community
- rich
- ruby
- sanctuary
- scheduling
- scott sheridan
- search
- security
- seo
- server
- service oriented architecture
- services
- session bean
- silverlight
- singularity
- social
- source
- spain
- spry
- sqlite
- static code
- steveounders
- stockholm
- streaming
- survey
- swc
- swf
- switchboard
- syscon
- test driven development
- testing
- testng
- thermo
- tip
- tools
- trends
- tufte
- tutorial
- ui
- ui pattern library design
- uirc
- unconference
- unit testing
- usability
- user experience
- ux
- vector images
- view source
- vision
- warsaw
- wdn08
- web
- web 2.0
- web 2.0 expo
- whenisgood
- why
- widgets
- workshop
- wwdc
- xulrunner
- yahoo
- yui
Related Books
Development Series
Get an overview of the tools and technologies that work together to allow developers to build Rich Internet Applications (RIAs) quickly and easily.
Recent Comments
- User piechulla1966 (see 2nd link in the blog article) on Is Eye Tracking Out of Reach?: "Of course you could go DIY and set up y...
- User laurie gray on Is Eye Tracking Out of Reach?: Andre, this is a great topic. I saw an e...
- User Andre Charland on Is Eye Tracking Out of Reach?: Thanks Rhys. Sounds like a good process...
Archives
About This Site
Welcome to the premiere community site for all things RIA sponsored by O'Reilly Media and Adobe Systems Incorporated.
About Us
Meet the Experts
Meet Our Contributors
Send Us Feedback

Hey Andre Nice article.
My process for usability testing is actually getting 2 or 3 users to use the app and fill out a survey. Of course I am not in the room to watch them work on it, otherwise it makes them uncomfortable. Then after they are finished I then sit down with them and run through their survey so I can get an understanding why they did what they did. After that I get them to run through the program again while I am in the room, and allow them to explain why they are doing this and doing that.
I then see for any improvements and if they are feasible. I would get more users, If I could. I suppose the more users you have the bigger the sample space of data or feedback you can get.
I have never taken a liking to any of the usability software out there, as for some reason I am always left hanging for more understanding. I still like face to face conversations with users.
Thanks Rhys. Sounds like a good process, simple yet effective.
What usability software have you tried. (And what do you mean by "usability sofware";-))
Andre, this is a great topic. I saw an eyegaze system demoed last year at the UPA conference by Tobii (http://www.tobii.com/corporate/start.aspx). They had some unique pricing structures that might potentially bring this technology to the masses a bit more.
That said, a number of others, particularly Jakob Nielsen, have produced articles about eyegaze results. To me, the results aren't *that* different between authors. I think that they're good to keep tabs on in case something changes, but I don't know that I'd expect to get the value out of doing one myself.
Over my years of practice, I have found good clear research questions, careful research design, a strong script and the ability to analyze my findings has given me everything I've needed without the fancy stuff (although I do admit to rigging up a way to view/record screen views for cell phone studies in my earlier days!)
@Rhys, you might want to consider incorporating the System Usability Scale (SUS) in your protocol - it's a pretty classical baseline tool. It's general, but that's ok. Check it out.
"Of course you could go DIY and set up your own low cost eye tracker, but seems like it would be even harder."
Yes, the demonstration application is still fragile. Optimal lighting conditions are critical. Many volunteers downloaded the program -- few reported success. An infrared version (based on a modified Microsoft LifeCam VX-1000) is in the pipeline. Hope this will track more stable. Stay tuned!
BTW: The professional eyetracking systems I worked with are not in the $30,000 USD range, but in the $90,000 USD range.
Best regards,
walter