Focustrakr CS SP

Transcript

1. User Behavior and Focus Analytics for the Web Raman Shalupau Senior Project I Prof. Karagiozov AUBG, Spring 2012
2. • User Experience (UX) impacts conversion rates • Observing user involvement • Points and flow of attention • Applications: Marketing, Usability improvement Analytics
4. • Eye tracking - expensive - slow - small sample size - no click capturing • Mouse tracking - cheap - fast - huge sample size Possible solutions
5. • Collect data from site’s visitors behavior • Filter gathered data according to some criteria • Visualize — build a heatmap • Match heatmap with a page shot Functional requirements
6. • High availability • High concurrency • Immediate response to data submissions • Horizontal scalability • Big Data Non-functional requirements
7. • Event-driven Async I/O at server side • Distributed persistent stores • Distributed caching • Load distribution Solution
8. • Node.js • MongoDB • Memcached, Redis • Ubuntu 11.10 on Amazon EC2 micro instance Stack
9. • Google Chrome’s V8 JavaScript engine • Event-driven, non-blocking I/O • One thread (though can be run in a cluster) var http = require('http'); http.createServer(function (req, res) { res.writeHead(200, {'Content-Type': 'text/plain'}); res.end('Hello World\n'); }).listen(1337, "127.0.0.1"); console.log('Server running at http://127.0.0.1:1337/');
10. • Document-oriented BSON storage • Auto-Sharding • JSON API • Map/Reduce • Various replication strategies • Craigslist • MTV • SAP • SourceForge • GOV.UK • TheGurdian • Forbes • NewYorkTimes • INTUIT • Bit.ly • github • etc…
11. • Free & open source, • high-performance, • distributed memory object caching system, • generic Intended for use in speeding up dynamic web applications by alleviating database load Memcached •LiveJournal •Wikipedia •Flickr •Bebo •Twitter •Typepad •Yellowbot • Youtube • Digg • WordPress.com • Craigslist • Mixi • etc…
12. FocusTrakr Observer Ubuntu instance (Amazon EC2) System User (Browser) Site visitor (Browser) Analytics Server User Data submission Mouse tracking Click tracking Scroll tracking Layout offsetting Data filtering Data collection Data compounding Heatmap generation Screenshots gen… User sessions Static file server Heatmap Image caching Sites Filters Maps Interaction controls RPC API
13. Demo
14. • Color allocation algorithm • Data collection, micro-sessions • Screenshot generation • Environment management • Liquid layout offsetting Challenges
15. Color allocation
16. Color allocation
17. Screenshot generation • xvfb — X virtual framebuffer • WebKit engine • Modified Adobe Flash • Universal Internet fonts
18. Future work • Do more work on the client side • Better RPC API + MVC on client • Add more filter attributes, metrics, filter community • Scale, scale, scale…
19. Q & A