Eye Tracker - Write Messages

Eye Tracker - Write Messages

10,000 - 50,000 downloads

Add this app to your lists
This is a PROTOTYPE application that I built for my Master Thesis. Therefore, if you download it, do not expect miracles from it, also have patience with it.

Curious about what's under the hood?
Get the printed version of my thesis: https://www.morebooks.de/store/gb/book/hands-free-human-computer-interaction-paradigm-using-face-tracking/isbn/978-3-659-47366-1

There is no built-in tutorial so far, you won't get how to work with it unless you read the hints bellow

Youtube instructions: http://www.youtube.com/watch?v=NHIyAg9rdpM

1. Make sure that when you use the application the light in the room does not reflect in your eyes. (try to avoid facing windows, or lightbulbs). However, your face has to be visible to the camera.
2. Do not move / tilt your head when you use the application
3. Perform a calibration test:
3.1 Start the application
3.2 Set your head approximately 25 cm from the screen. Your face should fit in the red rectangle on the camera preview, your RIGHT EYE and NOSTRIL are tracked by the camera.
3.3 Hold the Android device so that your nostrils appear in the camera preview
3.4 Press the "Start" button
3.5 Hold head still and look at the camera preview (at yourself).
4. Once calibration is done, three buttons will appear on the screen, each with characters and words
5. Gaze Left, Right or Up to Highlight a desired Button, then Select button by blinking right eye or both eyes for two seconds (cout to 3)
6. Continue to select desired Button until you have to choose between just two options.
7. You can restore the Buttons to initial values by accessing he Back button from the top menu.
7. You can delete characters from the text box by accessing the Undo button from the top menu
8. Mark the end of a word by using Space or punctuation symbols.
9. Use the Talk option to make the device talk the message back to you.

In case you are not able to use the application for any reason please write me an e-mail at: feedback2developer@gmail.com with the subject "Eye Tracker - Write messages". I will try to give you Hints and Tips on how to manage to use the application.

The prototype application purpose is to assist users write messages using only their eye's direction and blinks. The prototype was developed having in mind people with ALS, Locked-in syndrome or any person that can only move their eyes and eye lids.

The device that I have tested it with is a Samsung Galaxy Nexus with Android 4.1.2.
You will need a front camera, preferably a light sensor and patience.

- Supports different device orientations (Landscape and Portrait)
- Guidelines for face recognition and setting the light conditions to proper values
- Now app works with tablets like Nexus 7
- Added a BEEP when user selects a letter by blinking - for users that cannot close just their right eye
- Removed the Ads

Tags: eye tracking app nexus, eye message, using eye tracking for locked in syndrome.

Recently changed in this version

- Send Text by SMS - This features is not fully tested please write me e-mails if it crashes.
Please also be aware that the SMS messages are sent automatically when the SMS button is pressed. This might cause extra costs due to miss-tapping of the SMS button.
To protect yourself from extra costs, just leave the recipient phone number empty.

- Fixed crashing issue - Thank you for reporting the problem

Version worked for me in a dark room with light reflected on my face for my thesis.


Comments and ratings for Eye Tracker - Write Messages
  • (32 stars)

    by Jonathon Hoggarth on 18/04/2014

    I'm starting my own eye application on.android using opencv, perhaps instead of blinking you could use some sort of timer if the user is looking inside specific Co-ordinates? What algorithm and image processing techniques did you use in this? I'm doing my bachelors and it's my final year project. Keep up the good work and ignore the haters. Solid start with alot of potential

  • (32 stars)

    by Stanley Debono on 02/04/2014

    Great idea with great potential for improving the quality of life of persons with disability. I was unable to set it up correctly since I hold the phone to far away in order for my face to fit in the red box. As a result performance was sub par. However I encourage you to continue improving it further so it becomes more usable. Maybe you can give the user some feedback like a visual cursor o

  • (32 stars)

    by ASHWIN VANIA on 26/02/2014

    Nice

  • (32 stars)

    by DiLdEeP SiNgH JoLLy on 26/01/2014

    Add features like scroll homescreens, phone txt messages, applications screens through eyes... blink 1 tym or 2 tym to select... features like that.. whole scrolling areas of phone..( as in a Backgroynd running app )... This type of app will b super cooool.. ASAP.

  • (32 stars)

    by Mike Sam on 21/01/2014

    like it

  • (32 stars)

    by Hasam Mahroos on 16/01/2014

    Title says it all.

  • (32 stars)

    by Joseph Stone on 07/01/2014

    Keep up the good work! I was just playing with it on my break at work, I look forward to giving it another try when I get home with better lighting! I'll let you know how it turns out!