NIYANTRA Documents
(Make sure you follow all the 3 steps involved in submission. This is only Step 2 of 3. For details, visit http://bit.ly/16iNfUL)
Contact Information
Name of the College :
Army Institute of Technology
Name of the Team Members along with their respective current semester :
Ashwani Kumar tiwari (semester 7)
Ankit Singh (Semester 7)
Manjot Singh (semester 7)
Ajay Kumar (Semester 7)
E-Mail Address & Phone Number of the Team Leader :
ashwani.ait.entc@gmail.com Phone number:- 8793391071
Name of the Faculty Guide :
Prof. Avinash patil
E-Mail Address & Phone Number of the Faculty Guide :
ashwani.ait.entc@gmail.com Phone number:- 8793391071
Project Information
Project Title:
NIYANTRA 2013 - <how would a blind person use a computer> && NIYANTRA 2013 - <connecting physical world to digital world>
Hardware & Software Used:
Hardware :- Computer && Mouse && Camera
Software :- Labview
What challenge/problem are you trying to solve through your application:
Project 1 > how would a blind person use a computer
project 2 > Aimed at making the life of the Eastern world better and better.
How does your application solves the above mentioned challenge/problem:
Project 1>
Solution :-
The existing Computer technology for blind person
> Cumbersome to use
Blind person needs to remember the spatial location of files.
Secondly user also needs to remember many short-cut keys to operate computer.
Example : ctrl +r for reading text file etc.
> Slow in operation
> Expensive
Solution :-
>Cost effective
Not a single addition of hardware
> Blind person does not need to remember location of any folder
Using the concept that all files are alphabetically arranged
> Time to access any file gets reduced by a great extent
Highly Efficient and Effective Algorithm Implemented Which reduces acess time to great extent
project 2>
Making the life of the Eastern world better and better. ( Connecting physical world to digital world)
Solution :-
Control The Whole Computer Using Pattern matching and Gesture recognition technique.
IF USER SELECT VIDEO FILE....
Upward movement of hand leads to increase in sound of video player
Downward movement of hand leads to decrease in sound of video player
Right movement of hand results into fast forward by 1min
Left movement of hand results into a backward jump of 1min
IF USER SELECT STUDY NOTES....
Upward movement of hand switches the user to previous pages
Downward movement of hand switches the user to next pages
Right movement of hand make's the user zoom in
Left movement of hand make's the user zoom out
Description of Project:
project 1 >
How our project works
Blind People Process Speech Far Faster Than Sighted Persons.
All folders inside computer are alphabetically arranged.
Control whole computer with a mouse
Mouse button performs different operation depending upon the type of file selected by blind people
Blind People Process Speech Far Faster Than Sighted Persons.
All folders inside computer are alphabetically arranged.
If person is currently pointed to file name curiosity and if want to open folder named
image by pressing right click he can do the same without knowing the spatial location of file.
If he want to open 1song then by clicking left click several time he can open the desired file.
Control whole computer with a mouse
Mouse button performs different operation depending upon the type of file selected by blind people
right click- next file
Left click - previous file
scroll press - file open/close
POLYMORPHISM:-
Properties of mouse click changes according to the file selected by user
To site an example consider user opened a video file then properties of mouse clicks changed to
Left click – backward by 5 sec
right click- fast forward by 5 sec
scroll press – open/close
project 2>
The camera we used acts as a digital eye of the system. It basically captures the scene the user is looking at. The video stream captured by the camera is passed to mobile computing device which does the appropriate computer vision computation.
User need to tell two things to processor..
1=>Which file user want to access
. 2=>What operation user want to perform
We developed six algorithms that plots the information from physical world to digital world.
1 Plotting physical coordinate (hand movements) to digital coordinate.
After processing the captured data system retrieve the physical coordinate of the tracking object and plot accordingly to obtain digital world (computer) coordinates.
User got access to any file using transformed coordinate
2 Searching file
Assigning transformed coordinate to cursor so cursor moves in same fashion as Tracking object.
3 Selecting file
Keep track of coordinate’s received from digital world.
If coordinate not vary for 5 second’s system assumes that user want access to that file.
System uses digital coordinate as a file handler.
Once processor got file handler with him system goes into operation mode
4 Operation (Swapping algorithm)
Operation mode decides which operation user want to perform.
System starts timer
Keep verifying that is the physical coordinates are as previous one.
If not (Abrupted by User) selects first mode
System reset the timer to Initialiaed value
System repeat the operation mode subroutine until timer runs out so user has choice to enters in different mode.
Each mode has predefined subroutine after system decides the mode it executes the subroutine written in it.
5 Indication clock
change of quardrant in which circle move to indicate which mode get selected if timer runs out.
Cursor moves in circle to show time left with user before user can change operation mode
6 Ease of study notes and watching movies
IF USER SELECT VIDEO FILE....
Upward movement of hand leads to increase in sound of video player
Downward movement of hand leads to decrease in sound of video player
Right movement of hand results into fast forward by 1min
Left movement of hand results into a backward jump of 1min
IF USER SELECT STUDY NOTES....
Upward movement of hand switches the user to previous pages
Downward movement of hand switches the user to next pages
Right movement of hand make's the user zoom in
Left movement of hand make's the user zoom out
Other application's include....
Mobile calling using hand gesture
Playing virtual chess
Gesture lock (Ultimate security)
Writing over surface's
Insert Images Here:
YouTube Link of Video:
project 1 >
project 2 >
Insert the Video here:
