arm tracking technology
Posted: Tue Aug 13, 2013 3:14 am
In my eye tracking idea, I used the kingpin technology.
First I took the grid, that is the "button" in the kingpin technology.
I first made the eye to form the grids dimensions, then got the eye to look at the grid light up and this was the eyes position relative to that lit grid.
Then I showed the stereoscopic picture to the eye based on what part of the grid the eye was looking.
That was the eye tracking section.
Second was the neck tracking which let me judge the depth the person was looking at, it used the same grid idea but the grid looked different than the previous grid, so that what the grid showed could let me judge the distance the person was looking at.
That's about the skinny on what the eye tracking idea was.
In hand tracking, I need to have two parts;
- the hand motion when the arm is bent and holds the hand as clode as it can to the armpit
This is the same as the eye tracking in the eye tracking idea.
- the arm moving out so the hand is distanced from the armpit is was held close to.
This is the same as the neck tracking in the eye tracking idea.
I found that if you hold your hand by your armpit, and the palm is facing downwards, so the thumb is besides the chin.
That is you wiggle the single finger starting with your thumb and moving to your pinky.
Then the finger that is next to the wiggling finger, and closer to the pinky, will wiggle slightly, like the two are trying to rub together.
And if you wiggle the finger a lot then the finger beside it that wiggles slightly will will more too.
This was the wiggling finger is copied by the finger besides it.
Conversely, if you start with the pinky moving to the thumb, and wiggle the one finger at a time.
That the finger besides the wiggling finger and closest to the thumb will wiggle.
So if your counting the fingers inwards to outwards, thumb to pinky, the copycat finger will be the finger closer to the pinky.
Or if your counting the fingers outwards to inwards, pinky to thumb, the copycat finger is the finger closer to the thumb.
This is because your feeling where your moving too, it's a compelling feeling that you put your hand where your hand is moving.
This is visible when you imagine a object to your right and then try to touch it and you watch how your fingers bend, then try again but the object is to the left not the right - your fingers move differently, it's a touch association in the mind I think.
The grid in this case is the wiggling finger, the eye in the case, of hand tracking is the copycat finger.
So the grid lights up and then the eye follows the grid and this has a value, grid lit up by main wiggling finger = copycat finger position.
If you hold your hand below your elbow and then bend your forearm upwards. The amount you bend your forearm affects the amount you bend the arm attached to the shoulder, the same as the copycat finger, just the same.
The forearm is the main wiggling finger, and the arm bone attached to the shoulder is the copycat bone that copies the forearm.
So if you map the amount the copycat bone moves, it moves because the forearm moved.
So if you can have the forearm be the grid, the copycat bone that is inside the shoulder joint is what follows the copycat bone, as the eye, if you see the parallel between eye tracking and this.
So when the arm is held next to the armpit, the forearm is held still against the ribs, so the arm attached to the shoulder is still.
Then the copycat fingers are made to equal the main wiggling finger.
Then using eyetracking terminology, the forearm moves, and the bone attached to the shoulder is made to equal the forearm, if the forearm is the grid that lights up, and the bone attached to the shoulder is the eye.
Now the grid and tracking of the grid is understood, you just need to figure out how to get the grid to mean something in software, then match the copycat to the grid in software.
This would then let you have hand tracking in virtual reality. This was on theory not actual implementation. For implementation I can't say what can read the bones of the hand and forearm to make the grid, thenwhat can read the copycat bones in the arm and hand. Maybe colors on the arms that then show how the fingers will wiggle?
If the arm moves outwards, then the fingers grid finger and copycat finger is understood in SW.
First I took the grid, that is the "button" in the kingpin technology.
I first made the eye to form the grids dimensions, then got the eye to look at the grid light up and this was the eyes position relative to that lit grid.
Then I showed the stereoscopic picture to the eye based on what part of the grid the eye was looking.
That was the eye tracking section.
Second was the neck tracking which let me judge the depth the person was looking at, it used the same grid idea but the grid looked different than the previous grid, so that what the grid showed could let me judge the distance the person was looking at.
That's about the skinny on what the eye tracking idea was.
In hand tracking, I need to have two parts;
- the hand motion when the arm is bent and holds the hand as clode as it can to the armpit
This is the same as the eye tracking in the eye tracking idea.
- the arm moving out so the hand is distanced from the armpit is was held close to.
This is the same as the neck tracking in the eye tracking idea.
I found that if you hold your hand by your armpit, and the palm is facing downwards, so the thumb is besides the chin.
That is you wiggle the single finger starting with your thumb and moving to your pinky.
Then the finger that is next to the wiggling finger, and closer to the pinky, will wiggle slightly, like the two are trying to rub together.
And if you wiggle the finger a lot then the finger beside it that wiggles slightly will will more too.
This was the wiggling finger is copied by the finger besides it.
Conversely, if you start with the pinky moving to the thumb, and wiggle the one finger at a time.
That the finger besides the wiggling finger and closest to the thumb will wiggle.
So if your counting the fingers inwards to outwards, thumb to pinky, the copycat finger will be the finger closer to the pinky.
Or if your counting the fingers outwards to inwards, pinky to thumb, the copycat finger is the finger closer to the thumb.
This is because your feeling where your moving too, it's a compelling feeling that you put your hand where your hand is moving.
This is visible when you imagine a object to your right and then try to touch it and you watch how your fingers bend, then try again but the object is to the left not the right - your fingers move differently, it's a touch association in the mind I think.
The grid in this case is the wiggling finger, the eye in the case, of hand tracking is the copycat finger.
So the grid lights up and then the eye follows the grid and this has a value, grid lit up by main wiggling finger = copycat finger position.
If you hold your hand below your elbow and then bend your forearm upwards. The amount you bend your forearm affects the amount you bend the arm attached to the shoulder, the same as the copycat finger, just the same.
The forearm is the main wiggling finger, and the arm bone attached to the shoulder is the copycat bone that copies the forearm.
So if you map the amount the copycat bone moves, it moves because the forearm moved.
So if you can have the forearm be the grid, the copycat bone that is inside the shoulder joint is what follows the copycat bone, as the eye, if you see the parallel between eye tracking and this.
So when the arm is held next to the armpit, the forearm is held still against the ribs, so the arm attached to the shoulder is still.
Then the copycat fingers are made to equal the main wiggling finger.
Then using eyetracking terminology, the forearm moves, and the bone attached to the shoulder is made to equal the forearm, if the forearm is the grid that lights up, and the bone attached to the shoulder is the eye.
Now the grid and tracking of the grid is understood, you just need to figure out how to get the grid to mean something in software, then match the copycat to the grid in software.
This would then let you have hand tracking in virtual reality. This was on theory not actual implementation. For implementation I can't say what can read the bones of the hand and forearm to make the grid, thenwhat can read the copycat bones in the arm and hand. Maybe colors on the arms that then show how the fingers will wiggle?
If the arm moves outwards, then the fingers grid finger and copycat finger is understood in SW.