TED Talk on direct brain interfaces
-
- Certif-Eyed!
- Posts: 645
- Joined: Fri Jan 11, 2013 5:10 pm
TED Talk on direct brain interfaces
http://www.youtube.com/watch?feature=pl ... R_LBcZg_84
This talk is about research done to allow a monkey to control a robotic arm, as well as a virtual arm- including receiving sensory feedback from the virtual arm.
Potential path to a direct neural interface for VR?
This talk is about research done to allow a monkey to control a robotic arm, as well as a virtual arm- including receiving sensory feedback from the virtual arm.
Potential path to a direct neural interface for VR?
-
- Petrif-Eyed
- Posts: 2708
- Joined: Sat Sep 01, 2012 10:47 pm
Re: TED Talk on direct brain interfaces
They are doing this suff with humans too.Mystify wrote:http://www.youtube.com/watch?feature=pl ... R_LBcZg_84
This talk is about research done to allow a monkey to control a robotic arm, as well as a virtual arm- including receiving sensory feedback from the virtual arm.
Potential path to a direct neural interface for VR?
A robotic hand that can feel:
http://www.youtube.com/watch?feature=pl ... 85Lpuczy3E
It's possible to hack your brain, forcing you to reveal information that you’d rather keep secret:
http://www.extremetech.com/extreme/1346 ... itive-data
We can reconstruct visual images from fMRI data:
https://sites.google.com/site/gallantla ... et-al-2011
We can record what people are dreaming about:
http://www.nature.com/news/scientists-r ... ms-1.11625
Cracked retinal coding, now a functional prosthetic eye:
http://www.ted.com/talks/sheila_nirenbe ... dness.html
Now decoding speech signals in the brain:
http://www.nature.com/news/voicegrams-t ... rds-1.9945
I have been waiting most of my life for a Direct Neural Interface. Until then, my Rift and my Hydra will be my "Poor Man's" gateway to VR.
This work is licensed under a Creative Commons Attribution-ShareAlike 3.0 Unported License.
-
- Certif-Eyed!
- Posts: 645
- Joined: Fri Jan 11, 2013 5:10 pm
Re: TED Talk on direct brain interfaces
Yeah, we are certainly making progress. I'm always telling people that our technology is more advanced than people realize, its just not always apparent/on the consumer market yet. I occasionally have to catch myself with that too- I remember being shocked when I realized how much processing power a smartphone had.
-
- Certif-Eyed!
- Posts: 661
- Joined: Sun Mar 25, 2012 12:33 pm
Re: TED Talk on direct brain interfaces
We can already do Vision (thank you Rift), and hearing (headphones). Those are easily two of our highest bandwidth senses. We also have limited control over balance/acceleration (GVS).
The last sense we need to spoof for full immersion is proprioreception (being able to tell how our limbs are oriented without looking). From there, it will be a simple matter of putting the patient into a "sleep paralysis" like state, and measuring the neuronal impulses heading toward the muscles. It still won't be cheap with all those electrodes, but at least it will be possible.
Any sense after that (smell, taste, more haptics etc.) will all be icing on the cake. Studies have shown that resistance-to-movement sensed through proprioreception is a major part of the haptic sense. The other part is merely sensation on the surface of the skin.
The last sense we need to spoof for full immersion is proprioreception (being able to tell how our limbs are oriented without looking). From there, it will be a simple matter of putting the patient into a "sleep paralysis" like state, and measuring the neuronal impulses heading toward the muscles. It still won't be cheap with all those electrodes, but at least it will be possible.
Any sense after that (smell, taste, more haptics etc.) will all be icing on the cake. Studies have shown that resistance-to-movement sensed through proprioreception is a major part of the haptic sense. The other part is merely sensation on the surface of the skin.
- twofoe
- Cross Eyed!
- Posts: 164
- Joined: Mon Dec 17, 2012 7:16 pm
Re: TED Talk on direct brain interfaces
Proprioception with phantom limbs is actually something that can happen naturally during sleep paralysis. Personally, I'm able to move my dream limbs during sleep paralysis and sometimes transition into an "out of body experience" by pulling an imaginary rope. Not saying I'm actually leaving my body, just that I perceive myself as doing so. And that's all that matters, really, since it will light up the same brain areas for movement which could then be read by a BCI.zalo wrote:We can already do Vision (thank you Rift), and hearing (headphones). Those are easily two of our highest bandwidth senses. We also have limited control over balance/acceleration (GVS).
The last sense we need to spoof for full immersion is proprioreception (being able to tell how our limbs are oriented without looking). From there, it will be a simple matter of putting the patient into a "sleep paralysis" like state, and measuring the neuronal impulses heading toward the muscles. It still won't be cheap with all those electrodes, but at least it will be possible.
Any sense after that (smell, taste, more haptics etc.) will all be icing on the cake. Studies have shown that resistance-to-movement sensed through proprioreception is a major part of the haptic sense. The other part is merely sensation on the surface of the skin.
Of course if you could induce OOBs with a drug, why even bother with video games?
-
- Petrif-Eyed
- Posts: 2708
- Joined: Sat Sep 01, 2012 10:47 pm
Re: TED Talk on direct brain interfaces
With a snug-fitting exoskeleton haptic feedback suit, you should be able to apply pressure in any direction to simulate gravity or weightlessness. Like floating in neutral bouyancy, perhaps...
This work is licensed under a Creative Commons Attribution-ShareAlike 3.0 Unported License.
-
- Certif-Eyed!
- Posts: 661
- Joined: Sun Mar 25, 2012 12:33 pm
Re: TED Talk on direct brain interfaces
Because all the ones that do that are illegaltwofoe wrote:Of course if you could induce OOBs with a drug, why even bother with video games?
@Exoskeleton Any pressure force from above would be met with an equal pressure force from underneath?
-
- Petrif-Eyed
- Posts: 2708
- Joined: Sat Sep 01, 2012 10:47 pm
Re: TED Talk on direct brain interfaces
Regarding the haptic exoskeleton, I was thinking that it could apply a force that you resist, like standing against gravity. Because the tug of gravity on your limbs is supposed to be how you sense gravity, perhaps the exosuit could apply force to all your limb joints such as gravity would do, essentially simulating gravity. If the simulated gravity was stronger than real gravity, you should feel the change in perceived direction.zalo wrote:@Exoskeleton Any pressure force from above would be met with an equal pressure force from underneath?
Just a personal thought experiment. I do not know if it would actually work. I would like to try such a gravity simulation using a haptic exosuit though.
Or perhaps we can use electrical stimulation other parts of the body, similar to GVS (galvanic vestibular stimulation). If you apply enough current to enough electrodes attached to enough locations on your body, who knows WHAT you can accomplish, eh?
This work is licensed under a Creative Commons Attribution-ShareAlike 3.0 Unported License.
- android78
- Certif-Eyable!
- Posts: 990
- Joined: Sat Dec 22, 2007 3:38 am
Re: TED Talk on direct brain interfaces
I'm pretty sure that one of the major ways we sense gravity is through out inner ear. The same as how we detect rotation, movement, etc. This can only be truly simulated through acceleration (or gvs, neural interface, etc)geekmaster wrote:Regarding the haptic exoskeleton, I was thinking that it could apply a force that you resist, like standing against gravity. Because the tug of gravity on your limbs is supposed to be how you sense gravity, perhaps the exosuit could apply force to all your limb joints such as gravity would do, essentially simulating gravity. If the simulated gravity was stronger than real gravity, you should feel the change in perceived direction.zalo wrote:@Exoskeleton Any pressure force from above would be met with an equal pressure force from underneath?
Just a personal thought experiment. I do not know if it would actually work. I would like to try such a gravity simulation using a haptic exosuit though.
Or perhaps we can use electrical stimulation other parts of the body, similar to GVS (galvanic vestibular stimulation). If you apply enough current to enough electrodes attached to enough locations on your body, who knows WHAT you can accomplish, eh?
-
- Certif-Eyed!
- Posts: 661
- Joined: Sun Mar 25, 2012 12:33 pm
Re: TED Talk on direct brain interfaces
No, I think he's right that tug-on-limbs is a core component of the gravity sensation. I think more than that, it's how we perceive the positions of our internal bodily organs. Wikipedia described this as an "Internal Sense". When we're laying down, we can feel our guts kind of tug towards in our body, so I think that will be really hard to fake without some hardcore neural engineering.
Cooked soylent green!geekmaster wrote:If you apply enough current to enough electrodes attached to enough locations on your body, who knows WHAT you can accomplish, eh?
-
- Petrif-Eyed
- Posts: 2708
- Joined: Sat Sep 01, 2012 10:47 pm
Re: TED Talk on direct brain interfaces
No, the inner ear only senses rotation when fluid moves through the inner ear canals. It cannot directly sense nonrotational force such as gravity, which sensed by the force we feel pulling on our body, trying to rotate our joints to minimize the force on our weaker muscles.android78 wrote:I'm pretty sure that one of the major ways we sense gravity is through out inner ear. The same as how we detect rotation, movement, etc. This can only be truly simulated through acceleration (or gvs, neural interface, etc)
EDIT: I have since learned that the inner ear contains weighted portions that flex the circular canals in the inner ears under acceleration, allowing us to sense acceleration direction. This means that contrary to the common understanding of forces on the limbs and organs used to sense gravity, the inner ear also contributes to the sense of gravity.
A better way to look at the inner ear is a a set of three circular tubes filled with fluid, aligned to each rotational axis. When the body rotates, the tubes rotate around the fluid (mostly), causing the fluid to bend little hairs attached to nerves that sense which way and how far these hairs bend. That measures the rotational velocity on each axis. The hairs cause some friction, causing the fluid to accelerate with the rotating canals. If you rotate long enough to get significant fluid motion, stopping the rotation of the body causes the fluid to bend the hairs in the other direction, causing dizziness.
The body really does not like to feel motion when the eyes say you are not moving (such as when intoxicate and the room spins around you). This is a problem in VR too.
Gravity is sensed mostly by force pulling on your limbs (and internal organs to some degree). A simulated force that is stronger than nature may be sensed in a way that overrides the natural force, such as the direction of gravity (or acceleration). Of course, there are complications with trying to simulate gravity. The easiest way to CHANGE the direction is in a motion simulator (such as a stewart platform). To change the force of gravity, you need a centrifuge to increase it, or a parabolic (ballistic) flight path to reduce it, or some (unknown) form of electrical stimulation to simulate it.
Transitory dynamic forces (such as vibration) are much easier to simulate.
Last edited by geekmaster on Fri Sep 13, 2013 6:09 am, edited 2 times in total.
This work is licensed under a Creative Commons Attribution-ShareAlike 3.0 Unported License.
-
- Petrif-Eyed
- Posts: 2708
- Joined: Sat Sep 01, 2012 10:47 pm
Re: TED Talk on direct brain interfaces
And here is another key to DNI (Direct Neural Interface):geekmaster wrote:They are doing this suff with humans too.Mystify wrote:http://www.youtube.com/watch?feature=pl ... R_LBcZg_84
This talk is about research done to allow a monkey to control a robotic arm, as well as a virtual arm- including receiving sensory feedback from the virtual arm.
Potential path to a direct neural interface for VR?
A robotic hand that can feel:
http://www.youtube.com/watch?feature=pl ... 85Lpuczy3E
It's possible to hack your brain, forcing you to reveal information that you’d rather keep secret:
http://www.extremetech.com/extreme/1346 ... itive-data
We can reconstruct visual images from fMRI data:
https://sites.google.com/site/gallantla ... et-al-2011
We can record what people are dreaming about:
http://www.nature.com/news/scientists-r ... ms-1.11625
Cracked retinal coding, now a functional prosthetic eye:
http://www.ted.com/talks/sheila_nirenbe ... dness.html
Now decoding speech signals in the brain:
http://www.nature.com/news/voicegrams-t ... rds-1.9945
I have been waiting most of my life for a Direct Neural Interface. Until then, my Rift and my Hydra will be my "Poor Man's" gateway to VR.
Vulcan "mind meld" here we come!http://medicalxpress.com/news/2013-02-brain-to-brain-interface-transmission-tactile-motor.html wrote:Brain-to-brain interface allows transmission of tactile and motor information between rats
Researchers have electronically linked the brains of pairs of rats for the first time, enabling them to communicate directly to solve simple behavioral puzzles. A further test of this work successfully linked the brains of two animals thousands of miles apart—one in Durham, N.C., and one in Natal, Brazil.
This work is licensed under a Creative Commons Attribution-ShareAlike 3.0 Unported License.
-
- Petrif-Eyed
- Posts: 2708
- Joined: Sat Sep 01, 2012 10:47 pm
Re: TED Talk on direct brain interfaces
<accidental duplicate post deleted>
This work is licensed under a Creative Commons Attribution-ShareAlike 3.0 Unported License.
-
- Petrif-Eyed
- Posts: 2708
- Joined: Sat Sep 01, 2012 10:47 pm
Re: TED Talk on direct brain interfaces
<accidental duplicate post deleted>
When quoting posts for another thread, I sometimes click the WRONG submit button! Oh, well, let's put something thread-relevant here in place of the previous redundant quote:
http://www.youtube.com/watch?v=0-JJuHpfN5g
When quoting posts for another thread, I sometimes click the WRONG submit button! Oh, well, let's put something thread-relevant here in place of the previous redundant quote:
http://www.youtube.com/watch?v=0-JJuHpfN5g
This work is licensed under a Creative Commons Attribution-ShareAlike 3.0 Unported License.
- colocolo
- Diamond Eyed Freakazoid!
- Posts: 790
- Joined: Mon Jun 04, 2012 1:25 am
Re: TED Talk on direct brain interfaces
i wonder what knd of device will be made out of this new Nitrogen vacancy MRT.
http://abclocal.go.com/wls/story?sectio ... id=9074545
http://phys.org/news/2013-05-electron-d ... netic.html
as you think of the new achievements in imaging humans inner eye and that they will up the res by a 100 times, what will
they do with those Nano MRTs?
http://www.youtube.com/watch?v=SjbSEjOJL3U
Headcaps with intergrated Nano MRT and Nano Photonics to read out the spins?
http://abclocal.go.com/wls/story?sectio ... id=9074545
http://phys.org/news/2013-05-electron-d ... netic.html
as you think of the new achievements in imaging humans inner eye and that they will up the res by a 100 times, what will
they do with those Nano MRTs?
http://www.youtube.com/watch?v=SjbSEjOJL3U
Headcaps with intergrated Nano MRT and Nano Photonics to read out the spins?
-
- Petrif-Eyed
- Posts: 2708
- Joined: Sat Sep 01, 2012 10:47 pm
Re: TED Talk on direct brain interfaces
Pulling images from your "mind's eye" off your retina was mentioned in that video. That coincides with something I read a long time ago about how 90-percent of the traffic in the optic nerve is OUTPUT data and only 10-percent input. The speculation at that time was that the brain is asking the retina "do you see this, do you see that?" and the retina is just answering "yes, or no", as a form of "dictionary based" data compression for the limited bandwidth of the optic nerve fibers. It would be VERY interesting to see a modern interpretation of this, based on whatever Mary Lou Jepsen was referring to in that video.
I find that a very interesting "coincidence", and I would love to see what more developed in that area in recent years.
If you haven't yet, I strongly recommend reading Davd Marr's "Vision" (one of my favorites):
http://www.amazon.com/Vision-Computatio ... 0262514621
And of course, if you missed the "PDP Books", OMG, go read them:
http://mitpress.mit.edu/books/parallel- ... processing
I find that a very interesting "coincidence", and I would love to see what more developed in that area in recent years.
If you haven't yet, I strongly recommend reading Davd Marr's "Vision" (one of my favorites):
http://www.amazon.com/Vision-Computatio ... 0262514621
And of course, if you missed the "PDP Books", OMG, go read them:
http://mitpress.mit.edu/books/parallel- ... processing
Last edited by geekmaster on Mon Mar 14, 2016 1:32 pm, edited 2 times in total.
This work is licensed under a Creative Commons Attribution-ShareAlike 3.0 Unported License.
- colocolo
- Diamond Eyed Freakazoid!
- Posts: 790
- Joined: Mon Jun 04, 2012 1:25 am
Re: TED Talk on direct brain interfaces
thanks for the recommendations. Neuroscience is more and more attracting me, especially in the context of VR.
will keep the recommend's in mind. first i have to read more about anatomy,physiology and neurons. i guess thats what
David Courtnay Marr did.
EDIT: i wonder if it will be one day possible to fully embody another body apart from humanoids. Sth like a birds body.
from what ive seen know control of additional limbs should be possible, but another Skin and the feeling of muscles?
will keep the recommend's in mind. first i have to read more about anatomy,physiology and neurons. i guess thats what
David Courtnay Marr did.
EDIT: i wonder if it will be one day possible to fully embody another body apart from humanoids. Sth like a birds body.
from what ive seen know control of additional limbs should be possible, but another Skin and the feeling of muscles?
- colocolo
- Diamond Eyed Freakazoid!
- Posts: 790
- Joined: Mon Jun 04, 2012 1:25 am
Re: TED Talk on direct brain interfaces
The inventors claim to stimulate theoretically every Neuron, if degenerated or not. Exciting times!
http://www.iit.it/en/news/news/1888-imp ... etina.html
By the way, anyone knew about Vitrectomy? http://en.wikipedia.org/wiki/Vitrectomy
Replacing the vitreous humour. LOL. Shouldnt it be possible then to put a µm thick sphere curved OLED microdisplay and a microcamera into an eye. Until today there is no need for such a surgery, because such microdisplays with that high res arent there yet , but in future it could be considered.
In fact, we are not that far away from:
http://www.iit.it/en/news/news/1888-imp ... etina.html
By the way, anyone knew about Vitrectomy? http://en.wikipedia.org/wiki/Vitrectomy
Replacing the vitreous humour. LOL. Shouldnt it be possible then to put a µm thick sphere curved OLED microdisplay and a microcamera into an eye. Until today there is no need for such a surgery, because such microdisplays with that high res arent there yet , but in future it could be considered.
In fact, we are not that far away from:
You do not have the required permissions to view the files attached to this post.
-
- Petrif-Eyed
- Posts: 2708
- Joined: Sat Sep 01, 2012 10:47 pm
Re: TED Talk on direct brain interfaces
Hmm... I remember his name as "David L. Marr", but I see that Google says you are right. Some of those brain cells must have gotten recycled (or gone missing) after all these years... But yeah, he wrote some really good stuff... And I removed the errant "L." from my post.colocolo wrote:... i guess thats what David Courtnay Marr did. ...
This work is licensed under a Creative Commons Attribution-ShareAlike 3.0 Unported License.
-
- Petrif-Eyed
- Posts: 2708
- Joined: Sat Sep 01, 2012 10:47 pm
Re: TED Talk on direct brain interfaces
Perhaps closer than we think:colocolo wrote:... Shouldnt it be possible then to put a µm thick sphere curved OLED microdisplay and a microcamera into an eye. ... In fact, we are not that far away from:
http://www.youtube.com/watch?v=2_zk8PrlRfs
http://www.youtube.com/watch?v=ozEwH9v5Fk0
http://www.youtube.com/watch?v=-btRUzoKYEA
http://www.youtube.com/watch?v=R8sUDdLH2_Q
And guess who has "patents" on this obvious biotech:
http://www.youtube.com/watch?v=rsdImcPj5SM
http://www.realareal.com/apples-plans-f ... ns-concept
This work is licensed under a Creative Commons Attribution-ShareAlike 3.0 Unported License.
- Mitbekommer
- Two Eyed Hopeful
- Posts: 75
- Joined: Mon Aug 13, 2012 2:48 pm
- Location: German and proud of it. World, we'll be back!
- Contact:
Re: TED Talk on direct brain interfaces
Of course you do mate, of course.twofoe wrote:I'm able to move my limbs and sometimes transition into an "out of body experience"