TED Talk on direct brain interfaces

Talk about Head Mounted Displays (HMDs), augmented reality, wearable computing, controller hardware, haptic feedback, motion tracking, and related topics here!
Post Reply
Mystify
Certif-Eyed!
Posts: 645
Joined: Fri Jan 11, 2013 5:10 pm

TED Talk on direct brain interfaces

Post by Mystify »

http://www.youtube.com/watch?feature=pl ... R_LBcZg_84
This talk is about research done to allow a monkey to control a robotic arm, as well as a virtual arm- including receiving sensory feedback from the virtual arm.
Potential path to a direct neural interface for VR?
geekmaster
Petrif-Eyed
Posts: 2708
Joined: Sat Sep 01, 2012 10:47 pm

Re: TED Talk on direct brain interfaces

Post by geekmaster »

Mystify wrote:http://www.youtube.com/watch?feature=pl ... R_LBcZg_84
This talk is about research done to allow a monkey to control a robotic arm, as well as a virtual arm- including receiving sensory feedback from the virtual arm.
Potential path to a direct neural interface for VR?
They are doing this suff with humans too.

A robotic hand that can feel:
http://www.youtube.com/watch?feature=pl ... 85Lpuczy3E

It's possible to hack your brain, forcing you to reveal information that you’d rather keep secret:
http://www.extremetech.com/extreme/1346 ... itive-data

We can reconstruct visual images from fMRI data:
https://sites.google.com/site/gallantla ... et-al-2011

We can record what people are dreaming about:
http://www.nature.com/news/scientists-r ... ms-1.11625

Cracked retinal coding, now a functional prosthetic eye:
http://www.ted.com/talks/sheila_nirenbe ... dness.html

Now decoding speech signals in the brain:
http://www.nature.com/news/voicegrams-t ... rds-1.9945

I have been waiting most of my life for a Direct Neural Interface. Until then, my Rift and my Hydra will be my "Poor Man's" gateway to VR.
Mystify
Certif-Eyed!
Posts: 645
Joined: Fri Jan 11, 2013 5:10 pm

Re: TED Talk on direct brain interfaces

Post by Mystify »

Yeah, we are certainly making progress. I'm always telling people that our technology is more advanced than people realize, its just not always apparent/on the consumer market yet. I occasionally have to catch myself with that too- I remember being shocked when I realized how much processing power a smartphone had.
zalo
Certif-Eyed!
Posts: 661
Joined: Sun Mar 25, 2012 12:33 pm

Re: TED Talk on direct brain interfaces

Post by zalo »

We can already do Vision (thank you Rift), and hearing (headphones). Those are easily two of our highest bandwidth senses. We also have limited control over balance/acceleration (GVS).

The last sense we need to spoof for full immersion is proprioreception (being able to tell how our limbs are oriented without looking). From there, it will be a simple matter of putting the patient into a "sleep paralysis" like state, and measuring the neuronal impulses heading toward the muscles. It still won't be cheap with all those electrodes, but at least it will be possible.

Any sense after that (smell, taste, more haptics etc.) will all be icing on the cake. Studies have shown that resistance-to-movement sensed through proprioreception is a major part of the haptic sense. The other part is merely sensation on the surface of the skin.
User avatar
twofoe
Cross Eyed!
Posts: 164
Joined: Mon Dec 17, 2012 7:16 pm

Re: TED Talk on direct brain interfaces

Post by twofoe »

zalo wrote:We can already do Vision (thank you Rift), and hearing (headphones). Those are easily two of our highest bandwidth senses. We also have limited control over balance/acceleration (GVS).

The last sense we need to spoof for full immersion is proprioreception (being able to tell how our limbs are oriented without looking). From there, it will be a simple matter of putting the patient into a "sleep paralysis" like state, and measuring the neuronal impulses heading toward the muscles. It still won't be cheap with all those electrodes, but at least it will be possible.

Any sense after that (smell, taste, more haptics etc.) will all be icing on the cake. Studies have shown that resistance-to-movement sensed through proprioreception is a major part of the haptic sense. The other part is merely sensation on the surface of the skin.
Proprioception with phantom limbs is actually something that can happen naturally during sleep paralysis. Personally, I'm able to move my dream limbs during sleep paralysis and sometimes transition into an "out of body experience" by pulling an imaginary rope. Not saying I'm actually leaving my body, just that I perceive myself as doing so. And that's all that matters, really, since it will light up the same brain areas for movement which could then be read by a BCI.

Of course if you could induce OOBs with a drug, why even bother with video games? :lol:
geekmaster
Petrif-Eyed
Posts: 2708
Joined: Sat Sep 01, 2012 10:47 pm

Re: TED Talk on direct brain interfaces

Post by geekmaster »

With a snug-fitting exoskeleton haptic feedback suit, you should be able to apply pressure in any direction to simulate gravity or weightlessness. Like floating in neutral bouyancy, perhaps...
zalo
Certif-Eyed!
Posts: 661
Joined: Sun Mar 25, 2012 12:33 pm

Re: TED Talk on direct brain interfaces

Post by zalo »

twofoe wrote:Of course if you could induce OOBs with a drug, why even bother with video games? :lol:
Because all the ones that do that are illegal :(

@Exoskeleton Any pressure force from above would be met with an equal pressure force from underneath?
geekmaster
Petrif-Eyed
Posts: 2708
Joined: Sat Sep 01, 2012 10:47 pm

Re: TED Talk on direct brain interfaces

Post by geekmaster »

zalo wrote:@Exoskeleton Any pressure force from above would be met with an equal pressure force from underneath?
Regarding the haptic exoskeleton, I was thinking that it could apply a force that you resist, like standing against gravity. Because the tug of gravity on your limbs is supposed to be how you sense gravity, perhaps the exosuit could apply force to all your limb joints such as gravity would do, essentially simulating gravity. If the simulated gravity was stronger than real gravity, you should feel the change in perceived direction.

Just a personal thought experiment. I do not know if it would actually work. I would like to try such a gravity simulation using a haptic exosuit though.

Or perhaps we can use electrical stimulation other parts of the body, similar to GVS (galvanic vestibular stimulation). If you apply enough current to enough electrodes attached to enough locations on your body, who knows WHAT you can accomplish, eh?
User avatar
android78
Certif-Eyable!
Posts: 990
Joined: Sat Dec 22, 2007 3:38 am

Re: TED Talk on direct brain interfaces

Post by android78 »

geekmaster wrote:
zalo wrote:@Exoskeleton Any pressure force from above would be met with an equal pressure force from underneath?
Regarding the haptic exoskeleton, I was thinking that it could apply a force that you resist, like standing against gravity. Because the tug of gravity on your limbs is supposed to be how you sense gravity, perhaps the exosuit could apply force to all your limb joints such as gravity would do, essentially simulating gravity. If the simulated gravity was stronger than real gravity, you should feel the change in perceived direction.

Just a personal thought experiment. I do not know if it would actually work. I would like to try such a gravity simulation using a haptic exosuit though.

Or perhaps we can use electrical stimulation other parts of the body, similar to GVS (galvanic vestibular stimulation). If you apply enough current to enough electrodes attached to enough locations on your body, who knows WHAT you can accomplish, eh?
I'm pretty sure that one of the major ways we sense gravity is through out inner ear. The same as how we detect rotation, movement, etc. This can only be truly simulated through acceleration (or gvs, neural interface, etc)
zalo
Certif-Eyed!
Posts: 661
Joined: Sun Mar 25, 2012 12:33 pm

Re: TED Talk on direct brain interfaces

Post by zalo »

No, I think he's right that tug-on-limbs is a core component of the gravity sensation. I think more than that, it's how we perceive the positions of our internal bodily organs. Wikipedia described this as an "Internal Sense". When we're laying down, we can feel our guts kind of tug towards in our body, so I think that will be really hard to fake without some hardcore neural engineering.
geekmaster wrote:If you apply enough current to enough electrodes attached to enough locations on your body, who knows WHAT you can accomplish, eh?
Cooked soylent green!
geekmaster
Petrif-Eyed
Posts: 2708
Joined: Sat Sep 01, 2012 10:47 pm

Re: TED Talk on direct brain interfaces

Post by geekmaster »

android78 wrote:I'm pretty sure that one of the major ways we sense gravity is through out inner ear. The same as how we detect rotation, movement, etc. This can only be truly simulated through acceleration (or gvs, neural interface, etc)
No, the inner ear only senses rotation when fluid moves through the inner ear canals. It cannot directly sense nonrotational force such as gravity, which sensed by the force we feel pulling on our body, trying to rotate our joints to minimize the force on our weaker muscles.

EDIT: I have since learned that the inner ear contains weighted portions that flex the circular canals in the inner ears under acceleration, allowing us to sense acceleration direction. This means that contrary to the common understanding of forces on the limbs and organs used to sense gravity, the inner ear also contributes to the sense of gravity.

A better way to look at the inner ear is a a set of three circular tubes filled with fluid, aligned to each rotational axis. When the body rotates, the tubes rotate around the fluid (mostly), causing the fluid to bend little hairs attached to nerves that sense which way and how far these hairs bend. That measures the rotational velocity on each axis. The hairs cause some friction, causing the fluid to accelerate with the rotating canals. If you rotate long enough to get significant fluid motion, stopping the rotation of the body causes the fluid to bend the hairs in the other direction, causing dizziness.

The body really does not like to feel motion when the eyes say you are not moving (such as when intoxicate and the room spins around you). This is a problem in VR too.

Gravity is sensed mostly by force pulling on your limbs (and internal organs to some degree). A simulated force that is stronger than nature may be sensed in a way that overrides the natural force, such as the direction of gravity (or acceleration). Of course, there are complications with trying to simulate gravity. The easiest way to CHANGE the direction is in a motion simulator (such as a stewart platform). To change the force of gravity, you need a centrifuge to increase it, or a parabolic (ballistic) flight path to reduce it, or some (unknown) form of electrical stimulation to simulate it.

Transitory dynamic forces (such as vibration) are much easier to simulate.
Last edited by geekmaster on Fri Sep 13, 2013 6:09 am, edited 2 times in total.
geekmaster
Petrif-Eyed
Posts: 2708
Joined: Sat Sep 01, 2012 10:47 pm

Re: TED Talk on direct brain interfaces

Post by geekmaster »

geekmaster wrote:
Mystify wrote:http://www.youtube.com/watch?feature=pl ... R_LBcZg_84
This talk is about research done to allow a monkey to control a robotic arm, as well as a virtual arm- including receiving sensory feedback from the virtual arm.
Potential path to a direct neural interface for VR?
They are doing this suff with humans too.

A robotic hand that can feel:
http://www.youtube.com/watch?feature=pl ... 85Lpuczy3E

It's possible to hack your brain, forcing you to reveal information that you’d rather keep secret:
http://www.extremetech.com/extreme/1346 ... itive-data

We can reconstruct visual images from fMRI data:
https://sites.google.com/site/gallantla ... et-al-2011

We can record what people are dreaming about:
http://www.nature.com/news/scientists-r ... ms-1.11625

Cracked retinal coding, now a functional prosthetic eye:
http://www.ted.com/talks/sheila_nirenbe ... dness.html

Now decoding speech signals in the brain:
http://www.nature.com/news/voicegrams-t ... rds-1.9945

I have been waiting most of my life for a Direct Neural Interface. Until then, my Rift and my Hydra will be my "Poor Man's" gateway to VR.
And here is another key to DNI (Direct Neural Interface):
http://medicalxpress.com/news/2013-02-brain-to-brain-interface-transmission-tactile-motor.html wrote:Brain-to-brain interface allows transmission of tactile and motor information between rats
Researchers have electronically linked the brains of pairs of rats for the first time, enabling them to communicate directly to solve simple behavioral puzzles. A further test of this work successfully linked the brains of two animals thousands of miles apart—one in Durham, N.C., and one in Natal, Brazil.
Vulcan "mind meld" here we come!
geekmaster
Petrif-Eyed
Posts: 2708
Joined: Sat Sep 01, 2012 10:47 pm

Re: TED Talk on direct brain interfaces

Post by geekmaster »

<accidental duplicate post deleted>
geekmaster
Petrif-Eyed
Posts: 2708
Joined: Sat Sep 01, 2012 10:47 pm

Re: TED Talk on direct brain interfaces

Post by geekmaster »

<accidental duplicate post deleted>

When quoting posts for another thread, I sometimes click the WRONG submit button! Oh, well, let's put something thread-relevant here in place of the previous redundant quote:

http://www.youtube.com/watch?v=0-JJuHpfN5g
User avatar
colocolo
Diamond Eyed Freakazoid!
Posts: 790
Joined: Mon Jun 04, 2012 1:25 am

Re: TED Talk on direct brain interfaces

Post by colocolo »

i wonder what knd of device will be made out of this new Nitrogen vacancy MRT.
http://abclocal.go.com/wls/story?sectio ... id=9074545
http://phys.org/news/2013-05-electron-d ... netic.html
as you think of the new achievements in imaging humans inner eye and that they will up the res by a 100 times, what will
they do with those Nano MRTs?
http://www.youtube.com/watch?v=SjbSEjOJL3U
Headcaps with intergrated Nano MRT and Nano Photonics to read out the spins?
geekmaster
Petrif-Eyed
Posts: 2708
Joined: Sat Sep 01, 2012 10:47 pm

Re: TED Talk on direct brain interfaces

Post by geekmaster »

Pulling images from your "mind's eye" off your retina was mentioned in that video. That coincides with something I read a long time ago about how 90-percent of the traffic in the optic nerve is OUTPUT data and only 10-percent input. The speculation at that time was that the brain is asking the retina "do you see this, do you see that?" and the retina is just answering "yes, or no", as a form of "dictionary based" data compression for the limited bandwidth of the optic nerve fibers. It would be VERY interesting to see a modern interpretation of this, based on whatever Mary Lou Jepsen was referring to in that video.

I find that a very interesting "coincidence", and I would love to see what more developed in that area in recent years. :D

If you haven't yet, I strongly recommend reading Davd Marr's "Vision" (one of my favorites):
http://www.amazon.com/Vision-Computatio ... 0262514621

And of course, if you missed the "PDP Books", OMG, go read them:
http://mitpress.mit.edu/books/parallel- ... processing
Last edited by geekmaster on Mon Mar 14, 2016 1:32 pm, edited 2 times in total.
User avatar
colocolo
Diamond Eyed Freakazoid!
Posts: 790
Joined: Mon Jun 04, 2012 1:25 am

Re: TED Talk on direct brain interfaces

Post by colocolo »

thanks for the recommendations. Neuroscience is more and more attracting me, especially in the context of VR.
will keep the recommend's in mind. first i have to read more about anatomy,physiology and neurons. i guess thats what
David Courtnay Marr did.
EDIT: i wonder if it will be one day possible to fully embody another body apart from humanoids. Sth like a birds body.
from what ive seen know control of additional limbs should be possible, but another Skin and the feeling of muscles?
User avatar
colocolo
Diamond Eyed Freakazoid!
Posts: 790
Joined: Mon Jun 04, 2012 1:25 am

Re: TED Talk on direct brain interfaces

Post by colocolo »

The inventors claim to stimulate theoretically every Neuron, if degenerated or not. Exciting times!
http://www.iit.it/en/news/news/1888-imp ... etina.html

By the way, anyone knew about Vitrectomy? http://en.wikipedia.org/wiki/Vitrectomy
Replacing the vitreous humour. LOL. Shouldnt it be possible then to put a µm thick sphere curved OLED microdisplay and a microcamera into an eye. Until today there is no need for such a surgery, because such microdisplays with that high res arent there yet , but in future it could be considered.
In fact, we are not that far away from:
You do not have the required permissions to view the files attached to this post.
geekmaster
Petrif-Eyed
Posts: 2708
Joined: Sat Sep 01, 2012 10:47 pm

Re: TED Talk on direct brain interfaces

Post by geekmaster »

colocolo wrote:... i guess thats what David Courtnay Marr did. ...
Hmm... I remember his name as "David L. Marr", but I see that Google says you are right. Some of those brain cells must have gotten recycled (or gone missing) after all these years... But yeah, he wrote some really good stuff... And I removed the errant "L." from my post.
geekmaster
Petrif-Eyed
Posts: 2708
Joined: Sat Sep 01, 2012 10:47 pm

Re: TED Talk on direct brain interfaces

Post by geekmaster »

colocolo wrote:... Shouldnt it be possible then to put a µm thick sphere curved OLED microdisplay and a microcamera into an eye. ... In fact, we are not that far away from:
Perhaps closer than we think:

http://www.youtube.com/watch?v=2_zk8PrlRfs
http://www.youtube.com/watch?v=ozEwH9v5Fk0
http://www.youtube.com/watch?v=-btRUzoKYEA
http://www.youtube.com/watch?v=R8sUDdLH2_Q

And guess who has "patents" on this obvious biotech:
http://www.youtube.com/watch?v=rsdImcPj5SM
http://www.realareal.com/apples-plans-f ... ns-concept
User avatar
Mitbekommer
Two Eyed Hopeful
Posts: 75
Joined: Mon Aug 13, 2012 2:48 pm
Location: German and proud of it. World, we'll be back!
Contact:

Re: TED Talk on direct brain interfaces

Post by Mitbekommer »

twofoe wrote:I'm able to move my limbs and sometimes transition into an "out of body experience"
Of course you do mate, of course.
Post Reply

Return to “General VR/AR Discussion”