What do you think about brain/controller interaction? As in controlling/triggering events with your mind only?

Replies to This Discussion

Permalink Reply by Stephane Jankowski on March 3, 2008 at 11:25am

This kind of technology is the next big step in computer development. We can see in many areas how user interface disappear or is greatly simplified (iPhone, touch-sensitive screen tables-fridge-tv/dvd player/etc remote controller, ...).
See how the computer has seen a democratization huge step after Apple Mac Os / Windows 3.x have been released.

Each time you make the interaction with the computer easier, you allow more people to access it. Seems stupid to say, but that's a key in the entertaining industry we all are. We need to make products to be accessible to our targeted audience.

Imagine virtual worlds where your mind directly draw new 3d objects, paint textures, move you/your avatar (the difference will disappear at that point). Forget the UI issue that Second Life meets, everything is possible to be done, and now, everyone can do it.

First step is to understand brains signal at 100% of accuracy. Translating them into VW actions will be "easy" then.
But the most interesting step for me will be when such devices will be able to send back information to the brain. Real virtual reality will be born :)

▶ Reply to This

Permalink Reply by Robert Rice on March 3, 2008 at 11:42am

I think the technology is over hyped and the marketing is misleading. Using cheap EEG technology to move something on a screen (mouse pointer, skier going down a hill, etc.) has been around for more than a decade. There are issues with the technology (something I blogged about recently) that need to be considered for product development.

The technology measures the electric pulses and signals coming from the brain, and the software can link actions to each type of measurement, but there is no real interpretation of the signal or reading the mind going on.

Anyway, I think the earliest and best uses are going to be in the novelty category (moving a character or pointer around on a screen, or basic biofeedback games) to interacting with AR and VW objects in an intuitive sense. This, combined with highly sensitive instrumentation and smart filters, could really have an impact on our ability to break away from the keyboard/mouse limitations towards a more fluid and intuitive user interface.

In any case, Ill be interested to watch emotive and see what developers come up with. I think they have potential.

▶ Reply to This

Permalink Reply by Mark Dubin/Threedee Shepherd (SL) on March 3, 2008 at 7:16pm

I am a retired neuroscientist in a second career providing virtual reality systems to a variety of clients both in real life and in Second Life. I have followed this kind of research for years and it is only a matter of time until it becomes more than a novelty. Yes, there are issues with EEG signal quality, filtering and the like, that early adopters will need to deal with. However, the underlying concepts are sound, in my opinion. If a potential user does not have high expectations for a "mind reading device" right out of the box, this will be interesting to play with. It is obviously another "input device" for games and virtual worlds. I am very interested in seeing it adapted for Second Life and my company will look closely at the SDK that is available for it. I have put in my "reservation" to get it when it is released.

Initially, it is probably best to think of this as a "biofeedback" type device that is adding EEG analysis (albeit crude) to the mix of possibilities. Biofeedback technology is proven, if the user expends the necessary time to "train" him or herself. The product Journey to the Wild Devine http://www.wilddivine.com/ does this kind of biofeedback using heartrate and galvanic skin response to control a simple game (which I have purchased), adding EEG is a next step.

I would be interested in using my neuroscience background (and my company 3D Embodiment) to collaborate with others interested in interfacing this with Second Life (and other virtual worlds).

▶ Reply to This

Permalink Reply by Randy Brown on March 5, 2008 at 5:35pm

We have worked with Emsense technology (http://www.emsense.com) and used their biometric wireless/fluidless headsets for training applications with great success. There are many different levels of "integration" of this type of technology into gaming, education, and virtual worlds, and I think there is plenty of opportunity to apply these technologies. We were not using it for biofeedback, nor for game control, but at the biometric level to provide tracking data to real-time instructors/observers during gameplay/training. We've got to get past the input wall of keyboards/mice to provide objective data.

▶ Reply to This

Permalink Reply by Ken B on March 14, 2008 at 12:09pm

Apply this to the often separated world of disabilities ('us' and 'them') and it comes into it's own. Imagine what Stephen Hawking would/could do with this, or what reaching 'in' to the autistic mind would be like. This could be a gateway into 'their' world and not just the other way around.

▶ Reply to This

Permalink Reply by Sinderbug on March 16, 2008 at 8:42pm

I have a bit of a different reaction/perspective to offer, I am an artist who works with technology and mostly biotechnology. I think this is really promising from a cultural perspective - I would personally like to work with this technology in a conceptual/artistic way ...

I would like to see access go beyond practical and into the cultural... hmmm possibilities! I am more interested in what this might say about where we are now as a culture, what we expect and how we interpret these technologies through their practical uses. Will be watching this thread :)

▶ Reply to This

Permalink Reply by Robert Rice on March 16, 2008 at 8:50pm

Sinderbug...check this out: http://youtube.com/watch?v=d4WZpYFRhg4 Imagine that, wireless and with emotiv.

Now, wouldn't THAT be interesting?

I love augmented reality!

▶ Reply to This

Permalink Reply by Shira on March 16, 2008 at 9:06pm

While this is really fascinating, something like this is a bit intimidating. Everyone here is praising the virtues of this while no one is talking about the drawbacks.

What exactly does it do the brain?

Does it stimulate the brain synapses?

Would something like this cause/trigger epileptic seizures?

What about a slightly more insidious vein here? Implant certain cerebral activities that perhaps the average person doesn't have.

You've also got to consider the addictive aspect about this. Do they have a preemptive plan to deal with this? IE. clinics to deal with withdrawal.

And this might seem like a far reach but what about issues that might arise like in the movie LawnMower Man, Video Drome.

I may seem to have a bizarre imagination but considering this is something that affects people's brains, I'd rather appear to be paranoid here.

▶ Reply to This

Permalink Reply by Robert Rice on March 16, 2008 at 9:15pm

All emotiv headset does is measure electrical impulses generated by the brain. It's no worse than taking your temperature with a thermometer.

As far as the youtube video, the headset that guy was wearing can cause eyestrain and some other issues. Give it a few more years and we will have wearable displays that are transparent and look like glasses. Thats when *everything* changes.

Brain implants are further off. Some research been around for a long time with rats and whatnot, but I sincerely doubt commercialization of that sort of thing for at least another decade or two.

▶ Reply to This

Permalink Reply by Will Weaver on March 19, 2008 at 9:08am

I've been watching implantation, we are a ways off from that being commercial, but in our life time, yup.

"While this is really fascinating, something like this is a bit intimidating."

The lab guys told me that most people are intimidated by it.

That is just silly. It's just sensors. (I know it's vastly more complicated, I just mean it's safe. ;-) )

▶ Reply to This

Permalink Reply by Sinderbug on March 16, 2008 at 9:42pm

thats fantastic!

I am becoming pretty interested in brain linkage(?) (or is it leakage:) ... its kind of the next step which really involves the biological body...

Although I have some critiques of this work (what artist doesn't have a critique? :P) this may be of interest as well...MEART

Big fan of augmented reality as well - it is the epitome of technology/culture connection! Thanks so much for that link!

▶ Reply to This

Permalink Reply by FlashAussie on March 17, 2008 at 4:22am

Intriguing to say the least. My son has been playing around with I-doser - another form of brain play where you listen to a monotonous sound that was created by using brain reaction to certain triggers (ie alcohol) - its pretty amazing what can be done these days and yes I'd be giving it a go when I could!

▶ Reply to This