News Paralyzed man, Civ 6 fan used Neuralink brain interface to play PC games and chess with his mind

vanadiel007

Distinguished
Oct 21, 2015
219
215
18,960
I think his true plans are to someday connect his brain to the neuralink, so he can eventually just keep the neuralink and live forever.

I like the guy, but I also think he's sometimes dreaming a bit too much.
 

cyrusfox

Distinguished
Agree with the authors [Christopher Harper] conclusions
There may be more promise in eye-tracking camera software that doesn't require brain surgery as well, if cursor control is really all this Neuralink is capable of.
Was hoping for more seamless direct control rather than the current stated solution. Hopefully more features are developed for these users and they survive and have a richer life due to this tech and its future advancements.
 

bit_user

Polypheme
Ambassador
I dreamed about doing something like this, ever since I saw a public TV program showing some guy steering his boat by using electrodes attached to his head. That was some 30 years ago. Can't believe it took this long to achieve the level of finesse needed for gaming, but I guess it's cool that it finally happened.

I just hope the patient doesn't suffer the same fate as so many of Neuralink's lab animals. I'd sure have reservations about getting brain surgery at a place like this:

"The laboratory problems identified by FDA inspectors included missing calibration records for instruments such as a pH meter used in one of the studies. For another study, seven instruments including a “vital signs monitor” had no record of having been calibrated. Neuralink conducted experiments on hundreds of animals, including monkeys.

Other issues included quality assurance officials not signing off on the final study report or documenting any deviations from approved protocols or standard operating procedures."

https://www.cnbc.com/2024/02/29/mus...pany-cited-by-fda-over-animal-lab-issues.html
 
  • Like
Reactions: atomicWAR

Bikki

Reputable
Jun 23, 2020
24
13
4,515
With brain interface we can do much more than controlling the cursor. With ten thousands of link channels he could literally control Jaeger in pacific rim. To compare it to eye tracking is premature. They're testing very narrow use-case for now to improve whatever tools they using for decoding-encoding, and the precision is already pretty good. Wait until you see he controls the computer faster than any human could, typing with his thought and open apps just by thinking Netflix.
 
  • Like
Reactions: bit_user

parkerthon

Distinguished
Jan 3, 2011
69
67
18,610
I think this is cool, but I’m still highly skeptical of the technology being safe. Have to start somewhere though. The first humans for everything. The risks are pretty obvious. I’m not sure knowing it failed on a few chimps by causing fatal brain bleeds would change the minds of people this intent on trying it first. They are already trapped by paralysis. They are trying to be part of history frankly.
 

parkerthon

Distinguished
Jan 3, 2011
69
67
18,610
With brain interface we can do much more than controlling the cursor. With ten thousands of link channels he could literally control Jaeger in pacific rim. To compare it to eye tracking is premature. They're testing very narrow use-case for now to improve whatever tools they using for decoding-encoding, and the precision is already pretty good. Wait until you see he controls the computer faster than any human could, typing with his thought and open apps just by thinking Netflix.
This technology is coming someday. I still think it’ll be a while. We know very little about the brain. It is quite difficult to study in a live patient with the technology we have. To that end I think this technology is still very primitive compared to what is possible with something even more fantastical such as, say, nanomachines in our blood. This method is highly invasive and dangerous whatever the results end up being. I’m sure to be the first though, it has to be amazing.
 

Trake_17

Distinguished
Jul 9, 2011
10
6
18,525
I dreamed about doing something like this, ever since I saw a public TV program showing some guy steering his boat by using electrodes attached to his head. That was some 30 years ago. Can't believe it took this long to achieve the level of finesse needed for gaming, but I guess it's cool that it finally happened.

I just hope the patient doesn't suffer the same fate as so many of Neuralink's lab animals. I'd sure have reservations about getting brain surgery at a place like this:
"The laboratory problems identified by FDA inspectors included missing calibration records for instruments such as a pH meter used in one of the studies. For another study, seven instruments including a “vital signs monitor” had no record of having been calibrated. Neuralink conducted experiments on hundreds of animals, including monkeys.​
Other issues included quality assurance officials not signing off on the final study report or documenting any deviations from approved protocols or standard operating procedures."​
Before you go all Lawnmower Man on Neuralink, those are VERY mild audit results. If you've ever been audited, every single of one of those could and probably does have an explanation like "oh, we've never actually used that device and have a process to ensure it gets calibrated before we do". You gotta know better than to take things at face value anymore. There often more QA rules than you can shake a stick at, which doesn't mean they aren't important, only that missing a couple is practically inevitable and doesn't itself mean you're generally irresponsible.
 
  • Like
Reactions: thisisaname

Trake_17

Distinguished
Jul 9, 2011
10
6
18,525
This technology is coming someday. I still think it’ll be a while. We know very little about the brain. It is quite difficult to study in a live patient with the technology we have. To that end I think this technology is still very primitive compared to what is possible with something even more fantastical such as, say, nanomachines in our blood. This method is highly invasive and dangerous whatever the results end up being. I’m sure to be the first though, it has to be amazing.
Yo, they have EEG caps that can, with recognizable resolution, reproduce an image you're thinking of.
 

atomicWAR

Glorious
Ambassador
I just hope the patient doesn't suffer the same fate as so many of Neuralink's lab animals. I'd sure have reservations about getting brain surgery at a place like this:
"The laboratory problems identified by FDA inspectors included missing calibration records for instruments such as a pH meter used in one of the studies. For another study, seven instruments including a “vital signs monitor” had no record of having been calibrated. Neuralink conducted experiments on hundreds of animals, including monkeys.​
Other issues included quality assurance officials not signing off on the final study report or documenting any deviations from approved protocols or standard operating procedures."​
This is a tough one I have some personal experience with as a paraplegic. While I would have great pause having such a surgery myself and I have had many due to my injury from carpal tunnel, cubital tunnel, spinal surgery and the list goes on...I would be extremely cautious about something this invasive in the brain.

The most problematic surgeries for me included being fitted with a Medtronic pump (twice plus a final removal...more on that in a sec) that sent medication directly to my spinal fluid allowing the baclofen that had a difficult time breaking the blood brain barrier when taken orally...to just be absorbed by my grey matter directly (brain and spinal cord) to control my spasms as I would frequently stand up out of my chair at that time and then collapse to the ground (spinal cord memory based spasm) or just spasm so violently in every muscle below my level of injury chucking myself out of the chair like a flopping fish out of water. Spoiler it was not fun and it took a long time to learn to control. Bringing my point back around as to why I'd have pause for an implant brain surgery as many of these procedures have some serious to straight up detrimental side effects they frequently don't do the best job warning you about.

I broke two of those Medtronic pumps within weeks to months of their install for example. One of those times I had ripped the catheter out of my spinal canal, was told it should have killed me from the withdrawal from baclofen as apparently it is extremely addictive when given via spinal fluid. And the second one they have zero idea why it broke. They just knew that it didn't pump dye out the catheter while doing active xray to detect it so there was no question the meds weren't making it out into my spinal canal...so yet again I dodged a lethal bullet from withdrawal they could not explain. And then there was the spinal meningitis I got when they removed the pump altogether when I refused to have a third put in, which really did try to kill me as I spent a month plus in the hospital recovering. Oh and for a bonus my spinal fluid drained every time I sat up for three of those weeks, even though I was told that was impossible...I'd either pass out or scream in pain according to the neurosurgeons if that were to happen...then a nurse saw it happen actively. The scar where they pulled the catheter out of my spine leaked spinal fluid profusely. They were shocked at my pain tolerance to handle my spinal fluid leak. I was also told later this leak was likely the cause of my meningitis as the leak gave a direct path for infection of my spinal fluid/canal.

My larger elongated point is for traumatic injuries like his, mine, etc. Quality of life considerations can sometimes make you willing to overlook potential risks from surgical intervention, even when you shouldn't ever think about it. Mexican stem cell therapy in the 90s-00s I am looking at you...popular when I was first injured but I saw it for the scam it was but some of my peers were not so lucky and it typically cost them their lives or diminished their quality of life severely and they had to pay for that 'privilege' out of pocket as insurance never covered it, for good reason (death, tumors, cancer, infections,etc).

As a paraplegic any game out there is typically playable in one fashion or another for me. Thus gaming has been a sanctuary for me as has building/repairing PCs. As someone pre-SCI I was a huge adrenaline junky...I raced on alpine skis in HS but was more known for my extremely high jumps/ cliff jumps. I loved jumping off cliff's on skis or high/cliff diving (started in 3rd grade), plus I skateboarded, rode mountain bikes, played football, soccer, etc etc. Going from that kind of lifestyle which is statistically common lifestyle among SCI patients (as is being a male 18-24...I was 20 and 21 for my spinal injuries) to a chair was a jarring experience to say the least and while I continued to do extreme sports like WCMX, football, downhill mountain biking, for some things I had to take that quality of life choice into consideration. I imagine it is the same thing for this guy. I mean hey he can game a little better now and likely play more games then he could prior with time and training.

Sometimes a short to medium term win that mostly likely ends with a long term loss is better than no win at all. So I can respect why this guy was willing to take this risk. To be fair someone has to do it at some point or no advancement would ever happen. All that said with the risk involved and track record of Neurolink as a whole, I don't know if I would have made the same choice but then again...who knows I am not a quadriplegic. Maybe if I was I'd see things much differently. I choose to take medication, for example, that ups my dementia risk because they make my pain and spasms tolerable. Its a choice many like myself are forced to make at one point or another. They are not easy choices to be taken lightly.

I do applaud this result in a patient and I hope for more/better advancements in the future yet I also fear how those desperate enough from an injury can and likely will be taken advantage of to achieve success. Now if someone has acclimated to their disabled lifestyle (typically takes 5 years according to therapist/docs) so they aren't being irrational trying to 'regain' their old life as many newly injured do, plus they understand all the risks involved (I mean all and not the extremely abbreviated cliff notes versions you typically get at best IME) and they are aware just how much of a guinea pig they're being, then more power to them. Heck I have guinea pigged a few times myself in test groups over the course of my injury with higher than FDA approved dosing on gabapentin...now approved as the new upper limit, I was in a control group for a medication test on paraplegics as I was already capable of physical function they were testing as an incomplete SCI (ie I can move with intention below my injury, much of my sensation is intact, etc) and they needed that to compare against paraplegics that were complete injuries with no feeling or movement...like a fully severed cord for example...to see if it worked for them as well as it did incompletes like me.

Anyways I look forward to seeing how this tech progresses but I do hope people won't disregard the cost in animal and human life in achieving such advancements. I fear thus far, that hasn't been the case enough of the time. Patients like this deserve out utmost respect and understanding, regardless if you'd be willing to do the same. So kudos and may the force be with him. (force mouse cracked me up)
 
Last edited:

bit_user

Polypheme
Ambassador
You gotta know better than to take things at face value anymore.
Well, I posted that link because it was more recent, but what I take at face value are the internal staff complaints about reckless use of animal testing, allegedly causing needless deaths, a little more than a year earlier.

"Elon Musk’s Neuralink, a medical device, opens new tab company, is under federal investigation for potential animal-welfare violations amid internal staff complaints that its animal testing is being rushed, causing needless suffering and deaths"

 
  • Like
Reactions: P.Amini

bit_user

Polypheme
Ambassador
Sometimes a short to medium term win that likely ends with a long term loss is better than no win at all. So I can respect why this guy was willing to take this risk. To be fair someone has to do it at some point or no advancement would ever happen. All that said with the risk invloved and track record of Neurolink as a whole I don't know if I would have made the same choice but then again...who knows.
I'm of the opinion that controllable risks should be controlled, not that zero risks should be taken. If Neuralink is cutting corners, it's not because Musk or its other backers don't have the money to keep it going, but because they're either being to cheap or (more likely) to greedy about the upsides of being first to market.

I choose to take medication that ups my dementia risk because they make my pain and spasms tolerable.
Anticholinergic? It might be possible to mitigate the risks. I'd focus on reducing other risk factors and look at interventions like this:

There have been some recent developments in Alzheimer's screening, which could alert you to problems before they become symptomatic. That might prove to be useful, since there are also new interventions involving immunotherapy that appear to be effective in slowing/halting disease progression.
 

atomicWAR

Glorious
Ambassador
Anticholinergic? It might be possible to mitigate the risks. I'd focus on reducing other risk factors and look at interventions like this:
Hadn't caught this piece thank you.

I do some dietary changes that I am not always good about, vitamins that I am great about and we do screen me frequently enough. Plus their age timed medication changes and a few other angles they work to limit your risk exposure but the stats against me and others like me still aren't great. There is a trade offs with many anti-spasm, anti-seizure, pain meds and tranquilizers used to treat some of the more severe injuries like mine, once described in an overheard conversation as the worst pain and spasm case in the US on a phone conversation between my doc at that time in Naval hospital in Bethesda and I believe a specialist over in Baltimore. Thankful as I am got better and controlling my symptoms, mentally speaking as I am a very incomplete injury, I have been lucky enough to limit my dosages to the lower end which helps more than anything as far as I have researched but there is always something new as you showed me just now.
 
  • Like
Reactions: thisisaname

TechLurker

Reputable
Feb 6, 2020
163
93
4,660
Normally, I'd welcome most advances to man-machine interfaces like this, but given it's a Musk company and their tendency to bend/break whatever rules they like in an attempt to rush a product to market, I'd instead be extremely cautious. Sure, there's always going to be a need for beta-testers, that's why we have drug and med-device trials after all, but their reported lackluster documentation and loss of key details in earlier animal trials doesn't inspire confidence.

That being said, and going slight off-topic, I'm also reminded of using targeted electrostimulation to parts of the brain to treat depression and other mental disorders, via permanently embedded electrodes and a pre-programmed micro computer that regulates the pulses as-needed.
 
while the tech is great for medical reasons like this case...EEG technology isn't anything new.

We have had devices (even down to toy level) that you put on head and control stuff with your mind.

Some people even do it to the level of playing elden ring. (example
View: https://www.youtube.com/watch?v=rIbfNUA5pWk
)

Musk's version is just an invasive version of it rather than an external version. (and it has pros and cons)
 

bit_user

Polypheme
Ambassador
Hadn't caught this piece thank you.
That site is an interesting blog. Take with a grain of salt, but reading it for a while made PubMed papers seem less scary. Now, I sometimes go searching on there, myself.

It was quite a leap for me to go right to that article, I'll admit. The first thing to do is try to understand the possible mechanisms underlying the link between your medication and dementia. If it's not due to plaque buildup, then something which inhibits that might not help you, at all. Anyway, I take milk thistle regularly, for liver health. No side-effects observed.

BTW, if you read an animal study and want to compute the equivalent human dosage, here's a handy guide:
 
  • Like
Reactions: atomicWAR

edzieba

Distinguished
Jul 13, 2016
443
432
19,060
The main form of control seems to be staring at a spot on the screen in order to move the cursor there and click. This actually sounds a lot like existing eye-tracking software, which can be applied to existing webcams without brain surgery.
This seems to be confusing a lot of media outlets: the system is not using eye-tracking for operation. Gaze tracking may be used for training if the more traditional joystick is not an option, but it is used to train the decoder system on what the intent is, not directly as an input method. Effectively, by monitoring the gaze target as the user attempts to 'think about moving the cursor', the system can learn the firing patterns associated with desired motion. As training progresses, the control of the cursor is switched over from gaze target to the BCI using input weighting, and eventually the gaze target can be ignored with full control via the BCI, allowing input intent and gaze target to be decoupled.
As anyone who has used a purely gaze-based UI, -or even a gaze + sip/puff or gaze + clicker UI - will know, gaze based input is excruciating to use in practice. It's not a magical sci-fi future interface, it's clumsy and prone to unintentional inputs because so much eye motion is completely unconscious. Being able to maintain your gaze on a gaze target in anything other than a blank environment is a skill that requires a lot of training to pick up.
while the tech is great for medical reasons like this case...EEG technology isn't anything new.

We have had devices (even down to toy level) that you put on head and control stuff with your mind.

Some people even do it to the level of playing elden ring. (example
View: https://www.youtube.com/watch?v=rIbfNUA5pWk
)

Musk's version is just an invasive version of it rather than an external version. (and it has pros and cons)
There is a massive yawning chasm of capability between mess-electrode EEG and invasive BCIs, and a similar chasm between mesh-electrode EEG and the consumer crap sold to unwitting buyers (that are basically just EMGs that measure how wrinkled your forehead is as a proxy for 'concentration).

EEGs measure aggregate currents from outside the skull, BCIs measure the action potentials for clusters or even single neurons directly. EEGs cannot feed back, BCIs can feed back (bidirectional communication). EEGs are not suitable for measurement of small muscle motion, whereas BCIs excel. etc.
BCIs are not new, Neuralink's difference is not so much in capability ('mind cursor' demos have been performed before), but in implementation. Being able to insert a BCI via a keyhole with minimal disruption to tissue is a big advance over needing to open up a large section of the skull to insert a rigid array. Recovery times should be reduced, and we see this with Mr. Arbaugh being mobile and with no protective headgear only a month after surgery.
 
  • Like
Reactions: bit_user

Trake_17

Distinguished
Jul 9, 2011
10
6
18,525
Well, I posted that link because it was more recent, but what I take at face value are the internal staff complaints about reckless use of animal testing, allegedly causing needless deaths, a little more than a year earlier.
"Elon Musk’s Neuralink, a medical device, opens new tab company, is under federal investigation for potential animal-welfare violations amid internal staff complaints that its animal testing is being rushed, causing needless suffering and deaths"​
Yeah, that sounds a bit more concerning, doesn't it