[00:00:06]
>> All right so it's my pleasure to introduce this weekend many of us know him already Lewis has been a real champion for neuroscience here at Georgia Tech leading the some really cool research initiatives and most recently in fact today he says in the process of submitting a major developmental grant for sciences here at Georgia Tech with both the focus on new research directions and its focus on increasing diversity equity inclusion in the sciences sense and really championship work on that I think it's very impressive that he's giving us a seminar the same day that this huge many 1000000 dollar age managers do so we're waiting to happen what we hear from today though is Lewis is really incredible research and I'm really excited to sort of get a new insights into the direction that it his lab is going like a lot of us here he has an interest in the aspects of Notre Dinero science but sort of a very different scale than like what I and others some folks do focusing on skill.

[00:01:10]
Movements especially in the upper extremities and on rehabilitation he came to Georgia Tech in 2008 after he had his Ph d. at the University of Maryland. And worked with the n.h. and since then he's been directing this lab here and doing some really great work the also is affiliated with the rehabilitation at Emory as well as being part of our biological sciences department so Louis it's a real pleasure to have you we're looking forward to your talk and I'll be collecting ask questions on chat like we've been doing in the previous weeks and the silicate those at the end and I really like today to the 1st question come from Michael actually stupid or her stuff that I'll be asking for a graduate student or a put stop to ask the 1st question all right let's go ahead and take it away.

[00:02:01]
From him and great to be with your. Being in this virtual space. It's good to always talk science as well so today I'll be giving a bit of a summary kind of a bit of a historical summary but also kind of leading up to some of the work that we're endeavoring looking at this very well known network this parietal front of networks that have been really well established or were characterized in humans in understanding motor control or motor planning always try to make sure people know that you know all of the workers in here in many ways don't do cellular or or you know non-human primate or or any other bottle system all of our work focuses on humanities and really trying to span and basic science and translate those things into motor rehab principles and sort of they will be talking a good bit about.

[00:02:57]
One of the things that's really interesting when you go back and I'm always a fan of of the history of the field of neuroscience is when you go back to a fairly recent history really in the eighty's into the ninety's you see this explosion of studies that are really driven by some clinical questions will researchers and some of these researchers if you're in the field of truly motor control or motor control in general many of these really Bain's will ring a bell These were people that were back in their post that Toro in the in some cases credit student days doing imaging studies on where they were and in this case here this is very classic work where using.

[00:03:45]
Pet imaging approaches look at areas of the brain that singular or evolve the motor imagery the impetus of this research was really focused on clinical questions that we're trying to understand where in the brain are people having or do people internally plan motor control are relative to injuries that can result in motor planning deficit and one of the principal findings of a lot of the study is innocent pretty common finding is that particularly over the left hemisphere in motor and premotor areas particularly on the more eventual surface you see these activation patterns and related work on the other side of the screen in school very classic study Martin Leslie Ungerleider Jeems x.b. where they were really interested in very similar brain areas in this case here looking at the role of tool use and recognizing that there were certain parts of the brain particularly again in some of these same areas particularly the pre motor cortex in the left hemisphere.

[00:04:57]
That were also active for tool use and even in this paper they reference this other work here indicating that you know that same area that was active promoter in measure to use was also engaged in this knowledge or I'm sorry the same areas that were involved in murder imagery are also involved in tool use in this idea really start to blend together of that in a maybe because left frontal area isn't as well including into the private a little.

[00:05:30]
Very active in the ability to encode motor skills in human behavior that's like way beautifully into the explosion of what you might refer to sometimes as Mirror neurons these neurons in various parts of the brain are as indicated here in the private although particularly in the area that we sometimes referred to as the poster Prado cortex if you do invasive recording here and in in this monkey and in this region but in the similar things in frontal areas particularly around the arc you focus on the spur of Arculus Orcus in the ventral premotor cortex you can find these neurons that are active when a monkey either performs or observes the performance of certain grass being or motor control or object related or 2 related behaviors and so in this case this monkey reaches and grasps to an object with their hand and what you see here is this activity probably for the reach to grasp and similarly here before extending the arm to pick up the piece of food and some things idea here is that not only can these same areas be involved in the actual performance of the task but even the observation and so if you were to characterize a bunch of these neurons in Monkey one in Monkey 2 you would see various populations of neurons that are involved in certain behaviors right where there's object based biological motion driven space driven or things like that and so this kind of generally with this idea of the importance of the mirror neurons system and in connecting this permanent work to the human work that was really bubbling up at the time you see this explosion really of studies in human or imaging that link to pride of from lawyers and their relationship to upper limit of control and so much so.

[00:07:29]
There it's almost become the default thing to far even as some of our studies of our just kind of go through some of our prior work whether we're using noninvasive or invasive methods to understand human brain understanding action judgments usually involves left parietal funnel systems whether it's motor predictions tools these are different slice but again you see frontal and parietal areas heavily involved in this task in this particular case there's left investment by us similarly in some of our order work the grasp ability of tools to selection and even using intracranial recordings we've shown that reach to grasp of tools in objects shows the similar patterns of neural activation when you're reaching particular with a contra lateral length as opposed to the epsilon or a limb or pretending to do just showed or movements or just simple wrist movements there are leaching movements so these left parietal formal systems and these activations abound that people sort of sort of in your studies and even other studies that have talked about made some you know casual inferences about what's going on but this is a problem that all of us in human rights science deal with because we really don't have a strong idea still what this activity really represents it's really hard to nail down.

[00:08:59]
Exactly what's going on in the systems and so one of the things that has been kind of an overall focus and interest of mine over the years is taking a step back and looking at. The question of what's going on in the systems using multiple approaches and really the centerpiece may still be neurophysiological in your time who approaches that we commonly use in human brain imaging such as Lecturer Cephalon graffiti were capturing voltage related or from.

[00:09:29]
Ation from the scalp or we're doing functional magnetic resonance imaging what we're looking at changes and in oxygenated the oxygenated blood flow in various parts of the brain but we also want to understand how these neural changes relate to certain biomechanical findings and also even computational theories about how motor control works and try to leverage tools and paradigms to connect all of these things right and see if we can really get a better sense as to what's going on particularly these products from the circuits if we're looking at the problem kind of from both directions so today I'm going to talk about 3 themes not necessarily individual studies but 3 themes here of work that have gone on in the lab over the last few years to try to understand.

[00:10:20]
Aspects of motor control related to how we think about what's happening within the prior formal system. We'll look at the 1st my former grad student Nick who's at u.c.s.d. you see. Good grief just like the city maybe he's in California now doing some good work out there looking at prediction of judgments of action goals Bill q. sec who's now at Facebook actually you know really cool.

[00:10:54]
There was really cool work up there and his work looking at perception of action coupling from 0 to learning and Crystal topping who's really doesn't beautiful work on perception action related to skilled skill learning and skill to actually development. So to really understand what's going on into almost explain where this is going before you get started well we're going to think about the idea of movements of the one of those things have been really well study over the years when it comes to motor control and particularly motor control related to the upper limb and this is a very classic study and I don't want to get too deep into the weeds on what this study and studies like it have tried to take a look at but one of the things here we see with with this particular work we are when you have to you know back and forth between targets and then subsequently you have to reach to a target and work your way back without visual feedback that your eyes tend to predict basically the future direction of your hand right and so the idea here to put it in a very crude sense is that your your eye is sort of leading your hand through time and space right in that you know as you're reaching you're engaging with the creature is kind of step wise it thing it's.

[00:12:17]
Where you're going to go and they primarily are in line with the direction of your reach as well so most of the the reach displacement your eyes tend to go to the same displacement of their reach so we wanted to understand and or use movements as a window into understanding certain things about motor skills in tool use and to observation and that really led to some thoughts about what is going on potentially within the parietal from the system for start with a very simple behavioral paper this is a behavioral study and it was done in collaboration with an apology in Rome who was really interested in doing some studies to understand certain aspects of tool use and to use context and what we did in this work.

[00:13:14]
Well as we start with a very basic image where we ask people here's an image and this is an example he can't quite see it it's just a spoon or scooping spoon and there's like a tub of ice cream here and you're asked to say is this to an object pairing correct right very simple and we know that wasn't the only image obviously showed other images in this case there was a hand in the picture and a functional grass meaning that the grass suggested that you were going to mention it maybe handle for the purposes of scooping out the ice cream or were Colonel Rick what we call an initiative grasp in this case where you grasp a whole in of the spoon which is not very helpful for scooping out ice cream you'll make a mess that way so this is kind of a interfering grasp to the overall tool usage.

[00:14:11]
Carry this context a couple different ways where we also put it in in correct context and way that doesn't afford natural action in this case here there's a tennis ball in the scene and a spatial sense if you can't quite see this is a sugar packets and so it's not uncommon to see a sugar packets and spoons in the same setting you don't necessarily use them together but they are very commonly associated with each other and so the task is simply to evaluate the 2 object relationships correct the important part about this is the hand is immaterial to that judgement right it has no bearing on the judgement of the of the usability of the tool on that object in the same.

[00:14:55]
So the findings behaviorally with that reaction time and we look at reaction time 2 ways reaction time with hands how long does it take you to press a button to determine whether or not one. Whether or not the context of the image is correct and as well we had people separate group people make the same promising test with their feet and so neck a foot switch reaction and the idea of the motivation behind that is if you if something is perhaps confounding for the hands there is a sense that behavior with the hands can be affected but behavior with the feet is actually not affected and that basic thing is what we.

[00:15:39]
See effects when they were Hanjour them but not when they were driven by the foot but was the basic reaction the basic result suggested that when objects particularly were shown in a. Spatial context. Decisions about correctness or incorrectness were always longer than when they were in the more appropriate functional context you're able to make those decisions a lot quicker.

[00:16:09]
Who likewise importantly. The manipulative grasp Posterous of the pastor in this case here grabbing the coffee pot by some other space than the handle which is very a typically done that tends to elongate reaction times in these individuals and again the hand has nothing to do with the decision that's a very superficial artifact there's nothing to do with the actual behavior.

[00:16:38]
Forgive me if I'm here dog barking in the background dog arrivals about in our neighborhood so. This really was fascinating to us and it led us to really think about what's driving this behavior so. Most exciting news that the good of this experiment is really based on how you perceive the visual stimulus as a matter of floor for us was to look at well let's look at vision so we take the same experiments also structure and let's add eye tracking and see what happens as people are looking at the same stimuli and now we're in for a something about the case so here is kind of a model of how we looked at this we kind of separated out each one of our 2 object pairings based on looking at areas of interest in this case here is the object and then we looked at both ends of the tool and we also included factors like the hand the arm and even nor space we modeled that in but really for the purposes of the reporting in the paper has those other no spaces didn't really matter so much statistically really modeled out their gaze patterns looking at not only gaze with an n a o I so gaze shifts around a single area of interest but also in combination of those 3 or at one point we have even up to 10 potential areas of interest that we were looking at we really pruned down to the 3 in a data driven way.

[00:18:09]
So this is a characterization of what you can see if if you were looking at particular this object that we were looking at the hit count basically of being in any one space this is the typical games profile for most people they will start out the object in there will be a drop off where they were hit the manipulative tool in which is this end up here where again this is the the thing that is going to operate on the object and then they will drop the function of the back ups and manipulative and then swing over to the objects of is this is what we're really cared about we don't care so much about the latency and or uncertain the duration we care more about their patterns what were their gaze patterns and was there anything interesting about the patterns that was ultimately predictive about behavior.

[00:18:54]
So if we were to track their probability over time looking at each one of these 3 spaces in the correct mill hand condition we see here that people tend to as we almost expected they look at the object 1st and that probability drops off and then quickly there probably goes up here looking at the manipulated in remember the Manipulate if it does appear so basically in this case their eyes are going back and forth between these 2 features and the handle which is black structure this black one here really never comes as a point of interest at all and so for the mark of this out using this trajectory space here we're able to describe the bias the photo bias for each area of interest for each condition so for no hand in the correct context we see it as a bias away from the the handle but more towards the object and the kind of operate in that object to manipulate pool in this kind of space here is a point of equivalence statistically where you know there's equal probability of being any any one space and time now in a functional context so again here the person is grabbing looks like they're grabbing the handle and again importantly the only decision you have to make is whether or not the tool in the object are aligned together and what we see is gazin mediately starts to shift down to follow where the hand is right so it biases a little bit more towards that end getting a little bit closer to equivalency between all areas of interest and in the manipulative space it's pursuing was right back in them most of the biases towards the manipulative in the object but there's very little attention really ever driven to the handle This is actually very important for us because a lot of studies related to coding in mirror neuron.

[00:20:54]
And I have always suggested a real importance of Tool object into object ructions of seeing the hand and engage with the tool in effect that we did not see this as a principle area of interest in any of us that is actually very intriguing and a point that will come back to.

[00:21:17]
Hear. Now we then hire her course during analysis of this and one of the things that's really kind of fascinating others quickly point out is that really the type of grass is what separates out the cluster so if you are manipulative grasp no hand grasp or functional grasp the Is all have a heavy preponderance of clustering how these different categories of case we look at.

[00:21:46]
The scale how one of those distance for each one of these contexts now what we wanted to build upon here was well let's think about this from an aural point of view Now let's add in some of the brain imaging to think Ok now that we understand something about the fact that their gaze is difference depending on which object or scene you're looking at Qantas tell us something about the underlying parietal formal circuitry that we're seeing and so we designed a study where we actually just looked at them the no hand functional manipulator of grass conditions looking at correct and correct and spatial tool use right so this these kind of 3 by 3 grid of critical tools only model the study in 2 ways in the 1st experiment participants.

[00:22:35]
Really. Weren't able to see the images long enough to make a fix to make us a car so that was a 100 milliseconds spareness of the image really flashed up 400 milliseconds and it went away and we have posited that we'd be able to inhibit store that condition.

[00:22:54]
But that it would not affect their actual behavior Similarly in experiment to the stimulus on the screen for $500.00 milliseconds long enough to make 2 maybe 3 sick crowds to evaluate the the areas of interest was really nice about this is that we look at their behavior because we do ask was there to object pair correct or incorrect.

[00:23:16]
There was equivalent accuracy regardless of the 100 or 5 of those things but somehow using poor for vision they were able to capture enough information to make the decision in the 100 the 2nd time little we know this because we can look at their vertical viewing angles here and note here in the 100 milliseconds experiment most of their fixations and.

[00:23:41]
Are lined up in this no space where there was a fixation cross so we can verify that yeah there was no gays that really shifted away from that but in the 500 milliseconds Spearman we can see that basically they would go back and forth as quickly as they could between the object and the 2 importantly as well this upper area is aware that manipulate it in there isn't the handle is always down here you see most of the gaze is kind of going this up which object will quantify that here a moment.

[00:24:14]
As well we can also see that you know most people they could make us a car within about 10200 milliseconds in this problem most likely time intervals enough to make a 1st and perhaps a 2nd because tended to always go to the object in the interiors or to.

[00:24:32]
Still verifying what we have seen before now I wouldn't normally show what I'm about to show in the video but I can't because I don't want to have problems with video recordings on this platform but I'm going to I'm going to kill you with with head maps here so I will explain the in another image but I just want you to see what we're able to see and where the next data that I'm going to show you comes from so in a 100 milliseconds spearmint we're able to look at these are these are every 10 milliseconds starting at 30 milliseconds after the stimulus comes on they were able to kind of look at 10 millisecond steps all the way through the experiment from a 500 milliseconds experiment we're able to do the same thing again these are maybe the 1st 3 right after the stimulus shows up and then we kind of fast forward time a little bit 355 in on remembering the fact that the stimulus is still on the screen from a 5 in the 2nd experiment that is going away for the 100 most are struggling so what's the takeaway here what we really want to see here was is there some vulnerability of these private all their frontal areas to be able to fight with these Tool object images based on this structure based on experiment that we set up and so we look at for example their role that grass plays what we see in this is a different representation we've taken the significant activity of each electrode over time.

[00:26:05]
And lined it up and so here what we have is the funso or the lower numbers being worked with back to the central electrodes in the prior lexical lecture woods are here in the higher numbers of basically been told to post earlier lower numbers a higher number in rank order what we have here is the main effect of hay and so with the grass type really you see that activity coming in or about you know.

[00:26:31]
15200 milliseconds after the stimulus onset in the 500 milliseconds experiment we see these 3 phases of activity and basically to summarize it goes from pride all the frontal parietal right and it kind of coincides with these the cards which was kind of fascinating to us as a My 1st question to Nick really was you know are this isn't some kind of funky artifact here what's really happening here because usually with these artifacts can be a big problem and so ending is kind of the answer that question on one level we said all right in the 500 most I can experiment list what are the condition based differences and what we see here is that particularly over frontal areas other manipulative grasp condition has tremendously more activation compared to the new hand condition and also there are some subtle condition differences as well in the pride a little bit the frontal lobe in particular is where we found most of the effects and so now I still have this question Is there some weird iron movement pattern that may be picked up.

[00:27:48]
As an artifact in the signal that we're not accounting for and so now if we look at it through the lens of context so it's correct and correct spatial what we find here is that regardless of it being the $100.00 or the $500.00 milliseconds spearmint we basically see the same activation coming up over frontal and mid parietal and parietal areas around the same time around that $500.00 millisecond time period if the suggest to us that the effect that we're seeing over here it couldn't be driven by and I move an artifact because we store the data just in a different way that if it was an artifact it would still be robust in this in this consideration but what we're really seeing here is modulation of the parietal follow activity in particular for what city when people.

[00:28:42]
Are engaged in you know understanding this grasper related behavior so whether or not it's in the relation grasp or functional grasp things distinct from understanding the direct or the distinct to use properties as well and seems as though the final activity may be related to understanding something about strategy or intent of the behavior that is going on and so this kind of dual representation of perception action coupling and after activation really got us excited and got us thinking about some things really it's a rehab the rehab space and so on transition that I think about this these studies from the rehab space in really realizing that a lot of motor rehab does focus quite a bit on the idea of actual observation indeed there's even a brand of rehab call action observation based therapy where individuals can win in this case here you can stare at a screen or stare another person in real time in real life performing an action in the intent is it that visualization of that action will help there are plenty of studies that suggest that actually observation alone or actual observation along with motor injuries are helpful and robust to teaching people how to perform motor control tasks.

[00:30:11]
In certain settings whether they are trying to recover from a stroke or in recovery more control after stroke but also in speech there's a lot of work in this with speech therapy to demonstrate or visualize how to develop speech sounds and with those that visualization can then help infer something about how these people should be performing their speech motor control.

[00:30:37]
Now in our case one of the things that we're particularly interested is upper limb every Taishan or limitation is fascinating because it changes not only body more from a tree so now you've you're missing part of a limb you also have lost the sensory feedback from that live as well component of reestablishing motor control tends to involve the use of persistent eclipse artificial limbs and so we started to wonder is there something unique or unique opportunity for action observation in the situation where somebody has an upper limb amputated if some of our previous work we've actually suggested that the visual system may actually be very well positioned to support motor learning after a virtually loss in a small quarter of a cohort of individuals we recorded their neural activity using electricity for a larger theme Well they basically perform to reach the target reaching movement with their upper lip and we compare this with individuals that were sound that were either right or left hand.

[00:31:48]
All of the every 2 years in this particular population were formally right handed dominant in they all lost their right limb and so we wanted to see really if there was a switching of their functional dominance as a relates to this or that question quickly got to play it based on this based on the results that we found.

[00:32:08]
And the results are pretty straightforward effectively here if you're a right handed person performing a task with your right arm we see most of the Activation is in the left motor cortex very expected if you do something with your left arm and your right hand it is not an amputee but your left handed you're also going to do things and motor planning is going on while both his figures that's very much expected likewise that pattern switches if your left hand on your left hand dominant you tend to be moving your right arm it's into the game is more about lateral activation motor planning but when you're moving your dominant army 10 to engage in more contra lateral motor planning behavior but we start every t. is really kind of stunned us a little bit these are formally right hand a p.t. is when they move their left arm they show motor planning activity that looks much more like left handed on the individuals that we look at their f u t's a lot more motor planning involved in post area parietal brain areas pride occipital areas in particular.

[00:33:18]
So that led a lot of work that we've been doing over the years it's really hard if the heart of the visual system to promote these functional improvements is there a way that we can actually do that and through many studies that we've done in the lab as you see there we model this idea to really use Action observation therapy and to really focus in on this idea that a strategy mentioned there before is there are there strategic benefits to really being able to understand or see how another person is user isn't gauged in motor task because it is so different from a biological weapon and so in this case here we created these 2 conditions where somebody has somebody using a prosthesis watches somebody engage in biological imitation which is mismatched versus prosthesis imitation which foreign entity would be the matched limb training and the summary of this is that there is a big difference between the 2 and effectively the prestigious user if they are watching another person is usually doing a task they basically mirror exactly what they see in this case this would be what the prestigious user sees and what this is really without getting into are the nuance here this is just an angle angle representation of the relationship of the shoulder and the elbow moving together in time with a task and so for somebody with sound limbs which is in gray that you would see kind of this shape I don't worry about what that shape represents every person has actor you it's kind of see the shape this relationship so different slope between us too.

[00:35:02]
What the participants do if they are a person the assess if they're imitating another person's use or their angle lingual a ship from the shoulder and elbow begins to look a lot more like the prestigious actor however when they're trying to imitate an intact limb they are still going to try to perform the action the same way the internet person does which is we've see in a lot of our studies is highly detrimental they actually perform very poorly with it you know by mechanical and other behavioral constraints so this really got us excited and we wanted to dig into a little bit more to why what's going on within this structure that allows this to happen so a group of students in this case my crystal really wanted to understand the role for the visual system in supporting this and that actually in training again if you're looking at something there's probably a visual patterns of how you're looking at it and so what we did in this study was we took procedures users and we assigned them to one of 2 groups either matched limb observation or mismatched limb observations and in this case here they are they watched a user take a desk move it over a barrier and place on the other side very simple very boring task right and then once they watched it they were also then supposed to perform the action and it isn't 3 different blocks All right so you observe for a little while and then you perform the task you lean you serve for a little while and you perform the task you observe from 0 to one that just depending on which group you read.

[00:36:45]
And one of the things that was really exciting for us when we started to look at the case patterns we have several areas of interest we were interested in how they use their shoulders the showed was a very important for this particular task because really the shoulders are flexion of the shoulder is what controls the actually of the percent eclipse so if you flex the shoulder it pulls a cable system you can kind of see the cable here it pulls this cable it causes the press that it went open quote This is a very specific skill that takes a good bit of time to actually learn how to do it control and is incredibly unique the person is learning because if you're doing this with your hand you will probably not use or shoulders very much for this particular task we were also interested in looking at visually where do their eyes go.

[00:37:35]
You have to be able to clear this barrier so are interested in their ability to kind of watch the gaze clearing the barrier but there's an alternative where you can basically just go between the 2 targets between the star in the importance of the action and to summarize what we found is here.

[00:37:53]
In this case for the match live users their eyes really clear that barrier and go back between the start and importance of the action or the mismatch condition they're really just going back and forth through the board games to the board which is actually not possible biomechanically you can't move the disc to the board and the fact that they're observing the action crossing the board suggests that they're picking up on some subtleties of their movement in action observation that may be helpful in controlling their behavior the question is Is it true well when we look at their care and that it behaviors we're interested particularly in a couple things remember they have to go over this barrier and one of the things that we are interested in is looking at their peak height so this is basically a.

[00:38:44]
Kind of code before it's like an estimate of risk how close are you willing to get to that barrier to make your grasp of the movement efficient and notice here that mismatch users they basically have the same peak height across tasks between trials However the matched group they tend soon get a lot lower and they they have a significant decrease from trial one to trial 3 a good son or 4 optimizing movement as well as the fact that while their peak height is dropping their velocity is going up and so they're very interested in not only engaging in the riskier height but they're also happy to move faster as they're employing that he'd like was we also see a subtle decrease in the amount of people lateral trunk movement in the Match Group which is also quite fascinating.

[00:39:41]
As well and continued analysis that we're looking at here particularly looking at the they're looking at their shoulders their ability to look at the shoulders this seems like there showed there are or the probability of them looking at their shoulders I'm a correlate with their peak velocity so the more you're looking at the higher probability I should have a look at those shoulders which may help confidence while you're making movement and while you're moving your body through this task it may correlate to improvements in that people Ossie to help support more control and more alert.

[00:40:19]
But I haven't talked much about the normalcy of this from a rehabilitation point of view and that's what we're kind of working at right now one of the things that was really exciting and I mentioned it subtly before is that a lot of the actual observation based approaches have been merited it or somehow associate it with the finding of mirror neurons and thinking that we are norms that was driving these representations of how to perform movements but it may not be a simple as observation alone but maybe how it actually is being observed and what parts of the visual scene are you grabbing together and how is that helping to support prior frontal activity in the brain it's Ok is maybe a powerful tool in modulating this parietal from like 30 during actual observation if some of our preliminary data that I have a show here seems to suggest at best exactly what's happening and it seems like it's happening based on an implicit strategy development for motor control and more alert and while you're looking at these behaviors you're implicitly extracting out information that's going to help support your performance is very similar to what we think we're seeing even with those static images of 2 objects in context with the head as gaze is differently organized about that that is a process that we did not ask the participants to do.

[00:41:51]
This is something that just emerged because it developed as they were gathering information about the perception of the tools and actions that they were looking at. It's a discipline it leads to a question that we've been looking at for several years now and we're starting to begin to understand a little bit more this game is changing maybe just gaze change alone help shape or form of activity to prime mover learning is it possible that during these action observation based approaches whether it's in a rehabilitator sense or in a basic motor learning or development sense that those experiences alone just savation phase is enough to shape these Corrado from networks there are several studies that are starting to emerge in also showing very similar findings looking at.

[00:42:43]
The ability for example to observe what say a simple movement like this which may act of a or cause cortical spinal activation differences for the muscles that are involved in that movement but not the muscles involved in this movement right and so the idea here is that even at a quarter spinal level.

[00:43:03]
You can prime the motor system based on the specifics of what you're looking at not the general sense that you're looking at something through a case of upper limb motor control and prestigious or this there's been a lot of work looking at motor learning to support person this is use and also a lot of work in developing more as biologic person is used to support usability and attention which are all extremely great but maybe we've been missing Ellen the potential of another sensory system the visual system to actually support functional learning with prestigious is really an education there.

[00:43:42]
So that's kind of where a lot of our work is going now to try to understand some of those processes. Just by way of conclusion the good old wall of text here it seems as though we have that gaze behavior you know can help predict judgments related to action goals so we can actually run a lot of those studies that I mentioned earlier the top to be able to actually predict exactly what image people are looking at these days patterns are incredibly robust to prediction but it's possible that we can predict these goals and that somehow these private or from old mechanisms are involved in doing that and this activity may be influenced or influence Gay's behavior we trying to understand that directional coupling right now ever tickly how it may be useful to know rehabilitation approaches to really help to understand what's driving these changes in the circuits this is something that's very important to me knowledge in the good collaborators that I haven't mentioned particularly in the development of Action Coding and a board in who is now in Rome who does do a lot of work with her related to this as well studies that we've been looking at with development of motor development action syntax looking at it from the lens of an apology which is a lot of fun to talk about that but I'd be more than happy to share that at another time is that mature is a little bit more we start to get publications out and also looking at the work in every season we're learning between colleagues in mechanical engineering in the clinical sector and also by Georgia State in those collaboration's also with that I will and thanks so much for the attention and and happy to answer any questions.

[00:45:44]
Very So there's lots of virtual laws going on in another disadvantage of this framework you can't hear the wall but they are there that very few turn out for the seminar series Thank you all for continuing to participate what we're going to do now we have plenty of time for questions again I would like to tell us as much in from a stupor but start 1st but while we're doing that I'm going to have people can either write their questions in to chat or they can raise their hand with a little raised hand function that I'll call on them but before we go to the questions and while people are writing those out there is a quick announcement from Leno taking about and it.

[00:46:21]
Works up what's going on so apologies the rest for hijacking your. Presentation but I'll give some time for people to formulate their questions and I'm going to share my screen really quickly and we know is going to present this really us let me know great so thanks everyone you may have seen this announcement so I just wanted to remind everybody we have a workshop on you know human and animal movement where to stereo to be and variability start Thursday March 18th from 10 am to 1 pm the registration I've posted in the link we also have in addition to the speakers listed here Mackenzie Mathis will also be speaking and this will be 10 minute talk to minute discussion 2 days later once you've attended that put that in action if you want to learn how to use deep lab cut to do video based movement analysis from start to finish that will be a Saturday's $93.00 sort of event you don't have to have any experience with any of this and will provide you with lunch and put you in teams and give you some cool ideas we need you to.

[00:47:40]
Dine out by Monday March 8th because of the logistics of all of this so put that in the chest of thank you. Thanks Alina Lewis if you want to go ahead and share your slides you can you can go ahead and do that now I had the control I was on to get some questions starting to come we got some comments from Alina has been some comments since the chat box.

[00:48:16]
And we'll go ahead and take some questions so we're having some resistant questioning so again that's a question I'm not sure if everyone is what everyone's role is. I'm not sure what your position is if you're a student or post office go ahead and ask your question otherwise hold on for just a minute we'll get some clarity to those who feel free to.

[00:48:39]
Undergraduate Student. Asked to clarify question when you were discussing the fact. The changes in gays alone on motor rehabilitation I just want to clarify was the correlation between increased gazing at the shoulder improving peaks older. With correlation between increased gazing at the shoulder improving the peak shoulder velocity be an example of the case alone improving rehabilitation.

[00:49:20]
Good question potentially right so you know one of the things that So that was really the increased attention the shoulders correlated to the overall movement velocity increase and so their ability to kind of grab and reach across and you know that's one of the things that we could speculate we saw that effect very early on in the force block so before the user had ever in the performance with that test.

[00:49:50]
In the 1st block you saw that improvement already in being able to look at that effect even at the earliest stages of therapy with him to suggest that perhaps the observation alone is sufficient but we need to understand more about you know other experience base factors and things like that that could lead to this Ok thank you and also congratulations on your grant.

[00:50:18]
Thanks hopefully hopefully get it that's a win for all of us if. He said thank you for volunteer he made a lot of family members very relieved because now they can start getting in the queue to ask questions so we really need it. And so appreciate you at least watching us the 1st question the next question comes from Dolly Dolly if you want to.

[00:50:40]
Ask your question. Alice Dolly here I took a cost plus a Mr super excited to theorise search. So you know this this talk seems like you're trying to parsing out like I movement and also strategic planning in some ways like motor control and so have you thought about maybe doing some kind of like instructions at the started to kind of cue participants to look at shoulders and see whether that changes the way that they think planned beforehand before hand.

[00:51:12]
And then yeah yeah absolutely you know that that was one of the more exciting things about this study was the realization that these patterns were just emerging we weren't telling them to look at anything and I don't think I mentioned it in the talk we just told them to watch the video or watch the action and copy it but certainly there are some people that you know for whatever reason they don't look at the shoulders and they don't look at certain things and yeah you're right or there could be a way to you know take that which has so far been implicitly driven but to make it more explicit now in the instructions if somebody is a composite what would it be like to you know say Art look at the shoulders or maybe highlight the shoulders in real time if we can observe in real time their eyes are looking their you know we can do some visual queuing to orient where they should go and certainly that's something that we thought a lot about developing into some of our studies and is actually part of our collaboration to Georgia State right now.

[00:52:21]
And harassing me getting more questions so feel free and raise your hand up your questions and shadow this I'll ask a question so there's this great workshop coming on and ask the question at the weirdest area to be and it was very early and I think it's a great question your step being like how how how consistent is all of this went right or it is very and this I mean like.

[00:52:45]
How does that play must've been thinking about these questions a little bit Absolutely and you know really one of the areas that this goes back to in the case of and I'll just put it up there again this will go back to this one here so I skipped this particular slide.

[00:53:04]
Where we were trying to understand and with with very discrete kinematics with the oboe flexion extension and shoulder a.b.a. direction based on with a participant see which is a very periodic same pattern because this is recorded video and what the person sees as do one of the things we noticed was that you know obviously there are some similarities between these 2 things particularly at the level of the oboe but it is a very regular pattern all of the participants uniformly just automatically reflects into this behavior which really got us and treat it wondering Ok Why is it the case that people just kind of automatically emulate in this way what they're seeing because when we 1st start them out of the study it in a separate study and don't have slides on this one but in a separate study we actually looked at just the basic variability so when they reaching for things and doing things it's just kind of there are certain patterns that are constrained in part because you know they don't have hand movement they don't have wrist movement they don't have a former patient it's all present these use at the level of them it for so they have their own.

[00:54:20]
Their shoulder some things are constrained but some things are are free to vary and within that there's a lot of variability in terms of how people would just naturally move we have them do the same type of tasks so in a really you know what happens when we you know over time we take them away from this setting and then just have them do tasks over and over again do we see the emergence of stability do we see that kind of emergence of chaos so to speak or irregularity again or do certain joints begin to hold it seems like honestly the result is highly variable and that's exciting for us but there's something that we're definitely looking at in some other work to understand how that variability released in lower costs.

[00:55:16]
But it's really cool I guess the other thing that I was very curious about a very early stage of things. Going back to the very beginning of this may just be my naivete about will you study sensibly this is a well known phenomenon but you know you have a scooping ice cream in that example and that's something that we have a strong association with the correct tool for that but they cation like I run out of things the ones I don't like but I've got a knife and I can sort of use that but that's not something that I normally associate there's a curious late I'll just do this there's this extended especially this relationship between different brain regions to whether the object is always been associated with that particular function and that particular use or what we're doing that sort of more abstract or interpretive connection between things that don't quite know what the right words are do we see the same kinds of patterns that no yeah that's a great question because it harkens on a lot of work that we've done over the past probably about 1015 years so we actually have done a good bit of work related to.

[00:56:23]
I don't think I have it up here in this particular set here but it relates a little bit to the study here but we've looked at. This sense of what it means to be spatial or what it means to be in in reasonable proximity so if we actually develop the theoretical model around the idea of what happens if I show you a knife in a coffee cup.

[00:56:46]
Yeah they don't typically go together automatically but you certainly think about storing with a with a knife just like you could with a spoon and so we've actually spent study that from a neuro neurophysiological point of view using Navy and I can ride a lot and we are so we do see actually a lot of the same left hemisphere pride across circuits engaged when you're seeing that but it's some point.

[00:57:13]
You start to see. Is that morally too why a lesion of action in that's kind of what's shown in this image here in green These are areas that if if the action if you seen your nose just absolutely wrong. Now you see a lot more temporal. Activation into the insula which is actually been seen by several researchers well so in those kind of in that gray space or the creative space I think as we called it in our theoretical model there's kind of still this private phone network heavily engaged maybe to a greater extent.

[00:58:06]
All right so it's gone on to about 1215 now so I think we'll go ahead and wrap up and accuracy can be a really wonderful. Learning about this stuff and for everyone else we will continue to have our interest in our series every Monday to get one small change to the schedule.

[00:58:30]
We had as a cancellation actually a postponement and but fortunately have a new nurse scientist in the department of math here on a chilly giving a talk about her model her models of. Networks and network theory as it relates to vision and so should be giving me a nice seminar on equal Thanks everyone will see you again next week and thank you the rest that was wonderful.