So you just this afternoon panel is about the who could put in future trends in theory and practice and we thought there was no better way to think about the present and the future then to kind of channel or our students have heard students and hear about what they're working on in the context of their advisers and the work that the faculty members have been conducting over the recent past. So we have an enormous panel of people I've never seen this many people in one of this room before and they parse for those of you who don't know everyone that we have in the city Pierce and decrease Gaskins who will be joining us momentarily to solve and more likely and Brian a great coach and and then we master life and with them. We're going to do the way that we would we're going to do this is we're going to hear a little bit from each advisor a small amount we got them to withhold their usual locations and this interest of moving us directly into the much more interesting work of their students and then we've got some sort system for presentations of student work as a way of introducing the idea of the future of digital media theory in practice and then depending on how the timing goes I've got some some questions up my sleeve and we'll have a little discussion. So I'll start by just just asking. Carl to kick us off if you will look just doing the work here or there as we move you hear what I'm told warming or not is the higher the problem coming through the summer you want morning panel. We may not know each other because I am in the midst of my fifth year here. So I run a series of projects. An advice thing through at least group of folks that called the public design workshop. But more important than that I'm part of a new sort of emerging threat within digital media around Civic Media and in is going to talk more about that at the end but there's a number of us including myself and I can use it up to embarrass and Chris with Dan tech faculty who are really concerned with the question of how do we bring design and design research to address problems of publics and developing new media platforms and opportunities for participation with communities and so the way that we approach is the way that I approach this work at least is trying to think about creating opportunities for teaching and learning for our students but instead of taking design to be sort of a service industry for corporations instead thinks about design as being a series of practices that might be applied to actually working with issues for communities and really forging out into new spaces so Karen mentioned bio and design and one of the projects you'll see this afternoon is actually a project looking at competition in needle media tools for do it yourself. Mycology or do it yourself mushroom cultivation and the other one which is I think really emblematic of the kind of work we can do if we shift away from thinking of being just for industry and instead thinking about being for issues is Laurent Langley's work which he's going to present which is really asking this question how do we use these tools such as information design information visualization to support local nonprofit institution and their issues and I think it's a sign of how we see this work within the department it's worth noting that Lauren's master's thesis was just her master's project was just last week awarded Best master's project. So actually the third right now and I won't say anything more. But let's pursue the work because I think it really speaks for itself in terms of one of the new direction of what we're trying to do here with the media. So put everyone kind of more in Langley. And my thesis project is a web based in our data visualization and it displays our quality data. This is just a snapshot of what it looks like now but I want to get a little background information about how I got here. So I initially set out to design a data visualization that would not only hold my research and development interest for a year but would also have plenty of potential or value in the community that I live in. So I chose to focus my energies towards a natural resource the Chattahoochee River. So the river supplies more than seventy percent of Atlanta's time water for drinking but it's also heavily used for recreation agriculture and fishing and with such a valuable research resource that affects the lives of so many people that Lana. Doesn't care to the health is monitored and the water quality standards have been put in place by E.P.A. and other governmental organizations to protect water from pollutants such as not Tyria and indicators of water contamination and are indicators like Eco ally and that is something that's measured heavily by organizations like upper Chattahoochee River Keeper which is an obvious and an organization that I approached this year to kind of use as my clients who are my project and in return I had access to their data which they collect. For a program called Neighborhood Water Watch pictured in this photo is Ryan an intern that I went out with and told him for a day as he collected and analyzed the water samples and this is an aerial view of one of the water collection sites in that program. So I approached the organization build them a comprehensive tool that would help them in and through their data and maintain their data and also visualize it and also try to do this and streamlining their current system which they use Google Docs to enter their information and they have kind of like a small Google map that just showed the results from that previous week but there's no archive of that information. So this is picture of me in their lab analyzing that you call I getting it ready for a test. So like I said they enter the data weekly and so the tool that I've created just sets up the Google spreadsheet as their you know administration for their they don't. And so I hooked it up so that would be updated real time into the visualization on the website which is this tool right here and I will show you what it looks like in action. OK Here is an example and you can choose one of the collection sites either from this map or you can choose it from the list view below and the chart over here and there is equal. What is the parameter that organization games the most important and in the chart below are indicators of equalizer which is. Committed and rainfall and all these charts are used and down all these charts are bound together by this top timeline slider which you can interact with by pulling the handles and as you see everything is bound together and you can zero in on us. You know a specific date range and then you call it parameters at the same time and if you want to look at different results for a day you can hover over it and you click to select date and if you want to compare data for this pick a specific day you can do that and then click on another collection site and see the data real time as well and that is the overview of the project. So thank you. Hello from the director of the atom lab here at Georgia Tech been here about the same cement of time as Carl. It's nice to people who are coming back here from before I was lucky enough to come to work that we do without and. Initially was going super on the idea of developing a digital media. So in other words using the eyepiece techniques to create a digital media that's a dad to dissolve or change itself in some way to the new user the interest of the user that was five years ago when I came here since the purpose of that work has shifted slightly to a little bit more broader category. Of looking at the relationship are specifically involved in human creativity and trying to support their creativity through practices. We have one project called your sketch which will be demo to stares later today on this post on using human creativity as means forward computer science education through the remake seeing of hip hop music and other genres through computer languages the work that we've most heavily focused on the however is the computation of representation of creativity by looking at different exemplars in our daily lives like human player children play or entertain practices that involve creativity like storytelling in games like theater games in improvisational theater or tabletop role playing better understanding these practices from a cognitive viewpoint or socio company you point our intent is to build technologies that represents the kinds of things that we see people do and the point is twofold one is to understand us as creative entities better to understand what it means when we say that we play with somebody or what it means to be on stage and who create a story with somebody and the flip side of that is that we have a better understanding of these processes more formal longer standing but what it means to engage with each other in this way then maybe we can build technologies that provide similar kinds of engagement with other machines or with with human interactors So for example building robotics that play along with you to provide creative and imaginative play experiences on either through software agents or harbor agents for people who don't have access to to that or for learning experiences that and you gauge in some sort of play and it should be developed. The work that we're going be running here is there's been talk about it's worth the focus is on our sort of improvisational theater. So better understanding how to build interactive narrative experiences through the study of a real live interactive year of practice. That's one kind of ninety nine point nine nine nine percent involves kind of the spontaneous creation of story content on the fly and as a performance. I thought instead we are very much interested in competition good music and I think calories very much along other back and back to more of the system. I currently special they sit side. In fact when we play games at present but we are used to use these other cards where we have put control over them and we are expecting no most information on the weight loss or I think that we're going to do that. Of a car that's what we are trying to do here is to have this kind of more flexible interaction with the system so that human activity is doing some motions where he's in buttons are included in the system and our car has to work into the best luck that human is also is doing so you can do some motions and then another car is using his EON reasoning goes is in order to get to bed like other human activities. In fact we can see here that there are going to be lost in the mission there and has been included in this process. So long time friend to me is to come to this kind of a conciliation and of this company that I believe that information poses and didn't accomplish them more than the evil. Two I love. They are agents to get these women to live in the way and he shared with them. No I don't like just secretly. My question at the moment it's about being on the think it was another supreme something when we are doing a conversation with each other each one about his business trying to build momentum over the book with the other person is having in his mind in about his beliefs or his understanding going Spago so in order to be on the same page. We need to have common ground we need to have common genuine and this is what we are trying out who is currently in business and to examine Nowadays we are also interested in what's called conception lending how human beings. Does this kind of government forces and how we kind of visionary present this coming into that business and how this needs to assume these interactive nights and to be a movie that pulls the kind of you know from all. So the work that we have the work that we have observed in this project is a connect based interaction where you can actually step up and have this as Ronnie was saying and embodied interaction with interact and interactive narrative as opposed to looks like a traditional clicking on a computer or it's became a microphone subsystems The idea is to actually perform bodily with these AI agents within an urban setting. So what was his next setting is that it at all. Apparently about Brian and Karl mentioned at the beginning that there's different rats that are areas in the media that are shaping and Internet address these later on it and like Brian I don't want to fit our purpose in this area be to be a knowledge but also just that arts and entertainment as well. My lab and just all this. The static media lab. It's a slightly different but actually Brian's getting to the bottom side as you said and he is not that different now that we are really interested and house and all embodied interaction has created practices in these campuses range from the cross the Arts and Sciences never specifically assisted in connections between creativity in the arts and in the sciences and the way they are showing you supported by these new kinds of interactions technologies and modern technologies tangible technologies and combining digital media and in the expression and news media discovery in the sciences and also maybe modes of thinking about ourselves and thinking about the world around us and what we do on this theme of we talk a little bit more on this theme of theory and practice that we have in our program the work we do is really rooted in concepts from the cognitive sciences specifically from the area and body mission which suggests that there's a connection in our brain between perceptual cognitive and motor prophecies and what we do is we use these ideas from the body cognition and I was a framework for making about how we design a body and interactions that can better support creative practices and they can give us new ways of thinking about matching ideas and you know whether this is more of a narrative expression in the right storytelling system or whether it's for a conversational science so I make discoveries in science and that wire story and what I would like to do today with the earth with her for time today is going to give an example of how this science has through work and who's doing first Ph D. dissertations let me tell you more about that in a moment but I'd like to set the stage by giving you a group leader in this and telling you about a good home folder people neighborhood only. OK. A few not so many so called it's a game that felt actually a University of Washington and it harnesses a community of every day players to solve real world real protein folding problems and what's interesting about folding is that is that and so the weights are. For a mystery of how it came about is that they usually solve these protein folding problems the commentators all means like optimization algorithms. But they found that computers are actually failing in the exact problems that humans are really good at solving namely those that require spatial cognition. So in Baja Here's a representation problem. Let's give it a visual interface with drag manipulation and see what that does. And now suddenly they brought it. They made this problem except it will to a whole community of players that have never solved before like thirteen year old children now compete with the best biochemists in the world on the road evolving problems and it's and it's absolutely absolutely spectacular So clearly there's kind of an important citizen science aspect to this project but from the perspective that we take in my lab what's really interesting about this is actually the way that begin changing the representation and giving it an embodied in a direct me is not a more human construct a human a visual in direct manipulation interface gave people a way to think differently about this problem and that's that's really cool. The snow but the thing is that pretty people when you think about it is actually already a special structural problem it's proteins Yes they made a protein on screen and you can twisted and pull it and turn it around but it's not so hard to take this problem and represented visually. But there are loads of problems in the computational sciences that are way more abstract that are represented by so many so what we work on are biochemical pathways firing the reaction network so these are reactions that are happening all across the different cells in say some plant or organism and the question is how do you take this type of problem that's really abstract and represented by a sense for an ordinary differential equations and turn it into something that's tangible and marking that's exactly what we're working on and handed over and tell you a little bit about hiring and the music is an interaction varies and who's approaching that I think actually having it would have paid just person to discover. Which is an impact way to house the sense battles you just saw companies money makes. So this is what happening is the sense of balance and then you do the modeling is in bad and then they get scared and made a problem. Now that there's somebody has a neck and B. So far he's not completely and the temple of the model is to create a whole reaction that model cream in Egypt concentration and mark all money good hands and you know the whole model in the that would generate the same problem. So this is actually quite a complex problem that computers are very good at solving most of the current problem that AK exactly they have to use computer they have to think a way to form a model model you mostly at least get a piece of paper on the strength of the model in them or it is a programming language for example and manage the program manager to describe it. You know very very patient and after that Iraq is finished and there will be charts or numbers in there that compare the two major result was the sentiment data and somehow that go back and change the model or change music concentration or change the parameters to be generated this unit result. This is a very complex problem because we didn't really give the model the extreme weight of being a problem and then you get Ravager you on the computer language and every few years. What do you do it doesn't deliver anything to do with that and you can't because the programming in and you get numbers is not very how do they know so they have to use are not many Asian approaches that are connecting our way that we paid the second half. So many in every business who she and I know understand why all our growth their vocal. Now creature this vision that I'm so this is that we need to pathways somebody this memory when this isn't radical or moderate going to come come got tangled big and there's not a gun on the table yet so they can use it and bark just created a manager who's in with a circle he's not going to do is to create and mess back business because it's not very clear that they get away with science and actually creating what it is and having the ability to connect commanded to create a reaction and a view that in the demise of the nation and is even a result of what we shall immediately running through the model of it created all sort of beginning for the surrogate together and you know this is a steady lead So again I think I'm going to then look at the real problem. And also we have created a given really to take and we've used that reduction are you going to retain the one that was denying everything before we have all these you have a good meeting and happy how they seem to have the modeling process. So good so you can actually come to be done. There is interest you were nine years getting all of the current coverage through crises actually ten to program not using a variation. So we actually have some experimental data. No you don't need to face an accent you see an ad you could be a genius as you have been is that campaign tacking you prove the weight and piece because things are going to get you know problems and you thank us and gives a sense on this is the source of these gifts and are this is this is a good. Or what is it. This is one more zone. What was this one answer is the reason this is so well. How. Actually that's all she's going to use here since he's so sure this is so so my project is basically a cultural skull culturally situated game based learning more. C S T V L what it is does is it takes cultural artifacts looks a cognitive manes interpersonal context and sort of also look said you can see a little guy or a gram here and the middle and individual schemata and in the center creating experiences or game base experiences that engage would take away non rich. Non-traditional and under represented students particularly urban students or students who are African-American or Latino who are not necessarily moving into the STEM fields. So one of the things that I've been doing is looking at cultural artifacts existing cultural artifacts that actually have some some built in or embedded mathematics or science principles. So one of the examples the example I'm using for my demo. This is a painting it was done in one thousand nine hundred four by John diggers and it's a mural actually and how it was done in Houston and he this artist actually went through he went through a whole research process where he went to Africa and study stuff in Africa. You also used F.T. what was happening with black women in quilting in the American South and he also was really interested if they could geometry. So he embedded all of those different aspects inside of the smear role and then what I had did you know what I've done is Ronnie questions now for mathematician at R.P.I. who had been working with you actually wrote about this painting and many paintings like it in one and two thousand and four and talked about how this kind of creates a bridge. And this is what the paint one of the paintings he focused on so I began to pull also in the mathematic. Principles and constructing some of the math objects that are in this particular work and want to go back home and in doing so create a game around it. So what I mean by cultural artifacts are anything that is six hundred stone or representations they can be gestures quilts pottery pyramids and so on with cognitive domains which people from talking about such as knowledge that's actually happening in context are happening in the community and then the interpersonal context of the style or the person a static of the creator of the artist and then the individual schemata or the internal representations such as person experiences memories that may be shared has also been talked about and I'm looking at some research about different researchers have gone into classrooms particularly and working with students who have are under represented in notice me. And they're not just they're not connected to that in STEM information or STEM classes or in their class and they're disinterested So the idea is to use the cultural things that they may or may be aware of and bring them into and then to learn to step in similar science technology engineering mathematics. So this. So what I did is I took these and this information I crave a game around it using game mechanics and how this might walk through the steps of actually doing something like that taking something that's cultural that's existing and then making it into in this case again thank you. This is my this is my curse where I have it yet so. So this gives you a sense of I think to variety of different things that are currently going on and kind of where they're pointing and soon. Now as we as we kind of enter into conversation about this. I have a number of questions that that I want to. So the panel and then of course I'm curious to hear what what the audience might want to stop them with I'm one of the things that strikes me about all this and this is so many so many people here it's interesting to look at you from this angle. There's so many different methods backgrounds approaches to so the work that we've just seen and I tried to kind of count the different different areas or fields or the things that people would normally call fields that were represented even in just the few minutes that we there we heard these presentations and we have like you know design cognition and ecology and after Futurism and biology and contemptible computing and visualization and machine learning and I didn't know probably many more you could argue that none of these have anything to do with with any other of these fields and we have this kind of you know mishmash of different stuff this kind of bric a lot of different approaches but instead we're managing to kind of force a synthesis right some kind of synthesis in each of these works. So I'm curious to hear what any of you would say to the question well you know how do you reconcile all these different methods backgrounds fields with one another and still have you know a functional community and address you know a public where the public is the world at large or a particular scholarly community. Yeah I mean we can if you unseat the mike from it stand then and it will it will stop there we go. Yeah that was the we're in this is this is just ridiculous. One of the specialists on this is sitting with me in our so I don't see the world this is very very like this. And I like his life. Right. Experiments and that's why I like Google and cyber rather And I think that his friends are the same way as I talk about my life. We have our shape our problems. The biochemistry bowling problems without knowing anything about biochemistry the same are in my actual tools for this. There's a lot in that respect. Sometimes things that we can cope with the disciplinary side that's a little bit about real life and that's different because there's so much that same time a few people away from different perspectives and really great site work process. So I decided that family services answer your question in terms of how do I reconcile this one part of my practice I've already found it hard for I'm surprised that myself with all that you know quite like my publishing in this community or this like. I do you know makes me define myself for this but for the practice that I do that. My life doesn't matter to me that passion or the exit or right. Tension but not in my heart and this is the particular use of the weird girl of the university that rubs up against the the real world and we have to show actual created work right. All right you're being an impactful researcher friends looking a certain way on paper. Exactly which may or may not correspond with something without actually actually needs. So I mean you know if I can follow up on that a little bit in the city one wants to jump in on this kind of methodological question with the sort of question about theory and practice which is a phrase that not only is in the title of this adult with an M. percent even but also we talk about the school constantly using this phrase right here theory in practice students come in they say what's different about your program and one of the things we say is that we combine theory and practice but what is that what does that mean today and in the future because when I look at all of the work that you've all shown. I think I could make the argument that it's that it's not really theory in practice it's it's just practice it in some ways. So his theory is to read. Dead or history been applied what are your opinions about what it means to to do theory a fact. Now to the future. So you can hold it was a warm and just some bright ones or in the office friends. It's just the social conscience for some people who are like ruthless I mean it's really really really hard. So very right for the program where you write for one gives a little just as I'm sure. In the boy's new century talk about those kinds of things in a house and as a self and your game or a heart or installation or person and I think you heard their stories first. The theory is using this is right here in this neighborhood for Iraqi people space so that the rebels are using it here. You know he was happy but I don't think you know I don't think the theory always has to be front and center and I don't think it always is and I and I would like to say but with a lot of my classes and projects. I think that you can use those to win the war but I'm also I mean in the days of the idea of building projects for years around their sins of the public's in communities and and trying to take apart some of discussions of contemporary design about what does it mean to be socially engaged those and for the work but at the end of the day I'm actually much more interested with some of the students and actually seeing them go out their practices and then coming back and being here. So before we get what I mean let me follow up with a kind of devil's advocate question I can imagine someone asking. And that's that so-called of the situation you present I can imagine someone sort of souvenir from from some you know theoretically informed humanities background and saying well you're just you're just you know kind of colonizing theory or you're trying to get into this new liberal practice of putting it to work rightly is exactly what some would say How would you how would you respond to that to that critic. I'm trying to put into work. In certain circumstances. I mean I think I think well I I don't really hear about the criticism of God and maybe that's the answer right. But I mean I would say that I think I've but again for me like it is trying to put it to work in very particular circumstances and making a play or the kind of the view that doesn't for actually get it challenges us to make the scope of the decision about where we want to do right. So our ways of working in that we can hear directly but let me speak about stuff like my response as I said so I want to say earlier this morning is that I mean right that's right. It's not just about every This is about our life like it's a virus or just harmless little our little bird. For instance you mention that's part of when you also need some understanding on lines of funding. So that's why I didn't read. You know time we got to double know the devil's advocates have leverage here I'm going to everybody agree with us right. Good girl. I I didn't see marriage talk because I had to run and teach but but I think that actually we need to push it even further and I would say that I don't buy that there's any difference between us and he's the only one I think that we may have been and I CAN WE CAN I can prove it to you by looking at the papers until you grant that do exactly that. I think that what we need to do about the human going forward is at the same time that we are creating this pluralistic center for ourselves here we have to make sure that in the process of doing that we're not actually creating false boundaries to find ourselves and statements like well we're different that he's the are it's the C.E.O. We're different in this field of that building the other thing I think all all of that if we really want to become our potential how to get said we will do that. There they just are. So this is this is related to the point alleyway. You know that though that the distinctions the arbitrary distinctions between fields are very centrally bureaucratic structures and if we if we maintain them then the maintaining them not for the sake of getting things done that for the sake of appearing a certain way to us to a particular audience or so with their well known we have some so we can continue talking about about theory and practice internally but let me let me ask a couple other questions and I don't know if any you have anything you want to ask just you know wait wait. Stand up or wave your hands around or throw something in the end I'm just interested in in titles always in the way that we frame our ideas for the titles that we choose and another phrase that appears in this panel titled Is trends heard the future trends and I was struck by the fact that in all of your work presentations or brief presentations of work. What counted as trends did not include. Twitter. We keep Facebook issues of privacy or intellectual property or the knowledge economy all these sorts of things that are let's say trendy that we would that we would expect to hear in the in the context of digital media trends in almost any other in any other venue. So I'm curious what all of you think about that. What does it mean to be at the forefront of something or working with trends or predicting predicting the future or working to create a future in the present moment given everything else that's going on around us in the broad field of of of computing in different media so then we're doing your proposition is you are the general of interactive nerd which is what are these morning New York or New York and we've been good friends that exist within that medium our work is the way that I view it is directly a reaction to kind of the status quo or whether you see that field valving to repass and fifty years. This summer we're going to go down this bill was in the really did ninety ninety. There you know on in Stanford and mighty and they really there was one cow that was out by Joe Bates. That is basically due to diddle large amount of dissertations system. And reflecting on it and for my own view we can look at it go. Well we haven't sold it yet. We have to solve this problem. Billings hold it like experience. So maybe this little bit of that we're in is not necessarily the best solution or maybe there will be more solutions that are explained explored so though we're going to get a proposition is directly kind of from the one that a lot of you point and from a technological viewpoint in reaction to kind of where I see people are are stuck in terms of terms of pushing in terms of pushing the boundaries we're trying to create an experience from intervals of interacting with ality. And interest. No experience again that's on what do you think built like a local meeting beginning with friends and Freddie bright lights so you look from a really high level picture friends or much much longer for things that are trendy right now looking for that. Why not your friends and if you find the answer. A little you're stuck in what's for you right now but once you brought a friend to brought you there you go. Where is this going and the twenty years from now there is where you actually see friends as well as people in friends histories I suspect all of you have different rights as it is your friends or your agency when you work in my technologies and where when the sons of us try to pull of the supposed by her last days or the rights of privacy out of what's funny. Right now look at my favorite picture of you know where where's all this going and what is the friend that I felt create future. So we can hope for the stickers. So I actually did you meet them in the. People who work for you. Say they remind me. This is where I think it's the same world and time with the cool kids. Not all that do it you know it's just a wee wee Actually we do have a Twitter demo upstairs and the reason why was because we did a demo day last year for a project that we had both exhibited and that had received external funding and it was about the future of digital media relations at a small scale agriculture and both came in there like really like you're going to school for this someone you can do this and I had an interesting way of what I actually find for my students who want to go out into the field and get jobs as interaction designers having to drop some of this back again so you know who made a very tactical decision that is here to be like yeah we're interested in these questions and you know we're going to we're going to use Twitter to explore that in part because it makes a connection and that idea of making a connection back to what is not the silly trendy but also trying this was like a fiction what is a fridge is like one of the of importance for the moment. How do you do you not burn the bridge bill. Right which is just subtle of course subtlety is not normally the way to try to get discussed in any way we're almost out of time I have one more question or thought at least as a question. So we've heard a lot of opinions from the Faculty members of this panel if you were from the from the students actually we have an interesting group here we have master students Ph D. students of postdocs of different different places and introductory so that your careers. I'm curious to hear your opinions about. Well let's see what it was an intriguing question I ask what what are you. What are you worried about what are the things that you looked. Professor I know you're a liar an artist who works in research. Where did you learn English National Ballet. You've heard direction and you're out there more and more white myself and you see me more as. Your reality was his never really the world here. This is really. We're all like So. So a lot of real world. And yes. Actually result in an well that's the second question is are us from both ends and my eyes. Yes Yes yes yes yes. Look at all the people here. Right. Well here's what I might write novels. I didn't say that a lot rides and I think that's a big I heard my words right above my bed. But why I think that's a great question and I think the answer is we don't and it's not all research Lord's work it's not certain some Master's Degree project that's really about going out into the world and I wouldn't necessarily want to live with it from the research research. All right. But like you put this research involved in any design project right so I think we don't have to call it already. Surgeon it's worth asking at what point are we doing research of what points are we doing something else do we have to maybe there are parts of it that are that are not going to be research are not going to be academic research. I think recognising that everyone does some sort of exploration as part of their process and they were to be really careful actually I was at a workshop last weekend and one of the things that got brought up was a real concern that amongst a group of M.F.A. that they were going to have to go back and get Ph D.'s not because they wanted to get Ph D.'s but because suddenly that was being claimed as being the requirement for them to teach right and that what does that mean to have to cast everything suddenly as research and what are we losing in the process. I mean the really important question for us to ask. Actually our Ph D. in the arts research for an article in saying about me and never said it was I knew it was in my knee. Why isn't my answers in the comments are man people were mean to me understand why I did he says was just research. I didn't mean anything. I was looking at software forms is this and this is so this is what home terms. Now you know the names that he made sometimes there are reasons sometimes there's just sometimes a mole this is always or sometimes I won't tell a little research and some we shouldn't be you know this is wrong and you're researching how people do this so I think you know it's in the middle. I want to get my hands and I don't need you just saying I'm doing research means I'm doing research in your country practicing things and teaching to do my I feel a certain artist as you know most of us use my REAL. To let me say the reason he very well. So every response was yes of course everything that I do is heavenly these are serious and then I thought about it and the educational me you were there in this room it was an earlier on. Hip hop or nixing with code. There's there's a there's a there's a learning component to it or any sense is more intuitive of about asking questions about how to gauge computer science students are having a good minorities in your science but the majority the vast majority that we're going to do is not what I would call research it's all building a curriculum. It's building software to apply that to it's building the whole website so out of students to share the work that they're doing every now and it's all about to build something that can be actually be used and then by doing that they hope to begin actually answers. So some of these learning science questions about about a good many of your science and creative practices but the idea of this is one thing I recall here that we don't have the spotlight on everything and there's definitely a mixture of that. So I think this is just one of those words that means something different to me to consider people and it's kind of to Carl's point that I rely on partly as an aspect of research it has on research products have nothing to design them and research further use you know doing one side of things these I think lead over to somebody who's I don't know sitting in a cell biology lab but yet research needs different things everywhere and I think that ultimately it's a label and it doesn't really matter. I really don't know that legal or not or what you're doing nothing makes sense right. So I had some training already going in that case and I was back in the radical math so it really matter how you grew during the era as long as you're. As it has all of what we strive call it research or not whether or not writing on typewriters. As long as what we're doing makes sense that I guess there's a little problem. So I'm posting from there as well as my reason why it's a very hard writing laboratory. So it's really important that we are doing research from us a century. This is a research project as soon as I know you know terminologies by itself or you really do that if I see that. Yes I think there's a real research that legitimize some area that I think we'll hear about yeah I think he's a great.