[00:00:06]
>> Thank you for coming I'm just going to kind of run through the basis of my work on a couple projects that I've done. So I'm an assistant professor of an industrial design and. I really believe that making is a universal experience this is something we all do in every circumstance you can put somebody in any circumstance and they will still continue to make and this is one of the reasons that industrial designers are such great systems thinkers because we are connected with with kind of a base that we all share.

[00:00:36]
And this because design is inevitable so if you look at really tough times their history is like the 7 Years War This is an example of what people made when the government kind of took all of their jewelry away and they still found ways to make adorning jewelry through diamond cutting steel and nail.

[00:00:55]
So the way that we make is passed down through generations if you look at this picture this is one of the earliest examples of knitting that we have and then a few centuries later we can see that it's gotten much more complicated this is because we pass down making knowledge generationally and things get more and more complicated and it's really one of the things that separates us from animals like mice and it's been around this way for so long that we actually don't know the origins there's the earliest myth that we have is that knitting.

[00:01:27]
Knitting was started by even seen at the pattern on the surface back and if we look at modern knitting maybe it's true it's pretty similar so this was going on for generations and generations and then computer started and this is kind of our 1st computer drafting system settle in sketchpad our computers have gotten only slightly smaller.

[00:01:49]
But this was how we started as honors using computers to draw what we make. And people really often look at this is a departure from craft in these as 2 separate things but there are methods that we can use to take computer knowledge and look at crafts through computers.

[00:02:06]
This is a really interesting example done by some other researchers by a Lonnie and barrios where they were able to parametrically analyze Islamic geometric tile and find which factors were needed to be stable in which factors were flexible in order to create things that were still culturally relevant.

[00:02:23]
And if you look at craft around the world we can see that this type of work could be done in the factor's this is Appalachian overshot weaving. Or Nicaraguan pottery. Or even kind of the basics of architecture I see all the architects nodding because we all know the right so this is so gratifying 1000000 designed in 882 certainly before we were doing parametric modeling but one of the amazing things that I love about this building is that none of the columns are straight they're all crooked This was.

[00:02:55]
For mathematics as is a lot of God's work and so the question becomes you know we now that we're so dependent on computers like to say say you know how did this even happen. And it happened because this was kind of the 1st parametric model all of these Canterbury curves were designed on a grid that can be changed with hook and it was designed under tension so that it could then be averted and the compression and this is this Does the exact same thing as a lot of our really complicated computer model.

[00:03:21]
But as a model or I kind of wanted to look at craft through this lens and a little bit of a different way and I started by looking at knitting and looking at the bamboo trade in Thailand Thailand specifically is really interesting because it has one of the largest wealth gap in the world.

[00:03:37]
You know the bottom 40 percent of the population only has 2 percent of the wealth that's really severe and at the top end we have things like the tide aside creative design centers which the government is sponsoring to bring modern design to Thailand and it's really successful in amazing and so we have all these modern parametric tools and algorithmic tools and design tools but we still have a lot of large craft communities that are with me I'm also dealing with the cold that are that are dependent on craft for livelihood.

[00:04:07]
And so I thought maybe we could combine these 2 so using algorithmic modeling I was able to design kind of an alphabet of shapes that can be combined in different ways and the shape is given partially by the design of the shapes that I've made and partially how they are knit together centrally fit in there or if it's pearls so this can create a few different things these are a few products that I proposed could be made with this technique and one of the things that I find interesting is that it uses mass production methods but it can't be assembled by machine it still has to be assembled by hand and it also allows for people that are making to contribute to design through mistakes or through their own inventions of what they do with the shape so it's really more of a material instead of a final design.

[00:04:51]
And you can see there's a lot of different possibilities that could happen with that type of material with kind of an endless array of products that could come out of that. Looking at crafts around the world we can then see that these are all intentional cultural heritage crafts recognized by UNESCO and these are crafts that are in danger so if we if we do not have interventions if we as designers don't incorporate craft into our designs to make products that are saleable then these are crafts that will not be around in a few more generation so the question is how can we design modern advanced parametric that allowed direct engagement with mathematics to highlight the many skill based crafts that are in danger of fading away.

[00:05:32]
I started looking at Croatian bobbin lace and Croatian bobbin leases is interesting place to start with Bob and lace exists all around the world but Croatia is one of the lesser recognized place centers compared to a lot of the lay centers in Europe. And it was and it is really culturally relevant for for their culture Bob and laces this amazing process where you're really kind of throwing bobbins around in different patterns and as a algorithmic model or i course like that and it's been done for the same way for a really long time this is open at the new place starts pretty similar.

[00:06:09]
And here's me making some way also pretty similar him so by using some visual scripting tools and 3 D. modeling tools I was able to pick one of the torch on the ground that's common in a lot of different kinds of lace and analyze that and then be able to bring in some Attractors and detractors and different kinds of algorithmic tools.

[00:06:27]
And create some different types of pattern so this is the digital model in the physical model and they're pretty visually similar in my opinion so I started playing around with different patterns that could be possible. And because this can be morphed and mapped I started playing around with whether or not this place could be made seamlessly in 3 dimension so these are kind of the 3 dimensional and the 2 dimensional to each other with that being pretty successful the use that I chose for this was custom bras for women post in fact to me about 40 percent of women that have had a mastectomy strip and not have reconstructive surgery they're left with an even on even bodies and chests and they also have some issues that they can't tolerate seams or under wires or some of the features that are common in bras now so this seems like a great use.

[00:07:17]
Through using body scanning as well as the unseen machinery we can then create a custom mapped draw that creates an illusion of symmetry and a custom fit to give someone a a really special garment. It's still made in relatively similar ways except for it's made over a custom 3 dimensional body form but you know still with the same tools and this is something that's important because machines can't make 3 dimensionally we have machines that make lace every day but it's all 2 dimensional that seem together and that's just not suitable for this user group.

[00:07:51]
You know and this is kind of the end result from the front it looks much more symmetrical and as you turn to the side you see that it's a beautiful custom fit and so this is the project that I'm kind of currently finalizing to take to Milan in just a couple weeks and not terrifying at all.

[00:08:13]
So that's it after that's done I'm going to be spending the summer at a shaker village researching overshot weaving and how it was used in one specific shaker village and nobody knows why only one village used this specific kind of weaving that's highly decorative and not very shakily so looking forward to that over the summer and maybe in the fall you'll please them nice new images thank you very much thank you.

[00:08:47]
I. Yeah I think some know about it more than others so you can ask them. So right now I'm teaching sophomore studio and I'm teaching a graduate elective that's based on this research so this is kind of the 1st time that I've been teaching a full class on this methodology this week the students are presenting more material explorations and abstractions of their craft and then moving forward they're going to be designing.

[00:09:29]
They're going to be designing products with it so hopefully that will be successful I've been really impressed with their explorations but it is challenging because there's so many different levels to it so you know they could potentially need a whole semester of just mathematics modeling to be able to really robustly do that and they could take another semester of just learning a craft like this is a very long process so shortening it into a semester has been challenging but so far they've been handling it really well and I've got an undergraduate level it could be done a little bit less with the modeling side because there just are so many levels that it's going to be a little bit more just material exploration with craft but I think it's an important thing to recognize that we have certain skills that have been historically kind of favored by industrial design and certain skills that are like that that's crass and there's there's certainly cultural divides and and gender divides of how those things have happened and so I think it's really important to find ways to incorporate this more into our classes and even that out.

[00:10:34]
They were Yeah and you know I go back and forth with it's been really great having them each choose a different thing and explore that deeply and and I should have just given them one cross to all Explorers. Who you know but you know after a few more semesters I'll try both ways before it goes but they have really enjoyed being able to choose and I think for some of them they've chosen crafts that are things that their ancestors did or their grandparents that are where they're from so they feel a lot of connection to it which I think is great.

[00:11:10]
THANK YOU THANK YOU THANK. You. Thank you Nancy. I'm very excited to be. Giving my my 1st talk here in the College of Design as a new faculty member here at Georgia Tech I'm an assistant professor here and recently along with 12 students I've started the brain Music Lab where we perform music cognition research and engineer new musical systems using brain and body signal.

[00:12:41]
I'll be telling you today about creating musical systems that respond to the body in the brain decide the A isn't new but it's only in the past 50 years that we've had the scientific ability to do this composers have actually been thinking for quite some time about there being this unknowable and internal well of music inside of us that if only we had the right kind of instrument whether that's technological or not will will be able to unleash this armed well of musical expression that one of the very influential experimental music composers of the early 20th century had this in mind when he wrote I dream of instruments obedient to my thought and with which their contribution of a whole new world of and suspected down will lend themselves to the exit and seize of my inner rhythm that he wrote about this back in 1033 so now almost a 100 years later I'm taking very literally of arrises dream of instruments that are obedient to I thought by incorporating physiological measurement of cognitive and Africa States into my performance practice as a flu test and an electronic musician.

[00:14:09]
On mind. By. The and. So if I were to compose a response to river as having the tools that we have now in the 21st century it would be this that I dream of a music that is subtle and generative and responsive to emotion but aspect of Leo where open the contemplation that meets the listener at the level of their ambient awareness and brings them well being.

[00:15:09]
In pursuit of these goals I've pursued scientific research with colleagues at the University of California at San Diego MIT Dartmouth and now Georgia Tech that applies methods from science and engineering to send the M.B. an electrical activity M and properties that are released by the body or bio signal during all kinds of music and gauge Mint So this has included no scientific research at these sorts under computational neuroscience where we developed ways to CO analyze electroencephalogram our brain wave data with motion capture data to uncover the brain embodied in dynamics that and support engaged musical experience so while this was a very good way to develop new analysis methods to be able to classify music experience what I was really interested in is how we can use this information to develop new brain and body interfaces to create music that one of the examples of a project that I did with a collaborator was building an online way to model somebodies cognitive after the experience using E.G. and then generate new music.

[00:16:29]
From that system for a kind of community sound and deletion experience. Business there. The performance video that you thought at the beginning of the talk is the 1st example of how I applied this kind of online E.G. monitoring to develop a new musical interface and while it was very fun to to perform with us for a couple years I found it kind of limiting as a performer to have to constantly be classifying my emotional What I am doing now I incorporate this kind of method.

[00:17:19]
Little. Home. Own little home. So when I arrived at Dartmouth as a fellow last year I partnered with a epileptologist there to actually apply these algorithms for a health and wellbeing application we apply the same font occasion algorithms that I use and performance to see if they could be helpful in tracking the various types of E.G. activity that it epilepsy patient displays while they're being monitored in a hospital.

[00:18:15]
We're actually using a very similar concept to actually develop new kinds of sound material that could produce beneficial sensory nerve stimulation for it epilepsy patients as well we actually just emitted a and I grab for this project last month so it's. Keep our fingers crossed on that one.

[00:18:39]
I'm also using a film or concept with an on campus collaboration with Dr Annabel singer in the biomedical engineering department to develop a noninvasive brain stimulation method for Alzheimer's. So you can hear an example of what that kind of sound sounds like. The more we've actually taken. Mozart and applied signal processing muscles to produce a brain injury but a very specific frequency that's known to be therapeutic.

[00:19:23]
With a student here we're actually applying the same method to E.C.G. data and to see if listening to another person's heart beat can actually induce sympathetic feelings in somebody so just as an example I want you to see what it feels like to listen to the heartbeat some of the sounds are playing of the script this.

[00:20:05]
So in service of all of this all of these different projects we're building a software and hardware infrastructure at the Center for Music technology to support all of these different at topics that require measuring these ambient body signals as people are experiencing music and playing music then converting those into sound and analyzing all of this data and so we have several different projects that we're working on using this same exact infrastructure here.

[00:20:47]
So in conclusion I'd just like to reiterate that the goal of the brain Music Lab is to create this new kind of music that is subtle and generative open to contemplation but most importantly eventually will bring people wellbeing and I'd like to thank all the people listed here on the slide thank you thank you all.

[00:21:51]
Right so what we're doing here is actually very very different from the goal of music therapy we're actually trying to develop scientifically validated music interventions that are going to work for all humans regardless of their cultural background which is a very important. Shift here so regardless of what kind of music somebody hears pleasant there's still going to be a very particular kind of auditory of oak brain response in response to these very specific acoustical patterns that we're generating and so for lack of a better term this is a much more low level intervention meaning that it is relying on very very simple sensory mechanisms in the brain to produce that kind of beneficial entrainment which is very different than what something like music therapy does which is a much more high level participatory experience that still requires a lot of individuals ation on the level of the patient.

[00:22:57]
And so even though after actively this kind of stimulus might be unpleasant. It's still going to be a lot more universal in terms of the response that people have or so we hope because this is in the very early stages. Right so right now we're only looking at epilepsy and Alzheimer's as possible application.

[00:23:28]
I don't want to promise anything beyond that because the reasons why were were applying these these particular population comes from other research at that we know about the benefit of this one particular brain wave frequency cognition I think is something that's a much more multifaceted and complicated. Network of brain systems that are involved with that.

[00:23:59]
So while I don't want to rule that out I think that that would be kind of in a future stage that we would look at that. Right we actually applied for a grant from them for the Alzheimer's Project So I think there's an avenue there to work with them thank you for the suggestion.

[00:25:28]
Yep yep yep yep. Thank you everyone thank you so much for coming things safer for the arranging this event and thank you for the the staff involved also thank you for the wonderful speakers before me of the cellular and Grace I feel honored humbled and privileged to be with them and us faculty students and staff of Georgia Tech.

[00:25:56]
I'm basically going to be talking about my motives through the lens of the research that I've been leading over the past several years as story. Over the past several years in the title building signs by design where I joined Georgia Tech to continue working on 3 fields of research in the high performance building lab which is mobility and outdoor thermal comfort the topic of my Ph D. energy modeling and a lighting which is the topic of my master's and typically the bread and butter of someone working in brilliant performance simulation and the newest research that I'm attempting to lead called aerial analytics which is the use of drones in building performance and specs and all these 3 projects tie together to my motives of using building energy modeling as a process of understanding our impact through design decisions on climate change and energy efficiency so I will take you through each of these topics with one project through all of them starting with energy and the lighting in buildings so for this one I actually moved to the urban scale during my Ph D. and the research question here is how can measure data calibrate urban building energy models to inform a better community scale design the idea is we measure everything around us how can we use that measured data to actually build meaningful building energy models that help us in informing our design decisions so the firm framework that was proposed in this paper published at Tad starts with the idea of pre-processing this data using functional clustering techniques where we're looking at heating cooling lighting and equipment to infer presence and behavior of people to become imports for urban building energy models that allow us to look at different design scenarios and their impact on energy efficiency and the community scale So basically the clustering techniques takes this complex measure data and allow us to see trends and high mid and low energy users and from a cooling energy perspective in the specific example at the cycle of.

[00:28:07]
24 hours now we scale this up to the 4 categories of heating cooling lighting and equipment and we can infer from them the setpoint setbacks that human behavior presents in these models and we're able to build these calibrated urban scale models that allow us to understand community interactions and use such models to look into design impacts So for example what if we change these 4 buildings that come from different categories in terms of Windows who are ratios or Bill cheating devices or changing behaviors cooling and heating setpoints this was a project that was set in Mahler and Austin Texas in collaboration with faculty at 3 Q.'s University and with seed funding from the National Science Foundation and you can learn more about it with that from an upcoming publication and environment and planning be.

[00:28:55]
The 2nd topic which is really a topic of passion of mine basically I started my Ph D. coming to Boston from Cairo and I wanted to start biking because this is something that's very challenging in the context of Cairo and then thinking how can I do something with bicycling that links to building science which you can imagine is not very linked at very easily but I did find a link so the idea in this research is how can computer model simulate outdoor thermal comfort and spatially mapping to inform sustainable mobility designs of the walkability and Bikeability of cities so this is the title of my Ph D. towards comfortable and walkable cities bringing aspects of building science to the urban realm and mobility decisions so building focusing on outdoor thermal comfort modeling this is a map of downtown Syracuse for mean radiant temperature specifically and how it can inform for example walkability and Bikeability path that basically would promote such sustainable behavior the idea is that you would be able to inform users on which path is much more comfortable using the simulation models and I continue to apply this through funding from the NIH 3rd and the New York State Department of Transportation and it was published in building simulation basically looking into these paths of where can we use things like materiality shading and changing orientation landscaping and planting of trees to inform our thermal comfort and things to walkability in bikeability.

[00:30:22]
And the last topic which is Ariel analytics which is the use of drones in Building Performance inspection that's a topic I started authorities university when I joined on the tenure track so I come with 3 years of experience with this and it was also another idea because I like drones and I don't know how I can link them to the built environment basically from a construction standpoint and from measurement the link is clear but how do you link it's a building performance and I found a way so so the idea is we use thermal cameras and thermal cameras allow us to understand building skins but if we put.

[00:30:55]
A thermal camera on a drone it allows us several degrees of freedom and also becomes more safe not everyone possesses the capabilities of Spider-Man so maybe we can use drones to basically allow us to see into buildings and several degrees of freedom solar weather man died in the last movie I hoping he would come again in the next movie will see but anyway so this is for example a moment where missing insulation exists and we want to detect this semi-autonomous leap so the research question here is how can the use of drones Exeter 8 energy audits increase their accuracy using computer vision techniques so I'll start with showing you the part with building science from architecture then jump into collaboration with Bill with electrical engineering and computer science focusing on computer vision this is a video that showcases the flying workload that we've developed basically using an orbit around buildings and using been that allow us to become closer to the building this is one of the pilots who are trained to do this and acquiring a thermal images for through the mapping in deteriorating or or the order building to see where issues of performance happen so these are some of the snapshots of the context and the building itself we use 3 to 4 to remedy of the shelf software that basically allows us to put these orbits and been into I R and R G B platforms that come together to build a fairly accurate representation of buildings so this is a software representing both.

[00:32:22]
Data collected and then the model comes for the building scan itself so 3 thermography here were able to see deterioration in insulation where the snow didn't melt some infiltration expectation issues with the building skin some window performance issues as well. And so this is basically the 1st attempt to build a full 3 D. model with thermography and then the collaboration with computer vision comes from a semi-autonomous workflow that allows us to create these models that take that to the matrix of a thermal image and then through several processes of edge filtering come to an output of leakage so basically take a thermal image and see leakage in it autonomously So the idea is we take this thermal image and then using the workflows of collaboration between computer vision and us we tell them here is where it's what's happening here is where the most probability happens for information exploration and it was published and had and I'm very excited about this kind of collaboration with different media and of expertise if you want to learn more there is a paper that was published in automation and construction just the end of last year that talks about a review of the use of unmanned aerial systems in the built environment.

[00:33:35]
And that's about it for the 3 areas of research I look forward to collaboration is with experts and project across the college and the institute in computer vision and machine learning in artificial intelligence I'm actually containable shooting a contract with the Department of Energy were selected for a significant grant and the title of the grant is aerial intelligence for energy for retrofit building energy modeling so air BEM And so we're going to be using artificial intelligence to create a workflows to model building skills autonomous Lee and use these beyond just the surface into a full energy model and also looking for collaborators in urban analytics and data science that's what I'm planning and design for the urban building energy modeling and of course links to health and well being and much much more and to end on one final note there's a conference that I'm hosting and sharing called some are that's coming in the college in the space on April 7th to the 9th so please check out some of dot com 29000 where there's many many researchers coming from around the world that I hope you would be interested in collaborating with or having engagements with and with that thank you very much and I look forward to a question.