[00:00:05]
>> Welcome to the Georgia Tech libraries mapping how science may contribute to the sustainable development goals. We're excited that you've joined us today. My name is Catherine Manci and I am the public programming librarian at the Georgia Tech library. But 1st I would like to invite my colleague, dr.

[00:00:23]
us cons to give the introduction of our presenters. Thank you. Thank you, katherine, our horror organizing the exacting events and also including me and that mantle global's that is censored. That I manage that me say very briefly, a couple words about the science or it's a collaboration between georgia Tech and georgia State University and federally funded through unites us pontification.

[00:00:54]
And our science of integration emphasizes principles of Education for sustainable development and united nations sustainable development goals in all its programming and activity. Yes, this is a pleasure to be here today and introducing our speaker and moderates. Today we will hear from Dr. Is male raffles that there ruffles as a senior researcher at some 31st science and technologist at leyton university in the netherlands.

[00:01:27]
He works on the development of novel approaches to science and technology indicators for informing, evaluation, foresight and research strategies. His current focus is on research prior to setting in particular for societal challenges, such as sustainable development goals and how and agriculture conduct the ruffles and thank you for being with us today.

[00:01:52]
Dr. Robert, what harm will be moderating this conversation and that there what's, how is an environmental sociologist, words professional experience and environmental education and advocacy is a service learning and partnerships are still list for the center for surveillance us, dayne and then edge on a could in a professional in the school of history answer at the Georgia institute of technology here in Atlanta, Georgia park common.

[00:02:23]
Thank you dr. watts. harm done. Let me in the lower tier. Take it from here. Thank you so much, sir. 2 years now and I'm thrilled to be here with Georgia tech's new strategic plan featuring teaching in research to the dance of sustainable development goals. This research is not be more timely and more significant is who are in the situation.

[00:02:51]
Dr. russell, we're so happy to have you here today and I'm going to turn it over. It's easy to please tell us more about your research and insights into the mapping of the inable development or Hello. Good afternoon. Thanks so much for the invitation. pleasure being here. I wish I could be the gather with a few of our friends in Georgia Tech.

[00:03:25]
I used to work at Georgia Tech, a pope in years ago for a couple of years. And I really wish we had the opportunity to meet and discuss these personally, but help we will get through this and in the future. What I'm going to present today is part of a project that is led by the science policy research in it at the University of sussex by my colleague tom as a chattily from the center of science and technology studies at the University of flayed and we are at taking the lead on the people, a metric part is a project for the get u.k.r. i that's the United kingdom for funding agency.

[00:04:13]
We is in collaboration with the United nations that element providence. And our goal is to understand how by and might contribute to sustainable development goals. This is an extremely ambitious goal in the we would that the way that the project is organized, by the way, in the 1st page, you can the link of the project where you will see that the project is organized in a 3 part.

[00:04:50]
One is about this, if you met the diplomatic mapping of research related to the jews. Another is a sort of a about what type of fame then technologies experts and see the relevance for it. Is that Yes. And then there are 3 cases studies, one in argentina, about chakras disease.

[00:05:13]
Another in kenya, about fishing in the victoria lake. And a 3rd one about dr. c.. In India, where I'm going to present his family, the mapping site, which is what's related to the library and information sciences. Which concerns And I will begin with a summary though, that the key points are clearly or I tried to make the, the key point clearly in the beginning.

[00:05:53]
So the fact that there is a growing policy interest in how research addresses societal problems. And in particularly the fertile problems frame in terms of sustainable development goals has led to the man for mapping our scientific publications are related to societal problems. And in particular, to as that you Since science mapping has been shown in the past to be able to list straight priorities over time.

[00:06:39]
The countries, institutions, for example, or 10 years ago, my previous work at Georgia Tech with our import that was about the priorities in nanotechnology research. It is interesting to think how research is related or not sustainable development goals. Because they're specific. There is the perception that research is not actually prioritizing human wellbeing research which resources, research resources could be better that directed towards issues and problems that routing, prove human well being.

[00:07:28]
What is now there might be directed towards types of knowledge that might favor particular interest In this, for example, the, the fact which I will present later that we have now much more research on cancers which affect relatively small percentage of the population. druther that research on this is this, which is affecting huge amounts of people in the planet.

[00:08:08]
Now, the mapping of research in terms of sustain the full development goals is sometimes presented as an issue that can be solved technically by like ready, librarian approaches or by bedlam metric approaches. Which your attack whether one paper is related to sustainable development goals or not. And we have found this to be highly problematic, fanshen tagging publications because the g.'s and assuming that the aggregate is even jury information on which offend certain organizations like just attack.

[00:09:05]
What like my university is doing research addressing as it is, it's problematic because it may heighten certainty and I'm bigoted and bigoted because different people understand as it is in different ways. It's also hides the fact that there are different values which us associated with a plurality of choices.

[00:09:28]
So whereas some people might that say that steak is the g. city, which is about health and people might prioritize, maternal mortality and other people might protest mental health. So there you have 2 cases in which you have research addressing health and well being, but actually doing so in very different ways.

[00:09:58]
And also we are concerned that just doing aggregates of how much research is related to as the g.'s might be hiding. The fact that a lot of research Is influence by particle of interest, let's say the fact that certain corporations support the hiv and research line is leading to certain approaches to health or to certain approaches to energy.

[00:10:35]
And president, just thinking how much resources and have the g., we think that if we should think as well about what type of research studies on the different as the g.'s. So if we're talking about health and we addressing maternal mortality, are we addressing cancer at the rate, addressing mental health and whose interests are behind this choice?

[00:11:04]
So we have to be concerned in grading made solutions to tackling publications through as they just think that their new more thoughtful approach is a needed as a has been shown by this article by arnie tauscher published last year in the journal quantitative science studies. Ok. As I was saying that he shall, why there is this interest in relating to research because ages because that is a perceived mismatch between what the research priorities against what that is frightening.

[00:12:01]
And this is a, in many areas in health and gender in water and climate change. The idea is that these misalignments is due to institutional dynamics that influence of funding by big corporations or funding by big and departments that are not necessarily focused on people's well being. And the fact that it is very difficult for citizen still unknown.

[00:12:40]
I think about the different choices that can be made in terms of where research is high. But it is to use the sustainable development goals, which are clearly about wellbeing as a way to end or into shaping research towards our actions that say that wealthy. And in this sense, a developing monitoring tools comes as a way of setting relevant direction.

[00:13:16]
So I was mentioning that lisa, a blossoming of different approaches to try and the really like publications to effigies that the basic mentions and how has each publications practice being related or not to sustainable development goals that is on health and sickles. That is the condemning the duchesse association, our university says developed and has the g. that 4 And the un to be together with the british government asked us to do this project which will be published later today in the form of what we thought.

[00:14:02]
We might just cover selfies of these tagging approach Does make sense. And before going into what we're doing, I will introduce a bit of the conceptual thinking of who are the National directionality in research and innovation which can help us think. And then I will go into the sky thing, the challenges we did limitations face when mapping as the g.'s, the publication, The notion of that directionally take entry.

[00:14:47]
So We can think of other research that knowledge, ease or innovation as following trajectories that so you have a trajectory of a mini chart is ashen. In the case of semiconductor, You have and trajectory of developing that tick discovered is like talking with genetics in the case of cancer In these dominant ways of trying to trace a problem.

[00:15:37]
And when, in fact, a low at a given moment, there is a dominant way of doing certain function to order at chess or addressing cancer Or developing computers that up a variety of possible ways to go back to A case which is or is it to understand is the case of energy technologies because we have at the same time as I, it is possible that we're interested in a little card on an r.g.b. future.

[00:16:17]
You can go for hydro energy, you can buy a car for winter buy and you can go for not the you can go for 1st of all tax you can go for better insulation, less consumption. And there is research in each of these owner g. alternatives to fossil fuels.

[00:16:42]
And the amount of research is likely to have an effect on the type of innovations that will come about. As I was mentioning, these are research project that has a shaped or as has shaped by brought institutional settings, private funding, government priorities. The fact that the condemning incentives around decision indicate what some activists find it more difficult to shape research.

[00:17:21]
And so this is a case of what they did has calls for and on science in which talks about research agenda switch channels carried out For example, in the case of health, we see that one of them most important problems which is not addressed is maternal mortality but there is no social movement actually, or government pressure to Take to find out to or managing to find a solution that direction.

[00:18:00]
So the notion of the reaction out is that research and innovation can go in several directions. And choices can be made in which their actions to protect our do enough, whether whether we're doing the right science or with threats, the societal challenges of just climate change we can think are then inside of it.

[00:18:28]
And roger pielke proposed that that is on the one hand science apply this publications, funding peyton's. And on the other hand are settled in that. What is nice about this, it is it, which is it is a way of thinking about the society and that and it is important to think about the certainties, possible trajectories.

[00:18:56]
What is that? So for example, we have 2 types of choices that can be made. In the case of health, we have the choices about what type of problems are being addressed. So here I hope that you can see my pointer in red, we have the percentage of publications which are educated in world science to a given problem because malignant real pleasant disease cancer.

[00:19:29]
It's more than 20 percent where this, this is burden of cancer is life in them set, whatever because of cata vascular disease. If it's one's throat scan, ecarte, newsies, you have More the easiest than that, at least relatives and number of publications. And so it's often the case when in that condition.

[00:19:57]
So there is a choice about what type of problems Should be addressed. Just more research, be devoted to cardiovascular diseases, or to respect sort of this is a minute or there's a 6, it's an open question. So what type of problems are being addressed even within and there.

[00:20:22]
The 2nd of these is about the direction of it that action ality in the product. The 2nd time type of choices about what type of approaches are use, what are developed in order to address a given problem. So in this case, we have a research on obesity. And bubbles here represent different the amount of research on different approaches.

[00:21:01]
So the approaches on the left hand side are more related to basic biology. The approaches on the top are not related to the diseases and risks posed by a visiting the set is about medical treatments, the area for 4 or 5 medical treatments. But visiting someone in the area, his legs or styles the influence of Social data here, then the direction, it's ok.

[00:21:41]
This is research about or p.c.t. so that the choices will a made here. Then what type of research should be prioritized within of the city? And some people might think that given the high correlation between obesity and a social environment in particular, poverty, more researches should be devoted to that issue.

[00:22:15]
Whereas other people might think that it's better to focus on 3 We who have vs and digits for a specific problems. We also have them isn't the duties in terms of ethics. So that was mentioned as is that action ality in approaches which approach should be preferred. This was a conceptual introduction, so ok, we want to do research for addressing as the chicks quit a minute.

[00:22:54]
We can, we'll have to choose about the directionality, what type of problems within a given as the g.'s, like health, what type of problems within this year and has the g.p. like energy and what type of approach What do we find that these are choices and need to be made.

[00:23:15]
So what do is find when we compare different approaches which have been developed to map as the g.p.s. to publications. There's this idea nice idea of tagging publication with a g.p.s.. But the finding is that when 2 different approaches are compared in this case, a comparison is between the elsevier approach and the data going approach to mapping as egypt's army.

[00:23:47]
That is what answer making, which is the 3rd team. They found out that only varies at 26 percent of a line between the publications that vatican says are related to all as digital to About good and the publications that elsevier considers to be related to as the g 2 in this happens or marched as a g.'s, you can see if you go to this paper, you will see that the only as a G in which there is quite a lot of overlap, he says is just see for the others.

[00:24:35]
degree of overlap is below 30 percent below a degree of, of overlap between 2 approaches which are supposed to be mapping the same how research is related to as it is being on the 30 percent. Is that a serious warning that you have didn't we are providing is an acrobat.

[00:25:03]
Why is this evidence not? Not credible? Well, because when trying to relate and as the gist of publications with we are doing is relying on the specific keywords like malaria, to titus big hiv. Now the bending on the understanding of The target This is, this might be included or not technical issues about energy research might be included or not.

[00:25:39]
So for example, the order approach had malaria, tropical disease and vica, a brazilian infectious disease that's a working on in latin america. But brazil was very active in, in fighting it. And there is another one which is for malaria mosquito control an awful or sick. The bending of the cue or the results are very different and you see in this case the lettuce clearly has one disease that should be addressed by as a just but a surprising way suzuka is included but not the English, which is a closely related disease which affects many, many more people.

[00:26:28]
So there is a huge degree of ambiguity. The other problem is the problem not part of priority setting that I was mentioning. So here we have on the right hand side. What else of your sound, other main themes in as you just city, according to their tagging. And you'll see that it's about breast cancer, prosthetic cancer, passing on another cancer from a cancer.

[00:27:01]
Now if you've got the targets of as a just city of health cancer that is only in find $3.00 in terms of non-communicable diseases Because we, as the jews are un pentode, we are focusing on global health and issues about mortality and metal mortality rates. To go to collage of military or our relatives and no one important.

[00:27:32]
But most of the research is carried out in countries in the north. Therefore, most of their b.g. allegedly related to as a jeffrey is related to cancer. So here we have a problem of priorities. Yes, these are research and cancer might be considered to be addressing is the gist of it.

[00:27:54]
But actually, this is not the spirit of sustainable development goals. The spirit of sustainable development goals is to address the most process pressing needs. And therefore, what I did effect to have more research to maternal mortality malaria tuberculosis. The colossus does appear and but even a word cloud dominated by cancer.

[00:28:27]
So we have of this problem of ambiguity. Have been different problems that can be addressed by bridges. There are different approaches for a given problem and just counting whether publications are in Yes, which accounting or not is not actually telling us about what other priorities, setting choices that are being met.

[00:29:03]
And it's not clear that if you believe That the science system needs to be seriously transformed, staggering researchers as digicam planned or not, will have this transformative potential usefulness if attention will come from seeing alternative research genders coming out. But what these, the approach that we've been proposing that we will protect you and the high degree of ambiguity with proposed Rather than assuming that research is and make an active recovery related or not to and as the g, what we can do is to propose clusters of publications that might be related to messaging.

[00:30:06]
And then we are developing a visualization interface that stakeholders in specific contexts with a specific values Are able to decide whether those clusters of applications are related to effigies according to the needs of their contacts or thing to their understanding and values. But what we do is incidental duty as a last load and university.

[00:30:48]
We have developed a clustering of holes hands in $4000.00 areas. And closing the social sciences mathematical computer scientists is a core science of life or medical event. Whereas with all of these in the same thing, which you can pick up. Yes, the g.'s then set up a threshold.

[00:31:18]
So it was with louise. And the other approaches we come to start by setting keywords related to a given as the n.g.'s, which other arrived by your and report from this keywords we extract publications. But rather than looking directly into the publications, what we do is we look at the clusters that contain publications that these clusters are selected by saying we want to see clusters, which at least have 20 percent of this publications that might contain it might be related to us business and a given percent.

[00:32:02]
And these other classes which are then potentially related to as the g S In this interface. Now it is just the power point, so I can control and allows the user to check what other specifics papers in a question and decide whether that course is related to nasa does in a way that are relevant for the organization.

[00:32:35]
And do this work well with colors as a portal and conditional understand on happening or has there just in the sense that it's plural, different people might have different mappings and it's a condition, it depends on what you consider to speed are relevant properties of the cluster for some people, for example, this is the mapping for an orgy research And delis or red area, which is related to the development of the bill.

[00:33:25]
Typically the clusters here are related to technical development, exampling. But of all the excels order, technical development or in winter by The mathematical computing is more related to the management side of energy. That little area is related to social issues from the management of an urgent for example, one of the classes about portfolio management.

[00:34:03]
Of energy, which some people might consider concretely, are relevant. And the blue area, a light blue areas related to life and earth. That is, you can find things which actually event. There's a just to see this one, the greater sage grouse is an example of the problems with wind turbines for wildlife or ducks and related versus colliding with the winter.

[00:34:39]
But she's finished the latest talks, the negative consequence to alternative green technology. And the idea would be there at the University. People engage in good technologies might use this interface, the sink. What type of approach if with the relevant or Green energy. So in summary, come a little for time, I hope not too much.

[00:35:17]
And some of it in the face of this growing interest, progressive circles, problems i assume are things making it a go straight. What are the priorities of the time? But, and I know it's mapping by itself. It's making a lot of assumptions in terms of the data used to in certain data bases, other types of because there is a type of this emissions of science.

[00:35:50]
My penal exam is not enough. They had the sort i would give choices in the hay uncertainty and acquitted In the face of these uncertainties. We believe that really rather than providing a read in a close aleutian, we should provide these open map. So that priorities are discussed.

[00:36:23]
And all of us here. Thanks for the attention. Thank you so much dr. raffles. That was absolutely and such important work if we're interested in and evaluating and they answer research or it's rest with us. We are going to move to the q. and a portion of today's event now, and I'm going to begin with a couple of questions and, and share questions that you are providing through the dough.

[00:36:59]
As I start off, please go ahead and continue to share your questions with think we have quite a few of my 1st question dr. ruffles relates to the point you were making about a person mismatch between research priorities and needs and the waiters and wage the trajectory of reserves are shaped.

[00:37:26]
So what are the ways that non-governmental organizations interested in and dancing as to ease and try to address that mismatch? And also do give greater glory as an agent is through citizen science or community science as it's now often pop. And so I'm wondering whether the mapping that you have just described and after your street is approach, whether they're able to capture the science that is conducted outside of academia and university labs and might be published by teachers or, or other forms of great literature.

[00:38:16]
And if not, what suggestions you might have or evaluations he already is in research that could capture communities Because thanks, that's a very appropriate question. So, you know, we're building on larch, existing biblical epic. That's a basis we're using plays out here. It is extremely problematic in terms of the coverage because it pays a database that has low, lower and lower coverage.

[00:39:03]
The g.d.p. per capita of the country is a lot worse. Actually we have a graph showing that the culprits we creatures with jeffrey, people are copied. And if you believe that some of the pressing problems are in the global file, then we are missing a lot of the prop.

[00:39:27]
So and this is why we are not comfortable with close package mapping So that people can go and say, well look, you're saying that there is only one percent of energy research related to Whatever value mass. But actually it's, you know, we have these local reports showing that it's much more than that this young old we, we want to make this mapping open to take hold of this and citizens from different walks of life so that they can point out the gaps.

[00:40:17]
Right, however, with which we don't know how to do so at the moment. We don't have that a basis that include groser perspectives. Look at that include great literature or that concludes That include journals published in many developing countries even in developed countries. In britain aside, india is a huge gap And We would like to have a much, much more comprehensive.

[00:40:56]
The does not going to happen. She's not going to happen not. But we hope there will be improvements in the next 5 years in terms of coverage, including at least comparing the extent of gas to how much literature from say latin america we are using Thank you. Thank you.

[00:41:16]
And that's encouraging that you're seeing progress toward reducing some of those gases over the next 5 years or so. Yes, for example, there is and you know, there is an initiative in there initiatives in latin america particularly around that are bases covered in local journals in part to gays and spanish and make it which would allow them to capture local research or research possibly closer to implement ash Thank you, and we actually have the question really, is that really?

[00:42:04]
Is it languages from the audience? So I'm going to share that with and then go back to my 2nd question. So I'm going, joining us today has asked, would it be possible to translate in other languages take advantage of priorities locally and it sounds like that issue really just refers to is trying to do exactly that.

[00:42:36]
So I, I think it is possible to translate the terms but what I think it's more difficult and more meaningful to do the conceptual translation of what it means. And there's the genie In a different setting. Right. So maternal mortality in detail child in the center of africa on the turn on one type mortality in bolivia might be problems in both cases.

[00:43:21]
But let's say in law pascall e.v.a.'s who is related to perjury or event living conditions of the and the poor neighborhoods. Where as in chad, it's related to not having access to or not hospital nearby. And this might mean that actually it's another question of translating the kiewit.

[00:43:42]
It's a question of translating what it means to improve attention tools, mother in different context and, and in my view, the interpretation translation is the key issue that universal below metric approach approaches can do. And We, I think that it's great, we should be really careful. Right, right, And related to that and say how this kansas decisions are needed is a question of now, how do you determine the clusters are attached in this leads us to relate to your strengths approach, you know, how are those plasters determines The cost.

[00:44:42]
Those are based on citation relationships between publications Do you think is an approach which has been done in a number of lives in the world? So the in India is that citations reflect the way scientists are relating to each other. And would you get from those course? This is groups of papers of people which are fighting each other and therefore working along the same problems around the same ways of thinking.

[00:45:27]
Ok. These are course, these is not a problem. It is not an issues without lots of problems and with knowledge that it's just one potential layer of of course, the thing until the fact that we have $4000.00 clusters. Other groups are using 100000 plus this to do the same.

[00:45:54]
And it's, so it's a question of balancing this really, there's a lot of work to be done. Thank you. There's another question and goes back to this issue of matching research priorities with social needs this participant asked, how do you determine what is the relative social needs with the approach that you are advocating, We are not advocating.

[00:46:38]
We are not advocating that you can determine the social needs in a univocal way. We are just under contract. We are warning that it is not enough. Is saying that one, that one publication is related to as rigid. It is also important if it is related to a key problem within the average As order problem that it's important for her big is a franchise community rather than a problem that might suppose an incremental improvement of life in an affluent community.

[00:47:32]
And of course, the way that the fact that mass research is carried out in the global north or upper middle countries means that the prerogative of corporate research investment, but also governmental research. And there isn't but the well being of affluent society. And we need to put serious thinking from the global not in putting some of our resort resources to what the problems with this, with an effigy which are for abroad.

[00:48:11]
Well being maternal mortality rate I was mentioning before. Yeah, yeah, but then what did I answer the question there. Yeah. Ok to salute him. Yeah. So I interviewed him now it's their cases in which are You can come up with estimates. For example, in the case of Health, The global, this is birth, and it's an estimate.

[00:48:44]
And it is very useful as a thinking tool. But still, I believe you should keep it as an estimate. That can be a challenge by a call, that's what I think, please. Right, right. Yeah, and I really, I, I know in some of your writing the exact is out in additional challenge that there is now, is consensus between the relationship of research and outcomes.

[00:49:20]
For example, in the area of inequality, Many different perspective. What kinds of research and what kinds of policy proposals would reduce inequality. It makes announcing even more challenging and must mean for us even more technical issues like energy research. But in the case of inequality, that isn't an ideological battle.

[00:49:53]
Well, people believing that konami drugs will improve people's lives. People believing that redistribution is a much better way. And in the face of uncertainty. Totally stunned. And diversity can see its point can be shared a consensus value to the answers doesn't need to be absolutes, but the ignalina that it has a lot of uncertainty and therefore that is there should be room for pursuing different approaches.

[00:50:33]
But this is not the case that only happens when in ideological issues like inequalities, it might happen as well does. And with an energy, what type of opportunities, energy technologies should be fostered. If you want to see is there, there is a question growing and machine learning in that initial interest stations are you planning to use, for example, machine learning that has to connect different to similar concepts or decide what terms are relevant or not.

[00:51:18]
If I use We're not using machine learning for synonyms, but our colleagues in the consultancy say it is a cadet, make sure it's as I R A I S because I mix, they have use it From expecting to word for a u.n. documents and then using mission learning to develop in our names In a couldn't make the academic language of journals.

[00:52:08]
And these doesn't actually pollute all the and big it is that I was mentioning before. So, you know, we piece by means of this machine learning that you may end up getting ziggo which was a very serious problem in 2016 as I recall, but not getting the ingot, which because it's a problem that has occurred for so many years it's not popping up in policy documents.

[00:52:52]
So a problem with michelle's machine learning is not being in control of the interpretation Because It's because the machine learning is providing solutions. We just don't know exactly what they're based on and we know that machine learning algorithms are showing the bias that our society have terms of gender race.

[00:53:25]
So I think we should be well, technically it's really interesting to try to, which should be careful about how we're using these And to follow up on the question of bias. So if we start a little bit about how corporations in government shape research, agendas and the need for more pluralism an invoice for why range of stakeholders.

[00:53:57]
And wondering what you've learned through your research about the influence of more prestigious journals. Do you mention that the suggestion to do some s.t.d. s.t.g. editing and come out with respect to the journal nature? Are, are there certain journals that have an outsized influence? I research in our research related Going to school.

[00:54:36]
I don't think I can answer your question. We don't know What type of influence or You know, there's a high procedure not scared of what we know is successful in, in one case, what we did this, we looked for a given problem that was avian flu In which area of avian flu research appear to publications in the most prestigious journal nature science proceedings of the National academy of sciences.

[00:55:21]
Including the lancet and b.m.j., which are medical journals. And it turns out that in their d.n.a., in this is avian flu experts full. So it's not only a human problem, it's also a problem of how the flu gets into the bird. The. So it's related to that in there, rick, that is energy research as well.

[00:55:50]
We found that most of the research that the proper questions of why procedures were clustered around biomedical approaches. A medical investment, a lot approaches. So the concern and it's a concern as and has various other evidence. But because of that I see of her and that disturbs the court, is that the search for high prestige and good to me and news aligned with margaret's active wet lab approaches.

[00:56:33]
What is more holistic in the feel socially engage approach is wanted more harder to get the critics in, in touch. And in these like, it's very likely to be shaping research projects or to use the word solutions which are more aligned with the high tech and potentially results aligned with corporate development.

[00:57:10]
Because we are conscious because they could all get to do that a piece where the more policy and that it solutions more difficult to capture commercial Seems to me that would also bias my work is disciplinary research more holistic. critically important indeed, this is the heart. I have not seen hard evidence of over the past.

[00:57:52]
Interesting. Well, we are coming close on time here. So I'm going to move to our final question. And for that question I had to bring it back to Georgia Tech. One of our purchases actually has the same question I have, so I'm glad to be circling back to this one.

[00:58:14]
Georgia Tech is currently developing its strategic plan for research. How do you think we should take the findings from strings into account in crafting objectives and strategies to guide our research directionality? I think that the strongest learning from these projects is that the mapping service to see the landscape.

[00:58:50]
It doesn't sort of criticize which direction you want to take Because what each of the, yes it is, what I would have problems to be tackled. And that I, it's his of approaches to tackle those problems. And therefore, I suppose that the learning is that that is not apropos a technocratic advice on a good a strategy.

[00:59:26]
But the good the strategy should be found through consultation in which the new one state can be helpful to think about the relative strength weaknesses of the Georgia Tech. interrelation with 2 or 3 them just like would like to accomplish. But in the end, if these are found what they called us, this was a good bendix, but also with the communities and gadgets to detect with like what type of problems in the type of solutions they would like to attempt.

[01:00:09]
And yeah, but but, but I'm not saying that these markings on the to school. I'm saying that they're not use they, they, they are not that these for people to make Well, that is, that is a wonderful wages and very well for thinking about this limitation of our strategic plan moving forward.

[01:00:38]
I want to thank you so much for being with us today. Dr. russell says it has been a very, very interesting discussion. And at this point, i'm going to turn it back over to catherine to close out the event today. Thank you so much. I would like to echo dr.

[01:00:58]
oz hull's thank you to Dr. raffles. Thank you both. Thank you to serve, learn, sustain them for lending us the fabulous dr. Was all to moderate this conversation and for the Atlanta global center for helping us this event on. Thank you for attending. I mentioned in the chat that we will be sending the recording of this event out to everyone who register through that.

[01:01:24]
Right. So what we will be sending that once we archive it in the Georgia Tech libraries. I'm digital archives mark pac and I would also just like to put a plug in for the Georgia Tech libraries public programming. We are committed to providing free and accessible scholarly programming to our local and our global community.

[01:01:46]
And we hope that you will join us for more programs in the future. I'll put a link to our event and the chat. So again, thank you for attending us and we help you have a great day.