[00:00:10]
>> Hello everyone. Welcome welcome to the Welcome to the. Protect labor security a lecture series I project coming and it was previously faculty member to talk I was very pleased to be there for like for like I'm free to have here isn't a recently moved. To a new institution.

[00:00:36]
And I am especially pleased pleased today to kind of introduce. My own p.c. student you elect to will be our speaker today. Is a Ph d. candidate in the department of industrial engineering and operations research. University the rise by me and your research interests primarily lay at the intersection of like privacy and to to stick focusing focusing on focusing on focusing on application the machine learning and specifically to work like designing upgraded preserving algorithms for doing machine learning and I got a model as well as designing opposition techniques.

[00:01:25]
For doing privacy protection online and she's going to talk about her work in these areas today it away Yulia and the I think you know the same terms of her introduction Hi I'm yours I'm going to start sharing my screen Ok so again I run my name is your name and today I'm going to talk about the project.

[00:01:52]
I was 120 where we analyze the users progeny here and this is a joint we're going Rachel Cummings Elizabeth Cohen say and also there is a memo. Time to take Internet came an important part of our daily life and even one can say that people are constantly on line in fact according to Pew Research Center.

[00:02:19]
28 percent of American adults report for they are in line almost constantly and roughly out of sand you know as adults go online if these daily and these numbers and the fact that now you're as Internet service providers are allowed to collect and share users' data suggests that we have a massive amount of browsing data out there just a growing every day and this creates a space for in your research direction and discoveries and it is important for the searchers to know how to deal with this kind of data and wish which will help us to understand their interaction between the users and technology and also yours or its behavior patterns.

[00:03:12]
And as a 1st step. It is important to understand the structural properties of their browsing data for example how in different. 100 measures as an amount of time people spend online or. Myself they usually visit how these different matters after that they are crossing out by turns and of course some of these questions can be answered.

[00:03:43]
By the Internet and users going south like for example there I said about daily Internet consumption however in Utah investigate if users can correctly perceive their browsing behavior and that would mean that we can't trust very self-important intake and and this question is a sense so. Because. Especially if we want to encourage a self-appointed dater in our analysis.

[00:04:14]
And we're all over maybe it we can even this other one to date out for analysis and modeling images when we are I'm able to collect 3 on dictaphone for some reason and so now I'm going to. Talk a little bit about what has been done in this area previous year.

[00:04:36]
So it was so and a very nice correlation between users browsing the here and user style I just am a graphics or educational background it also was done in the ground and others showed that the benefits of Pan tend to change their browsing behavior when they know they are being observed and also another important finding that was presented in that recent.

[00:05:04]
Paper read Facebook researcher stance simple terms or overestimate overestimate the time they spend on the website and they tend to underestimate the number of music to the website visitors are here it was Advantage raised and so thinks what you might see are our main question stands I am going to answer to take during the stock.

[00:05:30]
The 1st question will be and I will if people have a correct perception of their behavior online and we will consider this question for us in terms of their own people for you to judge how much time they spent on why and also can they like a candidate who are actually asked to write what kind of writer side they usually.

[00:05:54]
Are as a 2nd question we want to investigate if people change their browsing the syrup even if they know and they're being observed. Next we want to. See how browsing the savior of the Internet universe changes in the different settings. Specifically among the Democrats are different demographic groups and also among different.

[00:06:21]
And finally. We want to see what kind of structural structural properties of browsing patterns we can learn from from the data and from our findings. As a 1st step. I want to discuss the experiment that we designed in order to answer all of these questions though it turns out experiment and.

[00:06:50]
Consist of started to all participants who were challenged and extremes and the goal was to collect continuously their brows in data. And easier for 14 days or so or so in here with color and I think when people are doing online. For taste we build a Chrome extension Act and the same name bug and you continue as a collection of using browsing data while the extension is on and.

[00:07:24]
Here we central Georgian text I am you Michael Mann for helping us with this. So let's look at the aspirin and status and experience. It started with a screening where only him. Myra's disciplines had all of them to the survey and after that we was so adamant she said bands who are new and engineering to crater that on the day one of the experiment we would happen to suppress talk come our own person to our office to sign their consent form.

[00:08:02]
And to install where our crime extensions that would call an affair and say done and also to complete them restart his service which I'm going to talk about later. Starting this moment then continues cash another data begins and it it was. It was on fire for 10 days and then one day for General experiment I disciplines would come in person and can't.

[00:08:31]
Come around to uninstalled and come extension and them to complete the quest and to serve. This cream crate she ran to and her always parents were her 1st ever since had to be a native English speakers and. We require that because we wanted to ensure and me I mentioned your aunt who was an English translator.

[00:08:58]
Also anticipate had to have 105 hours of browsing per week and of course. This is one I'm around to search as there is termination of how my stand I spent online but we're inquired of and she's kind of hours a week and sure enough there enough data collected and also her to spend had to be altered and.

[00:09:20]
18 Now let's look at our. And our demographics. In terms of gender we have family it barely Iran's illusion before and there the Muslim ears. In anything. I'm sorry here is a mistake so presidents of the danger from changing times to surgery for it if they are it was 46 and tonight in our present so we have that so we have almost.

[00:10:00]
The same amount of participants of the younger contemporary and the New York agree and we have mice less participants of their Alter can agree and finally for their raise our Reem have also almost fair. Franti hand of participants in terms of these 3 races we of course had.

[00:10:25]
Representatives of Morris's in our eyes but just human will by reason or have enough of a percentage just to include these in a statistical test so that's why we include on Monday in these. These races and also there. Are other features and that's actually the reason why you cannot use them some other numbers it is not so much a 100 because we had thought we had to exclude some other branches happens from things that economists now let's talk about our interests are ways that I mentioned before I don't respect Mr bait really I just want to kind of to get into now with the participants were asked about their demographics nationality their hobbies importantly its average number of browsing to predict.

[00:11:16]
Valid an admission number of hours of browsing pantry and also of their favorite or must pre-crime carries a website a visit this is an important question if you're going to include in our analysis later and then after the study in now we. Ask some of the similar questions and also really ask questions about their online premise there were missed.

[00:11:44]
These questions included land. Bridges or pens became more aware of their privacy if their opinion changed in their primaries on line and so on and also one of the important question we asked participants to. Reply if they change their browsing be her during the staging to prevent eyes from learning some information about that and this is also an important measure if you're going to use right.

[00:12:17]
Of course we are acknowledge that this kind of studly Jan was superior in some sensitive but we could question your call last time sensitive information about the users and that's why it was very important for us to ensure the privacy of the benches against the 1st Degree I don't know my system data.

[00:12:39]
But it isn't for assigned to random users ids and also an browsing data was linked onto their end user not to their names and the same comes from their research and the service. And are of questioning aren't I Ms under new system that they. Might not be enough in some cases and that's why many also are truncated or there was a go your letter your Alstead might be disclosing So for example if we call acting and.

[00:13:11]
Some. Action online by one of the users for example amateur and some primer and a Facebook page we were just trying to read this u.r.l. after the name of the maps. And also a purchase advanced had an option to plus 30 to collection in any time and we just had this option in the browsing extension very quick Charlie often chime in on an anytime and sign the register plans.

[00:13:39]
Would opt out from the experiment also and anytime during the study and in our in our in our. Research spirit really I still have questions in terms of class have got their eyes and for a 2nd degree session we use the semantic of our century here to and this is going to raise a student.

[00:14:07]
Yeah and it's going to be an issue we have different Harrison group of kind of groups and let's just have a look at very kind of resistance and maybe you walk through some examples though in the in the 1st columns you can see those are our main Congress and we observed in our in our during our study and in our my last column I'm sorry in the right column I have examples of some of kind of stuck consumers in this outside defense ample Facebook.

[00:14:42]
Might be a social network which would fall under some trash I'm going to agree you 2 is I generally don't lose weight but fall in multimedia and down Outlook communication and Amazon commerce and then Google information related. You can not just ask for example you could fly in post on an additional piece and also in their entertainments How can agree.

[00:15:08]
So we try to do it. As a semantic tool offers a different multiple categorization for every match sent and we chose the one. They made you resent as the most discreet your why for there for the rest that. Ok it isn't as I mentioned in our and data collection we want to collect every action France users who want our form online and for it you don't actually kind of question have we had different types of actions and now.

[00:15:45]
We're I'm going to market through all that Dyleski started on the back patent star and this is just land use and we present an abandoned during their. Browsing session that we had a peek and this is specifically a clique that does not question and. You are all change for example something like when you're like on social media.

[00:16:15]
You know that these actions young dancer back is the service now how can you tell and this is action of opening and your time and that could be posed either maner you end user opens a new time or by opening in lean in in your. Arneson have typing in on your box which is just.

[00:16:41]
And there on your box I just want to remind her mind it's just it's a natural as a parent it can be. Or usually also used as a search engine and so they actually have to I think they're. Going to say accident on your bus. Finally also we have to change which is just out or into an existing tabs we have a typing and we also have funeral change which is also up and actually and reflect the constant change of your out of for example if you are missing some study representing your Cleburne a project you change or your own venturous John Assaraf said.

[00:17:22]
And also our. Present moment you're attacking our new boss and your presence like starts and that was also a change in your element this at this convention for that's Ok Now many of you learned some a new things about our experiment let's look at the actual data don't the statements just a sample often same time and as you can see for every Iran's So yeah that action times they talked about and for every In France they have a unique education also for every event we track Rhys trap it was performed and so we have also you can use time ages and this is important if we want to incinerate a mystical comprising the hearer because users don't browse unwinds have a usually outer between that also may have been a random She was rated.

[00:18:21]
Some spirit for example we have the same person performing on all of these actions and s. 2 important measures are there time of the start of the action and time of the end of the action and. Most of that a lot of actions likely lead must or must of their actions are someone.

[00:18:43]
Ahrens continues so narrow very short. And this would be I mean why don't point later the next of which half of which have a. Jury also assigned to the actions and some of the actions like for example that change are not assigned to any Jor el and this is because.

[00:19:06]
Absence like the time change or our new box or. The new trap they are not the forms on the right side and they are performed in the browser itself and. Later have to consider is a contender is ation on their website. Ok and now we come to our 1st question which is about an people's perception under browsing the here and as I mentioned in a recent a Facebook paper it was a solemn event you pull downs over estimates and how much time they spend online and underestimate how many times they visit.

[00:19:50]
A site and also be asked in a priest or a how much and time she spends then they spend online and we went out to compare these responses really with their we play results are against from their collective takes up so that means we have to compute how mice time instead of their parties are spent online different than the state our recollected and and as it is you remember I imagine that most of the actions are instant genius and therefore really cannot just master the generation over and over rousing in time something.

[00:20:35]
Like the sound of sound over a duration of action. And therefore instead we really. See our data as a as a sequence of sessions where every session is an. Interesting question of action and our we define an int sized chance I am trying to stand there session and if they're not.

[00:21:11]
In town now then for more than 5 minutes and in their. In their previous works similar or similar threats were actual in the 1st when for example there was. A researcher into finding stressful there's 30 seconds and how we're going to fight it as a 3rd unions. Ok so now let's look and.

[00:21:40]
He and the dangers are drowsing time in the individual level so on each of these are plots how we jammed. In time of users browsing. And not just examples of 4 if users during Internet days of the status of from one to for a few or in some cases since last because as I said people were able to.

[00:22:12]
To pause contagion collection. And I was so sure on the y. axis we have adults over and out is defined as are real time browsing my not there really is to a show that you got from their service or how much people it's in response I'm right don't know basically Delta is kind of a matter of.

[00:22:37]
How much people are a measure of people's perception and even down to it is less than one license 0 that means that people overestimate in their in time spent online and in France are larger things you know the people underestimated how much time they spent on my. Yes and so I'll look in and interview the level we can see that we have well different instances and some Let's look and can tell to in terms of in terms of the population and in this case we would consider every state and actually even if you don't would consider average Delta for all.

[00:23:22]
Trace of a study in which isn't presented here by their red line. So on this plant down there right every hour reading it. We all wanted to sound. The average Delta which is a perception of our every user. Every entry Budaj is a severance you as a person bring disciplines and on the x. axis we have actual time users spend on online that if we.

[00:23:56]
Got from the data and wonder why it answers we have to have. Their perception minutes from the servant and as you can see most of their most of them most of them by disciplines are ambassadors trend line which means Delta is my sincere and that. Means that she spent over estimate how much time they spend online and.

[00:24:22]
This if you can get transient or hours of sanity to participate as one areas are estimated and their browsing time. Also we showed and counter is significantly different from 0. Re you suggest furthest out than just which means that it is against Jones and b I'm not correct in their presumption.

[00:24:50]
Now we want to consider if Delta deeper and or until. Our underage among the new frontier are graphic pictures. As. We in our. Reissue and our linear regression with a gender and phrase as a. Interbank variables. And we showed an increase this model does not have significance positioned which means that there is no in your independence between are dealt out recession and there and there.

[00:25:38]
And then demographic. Demographics arm and arm also show that it is to be snuffed out of that does not differ a month it's in a graphic features our sensors and we use them and we need an eye test were wondering here are equal and something has to be used and for gender and race it does not.

[00:26:03]
And doesn't doesn't Japans and gender and race hour we're also going to see it aren't there just to air it down turned. Into submission and down to changes in terms of theory and different age categories I want to actually look which South and who are the best and that's of course for the elite.

[00:26:25]
We have very close to significant. Difference between between the ages going to graze and you can see on this club that. And actually. Like Del just we just I'm going to be built is a difference between very and actual time users spend online and and also how much time this thing that they spend on might best Delta Dental be more broad and on average have has a lower lower than 0 value for each undergrad degree and enter an average it has a higher value position clear then the main town our own theory out there is well the container is 0 so yes or on average it has a higher value for their older category.

[00:27:22]
Yes So also we want to see it clearer if the end. Result is a perception of the South perception but all you want to investigate the self perception of on of I disagree. On what are their favorite categories and as you remember me ask this we ask this question in a free and also the possibly the only one to which just want to check if these are in this responses are supported by the request to take.

[00:27:55]
Dopes here we have are at here we have a concern Christan 3 offered participants in this are based. And they could chose from these categories or what are the ones that they needed to most. And so this matters as our answer here sort of confusion magistrates so far in how in their roles we have.

[00:28:23]
Indeed it is for example for something in the u.s. or already have their friends in surprise who claimed their sobbing in terror now mass times and there isn't a mosque and and in the now we have presidents we do not claim and in terms of the columns we have I would have.

[00:28:41]
If there is any interest to point to pride in Brighton dangerous or like trends in danger we can see there are just young producer bands. Yes the shopping is now masses of contemporary or are not. Right and so we consider this one for this great categories like stalking preference social networking and entertainment.

[00:29:05]
Our Bridget our pretty suppressed turn to our over estimate how much time they spend on there is. No as you can see for example for stopping 38 and 78 percent of the British sometimes answer the claim that shopping East and wherein they spend the most time and in fact it was not supported by their by the data.

[00:29:34]
Same here for example references on legal 9 percent of participants are correct so. Don't like they need to be reported in the very measure their friends what their favorite restaurant and in fact. In fact were supported by the actual data. And here in the book at that price those.

[00:29:58]
Downs are going to increase very users. There is users down to reply. More close to the choice in terms of they. Wasn't afraid how likely it is you can see for Mr started 74 and really respectively 56 percent of the British are men who claimed and. It's also out there most of it is not science actually reason and these are as I am to most.

[00:30:35]
Yes And so. From this we can see that. Most people most people do not have a correct perception on their own Proustian they tend to overestimate how much time to spend on the browsing and also the 3. They have kind of around a procession of what and there must be concern is it in websites.

[00:31:03]
And also results and this our perception does not depend on the demographics also its It's very close to significance in terms of the age. Now we are coming into our 2nd questions where we went to investigate youth in behavior of participants change. Or were in the time of standing because there they are aware and they being observed.

[00:31:37]
And of out in the in our in our surveys we ask in our pastor has been simply asked if the branch is supposed. Purposely change their behavior to brand their information to learn to program. And we want to to compare these responses will be the findings from the actual data.

[00:32:03]
And now from the actual Gentlemen you do. When you do mass or if there is if participants change their behavior because of the tracking. Now we which are not and is like specifically are my answer then changing their behavior because under tracking but we can't have this important imperfect Rossi that just to see if their bodies are going to be here in general and changes.

[00:32:31]
And as I mentioned. This was meant to maintain by their own lives to lines of uterus you know where it was shown don't you both do it change their behavior when when they're around they know they're being observed. So. I 1st want to see if the. Users browsing and delete it changes reaping time the 1st year as a measure of activity we use that not an amount of actions happened during some specific.

[00:33:11]
Timeframe. And so if you look at the implied we see here. On x. axis the then tell you something started it and then my abscess we can see that the average amount of actions that were happening during the State days. And out of. Egypt we just leave them to.

[00:33:39]
Like then began the 1st half of the experiment and I'm something to Pearson. When you can officially observance non-dance different from the 2nd half and it actually was supported by an same misery statistical test so recently so intense that it's different between the beginning of the of the experiment and then at end of the experiment in terms of mean and also in terms of variance is not significant.

[00:34:08]
Rotation I shouldn't have and not about his 1st day we have and we have comparing your last day activity on the 1st date in just because there's a ration and I mentioned the 1st day when today when I just opened I downloaded and installed the Crown so it was not training there and it started changing their their activity like later in the day and so.

[00:34:35]
As I receive it we have a less activity on the 1st day. Now we want to also see if there. If if people browsing the Syrian check changes in terms of what kind of class I visit during Arak each day of this time. And this can be a much greater buy.

[00:35:01]
Like people are and where a 100000000 has died is a very being observed and so they mind and they might want to look like they might want all. Kind of control over their. Religion so. Anyhow I got from some other one too and I really want to see more productive during the productive during their working times and not to mention sites like Facebook friends ample and we want to.

[00:35:35]
Thank we would expand. Their knowledge of that and their mere I'm sorry with decreased during the time of the study and by the end of the study they would kind of get more Conference of who I am I started browsing in the way into the usually brought. On content on the part of the right we can't.

[00:35:58]
So here we are presenting them and then on their **** who have their dreams and why Access. We have. Also this is a normalized measure of attention. And each different. Is Different category as if you're in there my job is represented by a car a different color and so we can see the kind of proportional distribution of their genes in one of their For every day of this type and again it measure our activity in terms of the.

[00:36:35]
Amount of action under one under a set and even if these are only we can not just stand this distribution does not differ too much tearing through here during the study and it actually was appointed by the. By There's that is a contest we can take a square test and that is no significant difference in there in the distribution between friends are sacred summer is over and they are over until answer based on it.

[00:37:11]
And so door to conclude this 2nd question. Really we cannot observe the change in the user's behavior and this is mine. And my day because the just ones were fact well informed from the beginning of the authors died in the very browsing will be required and run difference in days it's not enough time for an answer from around in I'm sorry and so are these what you may store a longer terms of time of the.

[00:37:45]
Dough we expand and know with a longer term of the study we can actually see this change and also this result that me too not times out there and when sides of the quest I survey because on the top out of search it's all our pretty sometimes claims of date actually ultimately receivers are in the sky and now we're wanting to our certain parts of the presentation around me I want to investigate if I'm browsing the similar changes in a different settings and specifically or want to look at a demographic groups and also different brands I'm kind of quick.

[00:38:27]
So 1st let's look at the demographic groups. Can we have a go at me and my new reminds you of our about about our our original graphics we have these fairly friendly humans are these known in terms of. Jobs or fundraising genders and also in terms of their amazing who are.

[00:38:51]
Ranked as 3 there was a percentage basis in our in our men's discipline pool and we also have found to use them in terms of the age of the Franciscans for brands to age groups. So now. What we want to see if it actually attempt. Browsing became her.

[00:39:18]
Browsing the shares are changes all of them on a different demographics so what isn't Europe we consider a different class and go greatest and create our website. For example I'll transfer might we have people who. Will visit it felt transfer the time during those times in people who are.

[00:39:44]
An illiterate and so forth on these kind of guys we are and comparing this file used to using the I squared test I wasn't to see him think if this proportion of people who use it in origin or visa. Is different for different demographic for trying to harass Excel from somewhere here we are in the in and in the gender column only exploration is different for.

[00:40:14]
Our. For the 2 genders to be considered and human not just that and surely. Given that we consider when don't remember from so many whether this testing and many until just a correction we actually do not have. A significant significant difference in terms of the distribution but we have some of the values that are close to significant.

[00:40:46]
So for example in that hour and alternated and multimedia class I kind of course we can see that are they are different but close to me are significantly different for a very different genders and this is someone that one might expect given their cultural background. The same friends and of a government and if you value is considerably smaller for a different races and it's also under my original something that maybe we can explain why the.

[00:41:20]
Current situation in the us. Ok now let's move to the 2nd part of our question which is. In browsing the hindrance you 1st among different my 2nd question. Here is just sad illustration so many of you have an idea how they're x. how actually activity is distributed among different kinds of Greys don't we have.

[00:41:49]
A source here we have on the x. axis and you've got the greys and on a y. axis. Our measure of agility which is our amount of opportunity and amount of actions. And our Regency in that line that the. Largest weight is mostly concentrated on the end of this.

[00:42:14]
Second equation and and yeah I mean the incentive is in something understandable because it was her like Jim I got him going then he will usually be prouder than most I'm just so. How we can't actually. Describe the general pattern on there on the website though because. I said that we have different passions of a time of the different types of the actions and wave pattern and pick and so on up however on the click track and your relatives I actually use absent to describe.

[00:43:00]
Actions be informed directly on the website and not in the browser and therefore we can consider their browsing behavior in terms of. Just of us terms of number of actions between this 3 it action kind of question so let's look closer at this so. You know we have different from 2nd to Grace and rank and for each of them some friends among your balance a concern we have how do you find the amount of actions your entry off nice are our action homers.

[00:43:37]
And as you can see most need this just to be assume is the same for him for our Most of the phrases so we have a large amount of action on the click and also neural change and then small actions in terms of the time. But 1st and then a great is distributions actually to France for example.

[00:44:04]
And someone else related we don't have the time I think right. Here in the security concerns we can see the distribution significantly different from. Everything else so we have more clinics that and actually cause built change in your health and peace than to not and also again we don't have.

[00:44:29]
Almost don't have time. And so now I'm given that we're once all out formally comparing to distributions of things and activity among different as I've gotten so far this winter from preparing my sky square test for every pair off they off their website and quest Iraq and Syria in there in there.

[00:44:57]
In the table you can see the results of this test. It's important to not jump in for security concerns though I would imagine before him in a previous life we actually have significant difference in the distribution for every I know West has kind of quiet. And. Yet. We just show me just important to continue side region identify.

[00:45:28]
From the danger we can actually identify rescan carry over our side it is injured in security concerns and off for a 4 hour. We're. Going to ask. Again we have to apply. And mine's a correction from multiple times by just guessing here but we still have. We still have a significant difference from Monsoon into.

[00:46:00]
The time of month to meet our standards as significant indifference for file transfer and also if your interests are and for example in general for security if 90000000. Mostly our morals and the same comes were for example. Our And our trade insults which are still that even though there is no significant difference but they are alike.

[00:46:26]
Still higher than different from the other kind of course. And so yes and the security concern categories are very different from other wrestlers in terms of the. Items on the machine or on the website and so it's really closer and this. From 1st in our intention piece we had.

[00:46:52]
Different. Type of crap said to fall into security concerns got them please don't hold us who are suspicious something like Who flicks and kind of low standard like just invite you to click on it although it's not what you think also we have in place want Holder's attention I wanted software and said.

[00:47:14]
My joints your legs but my Georgian security concerns our websites in our in our database were actually there. Also if you will look and activity on the security concern websites I see on the flight over. It's a friend over the hour something Day So here and there are every in terms of there in terms of them in terms of the demands and days and also among different branches of the Regency and most of their teammates it is actually happening in the wait even longer.

[00:47:55]
Early warning and. This is something just to think about and probably for our database we do have enough of the observations of the Syrian security contracts are signed but this is just maybe am I here for you humans or direction just investigate and timing on when to friends and Emery's out outside I've been usually isn't.

[00:48:23]
And so to sum up this question in our case browsing here and does not depend on graphics features and wasn't given you know a large and dangerous as for this. And how we show them browsing the **** depends on how kind of some types of them are sent and this can help for the accurate modeling of the browsing we share because we can have different models for different colors of the rest are and also things are finding can be sourced to identify Melissa some sites and security and those security transplants and yeah because as we saw in until distributional behavior on this flight my sense is different from.

[00:49:08]
Ok and up the final question is about. It Richard I learned a structural problem just as I'm browsing patterns we retreat and use. Browsing be here and wondering and also. To never alter a stick looking sentence in things or generation. Yes Already interest in the capturing develop the properties of their browsing behavior.

[00:49:35]
And again we want to use this for modeling browsing behavior and it's important because we want to model it such as it's instinctual from 30 and it. And then when one point. Our data is actually our kind of in time series because each each action is assigned to a specific time point and we also is immense when we consider how we can see it it is our it isn't just a collection of sessions right in session is how the questions are and kind of a boss that's out of this kind of person the green box.

[00:50:21]
And in Intuitively we can. Consider just brought process might have Michael Roberts I just want to remind them mark of property. Says that the man. Seems a saint and that next next element of the sequence demands are only on their previous element or sound fine a number of previous Ammons and not on the entire 6 entire sequence because they haven't previously.

[00:50:57]
And. Here we actually are like on their own then on the right. Of their traditional transition probability magic and mystery of things by beating their mark mark off Michael Green and the standard Margaret chain which is another of the order of one. Into our data and 2 little clues there in.

[00:51:24]
Yes or no just what constructors are for example those are in just a 2nd. That we are after and this ancient mariner exit so I can go. This this and this and this magic shows and from somewhere once a probability event given that we are right now in very interesting time then we are like the next step will be a change for example right and we can see that here is probably just actually.

[00:51:55]
A kind of light and because it's a bright red color and this is something that aligns with an intuition because. Also friends are also friends I'm sure we have near Tampa and then we have the clique my After the new tower which is our. Also something that we could expect because I like after opening in time I'm going to perform some actions in terms of the peaking and also in terms of the time after time I think really acts that so.

[00:52:35]
To see their clique for example because like if you're trying you have to click 2 or maybe stand a mile or a cent oppose the comment. Right and you can always find to find things we can shift the mark of models in a different sensing So for example we can feel different mark of models for temperance users or even to have maybe I have enough information for any users region in different markets.

[00:53:06]
Margraf change of course happens in a graphics groups or a minister of a different website categorized and in this case. Does Michael chance would we look differently you can say they would represent different I don't want our behavior. And votes and our present this is similar to question 3 where we asked if if you will have a crack possession of them browsing what you also compared the market changes or if it is using the user self-appointed data and also my questions that are actually feeding on the real data and to compare even if.

[00:53:46]
There is an issue contributor and because of their not and maybe your Which interests us. It has often point to data from the sorry to do more of your. Browsing the sooner instead of performing an expensive data collection also we want to see what features significantly impact the accuracy of market model.

[00:54:12]
In terms of like money the browsing behavior and it turns out features could be. Demographics or and they're actually the times how much time people use are spent on land and then your friends are 2nd time rest and so on and as a future work there of change results for them wanting in for the day and in general their insides of their data it can be your starting it can be used to generate a many 60.

[00:54:42]
Day time. For them can be used for resume charge or for improving user experience conscious or less there is some I'm content talk I just want to go through some of the main points we design an experiment where. We can in browsing dangers or just your hands on her fridge and taste refunds statistical analysis of 4 for our database and read his comment that have people on average do not have a correct perception of their browsing both in terms of time and also of their contemporaries of the mass and if they visit.

[00:55:24]
We also don't find any evidence that they are pretty surprised change their browsing behavior because they are being observed. Are also we show that we discount them browsing machine or just not sure significant difference among the Democratic groups however we are sorry this is Michigan difference among. Of the rest are going to question and finally we suggested a future direction for a plank our findings for.

[00:55:54]
Want to link money into online here and also for. A very stiff and Elkins intended interaction. And that is it for joining Thank you. Thank you. That. You wanted to questions yourself or do you want me to feed them to you which message that you are for. I don't read it myself because I'm now against actually see in our.

[00:56:27]
Place on the 1st question from Phillip or was is there an influence on their day off week on the attic or is being brought. Up is a good answer good question so I can save and we don't find a significant difference. As significant difference between the categories. However we definitely can still go and.

[00:56:55]
There is like a clearer and clearer. A clear difference in terms of how the how the activity is just a futile triumphant day for the different days of the Rick. Right so for example in their underwear days we can see really like a hired series here from the morning and then like on the weekend it's a bit slower.

[00:57:25]
Now the next question. And you know the presenters also want to you think I'm the most important feature for the one telling powers in be here or. Just so I think the most important features would be as we saw on a website because emperors. Because. We saw them for some of them are some contemporary thing here is dignity completely different.

[00:57:56]
Than the others and so this some in my important feature to consider and. Also another important feature is actually an array and mounds of activity that. Act I'm sorry I meant like if we if we want to model of the games here or there. Or some separate users it's very important to consider their amount of activity that they usually have because based on these rules has a.

[00:58:27]
Question different a different model. Next question from time doesn't allow them to use or to pass data clashing skills or result always be here they don't mind and the timeline being west. Excellent question yes it. Has if it make it through it can happen but. First we have to give users this opportunity to kind of China all of the data collection and 2nd is you not just wrong probably as we have sound some secure and result in these times but it is not just we haven't for you.

[00:59:19]
Browned categorisation so we had some of their contemporaries already. Present in our database. Some of them well as I wouldn't expect them to be present when I spent a few people told. To turn off the central question from this kind of our site but they still being present So given that it has such a broad categorization and also also be random to me you can see actually the activity of the users there are a lot of activity where every day we can say that it's even down there can be some skilled and.

[01:00:01]
Insert not that significant. That answers your question and finding your last question from Prince Harry. Does on duty use or not or undermines if it's a good question no I am not only a few years or so there is a document if I'm not mistaken then we shall enter a document that matches the user uses to their use or say just when just documents is kept separately in go.

[01:00:36]
Into say a 100 stories to the press separately from author data and it is our responsibility to make sure that. They are dangerous cannot be. Healed but we have a new question yeah I had a fellow Yeah and of course anyone else you have any more questions and at the minute at least.

[01:01:09]
I'm sorry I couldn't hear you I am sharing your question from the ground and do we have a measure of when the data collection is turned off. It's a very good question I actually not just that I iced our eyes is keep forgot to mention despite the we have we have or have we have 8 have side categories and whilst Now I'm sorry we have 8 if you friend and sometimes and one of them is and wink and this time and this action that it actually I did indicates why I am the user is call my own but he's not actively new and they're not actively browsing divines imo if someone is watching and worrying we are not getting any actions from this person and this person is John line so we will yet.

[01:02:04]
And. We will get and. And Wayne signals right so that means if the question is on and the user is a language which means the browser is active and the user is connected to the Internet but we are not using any. Other action then every 5 minutes we would get to there to waste email and so on this way which eventually track when 2 users are online but just not being active and they and their and I were going to go into his own and went through a data collection is all yes I heard an answer to question in the mirror.

[01:02:54]
Yes. No problem yes. Ok so this is all the questions we have now a kind of blab for a bit so people have a chance. To put in their new questions anything final before we end the See that were over time. So I will say thank you very much.

[01:03:19]
For and hey audience is especially to like Yulia or like I'm presenting is like and have to work if I'm allowed to like faith and bias of course. But like I think you so much for this great heart of hand a pause for a few seconds and see if any.

[01:03:38]
More questions pop up and if not I will thank everyone earth ending for standing there like a Friday afternoon here at the. Yeah and I'm also all I was very pleased to to participate in this and. A lecture series Thank you for inviting internships and also the things you're telling me and for the questions also yes right to think we have no more questions and we will.

[01:04:11]
Not hear thank you again.