Tooling Open Science with Web3 & The Blockchain
ETHCC 6 · July 2023 · 50:24
Paige Donner examines blockchain tools for open-science initiatives. The speaker discusses how web3 systems might help put open-science practices into operation across research communities and institutions.
Speakers
Topics
From ETHCC 6, hosted by Ethereum France.
Transcript
[Music] all right [Music] good day everybody bonjour so nice to see you all at ECC week 2023 so my name is Paige Donner and welcome to tooling open science with web 3 and the blockchain so what we're going to be talking about today is more open science so seions so I know that a lot of us here in this
room are very familiar with Desai and I'll be addressing what some of the differences are between DSi and open science but just to start off with I would say that or open science is a really big umbrella and it allows all kinds of thought and all kinds of people and all kinds of backgrounds to participate in science so just a couple words about myself my name is Paige Donner and I'm the co-founder of Frontier Dao so Frontier Dao is the science focused Dao and we were founded in 2021 August 2021 and our
verticals are Fusion Energy space and climate Tech so we're a little bit different from some of the some of the other Dows in that we don't touch it all on on Pharmaceuticals or bio or biomedicines or things like that I'm also a small business owner so my company is iot logistics and it was actually through iot Logistics that I got involved with blockchain and it was actually through using blockchain as a utility for supply chain and that was in 2018 and I mentioned that because it's a woman-owned small business and while I live in Europe my company is actually based in the United States and it's
qualified as a Government Contracting Company and so through that company I'm actually a subcontractor to NASA on a stem inclusion award which kind of keeps me current on what the um on what the what the government is is doing in terms of Contracting and Science and r d so there's some of my contact there's the website frontier.xyz and I'm also the Builder and creator of Frontier registry which is an on-chain science publishing protocol which I won't go into too much today I'll just mention it towards the end today's agenda is actually um gonna I'm gonna do this presentation for about 20 minutes or so we're just going to run through what some of the um
what sort of the the state of open science today and then I'd like to open it up for the second part and do kind of more of like a workshop so q a is great but I'd love to see us all sort of form maybe little little groups of maybe four or five and do some kind of workshopping ourselves on on how can we solve for some of the pressing scientific needs of today using some of the blockchain tooling that I think probably everybody in this room is very familiar with okay so I mentioned that I am a subcontractor to on a NASA award it's a stem inclusion award um and that's why I'm very cognizant of
this their tops program so NASA tops is transformed to open science and the program was um stood up in mid-2022 it was funded by about with about 42 million dollars from the U.S government and I'll I'll go into it in more detail in the coming slides but the White House did actually acknowledge or announce that 2023 is the year of open science so um NASA as an agency tends to be sort of one step ahead and so they've already been tooling and creating some of these toolkits and workshops and information
and how can people get onboarded so let's just go through some of the basics of what is open science what what are we talking about when we say open science now the most important part the four most important tenets of open science is that it's it's transparent it's inclusive it's accessible and it's reproducible so let's dive into those just a little bit so open transparent sciences that means the scientific process and results should be visible accessible and understandable open inclusive science so the process and participants should welcome
participation by and collaboration with diverse people and organizations I want to underscore that a little bit because a lot of times in our in our Global conversations I mean sort of like the meta conversations of of inclusive I think a lot of times we think that we need to share the results of what our findings are but actually what inclusive was really speaking more to is to share the process of how we get to those results open accessible science so data tools software documentation and publication should be accessible to up to all fair is probably a term that a lot of you are familiar with I know Martin is probably
very familiar with the the term Fair which relates to data findable accessible interoperable and reusable I gave a shout out to Martin because he's with flamingo protocol so he's he's at The Cutting Edge of a lot of this stuff um and then reproducible science so I know that uh all of us in this room are probably somehow engaged in science so we're very well aware of the reproducibility crisis so scientific process and results should be open such that they are reproducible by members of the community so if you have some kind of Cutting Edge breakthrough and you go hey I cured cancer that means that you should be able to go in look at all the data and
go hey yeah he did because I was able to reproduce it right so okay so a little bit more about tops and there is a QR code there if you guys want to want to click on it that'll take you to their GitHub repository so their toolkits they've got all kinds of they're just great about creating really good information so um their Five-Year Plan is to accelerate accelerate open science practices so the roadmap is to enable five major scientific discoveries through open science principles broaden participation of historically excluded communities so that means double the participation of these groups
across NASA science tops is actually housed in the earth Sciences division of NASA but it touches on all the different areas of NASA increase understanding and Adoption of open science principles and techniques and I love this one support 20 000 researchers to earn NASA's open science badge so it's a it's a very interactive toolkit and and platform that you'll see that's still being developed but it's it's really picking up steam now so go go and check that out and get start getting your badges and then accelerate major scientific discoveries yeah so that's that's that's the roadmap
so this isn't a whole um a presentation about NASA but but one more point is that um this is actually a slide that I sort of took off of their program scientists their program scientists her name is shell gentleman and if anybody attended meta science a few months ago I know a few people from protocol Labs actually spoke at one or two people from protocol Labs also spoke there and shell shell spoke there as well um so she's the the program scientist of tops and you know again it's like open science is accessible reproducible and inclusive so it creates research that is it's cited more it has a bigger impact it increases transparency it's more
inclusive what does inclusive science mean more collaborative projects there's access to Hidden knowledge right so even a lot of times when data is made open or open source it still can be kind of hidden right it's kind of like you need to know where to look for it in order to find it even if it's open Equitable systems increased participation so by increased participation we do mean citizen science but we also mean all kinds of increased participation so um infrastructure funding policy and Outreach these are some of the areas that have been identified as where we
really need to start working on being able to not just communicate about open science but actually implement it and build the tool estate to implement it so again we need more people more hands more eyes more brains we need more people with diverse experiences to participate so that we ask the best questions and find the best Solutions and again these aren't my quotes I'm quoting from some of the top people in the industry Yale Harvard MIT NASA so let's talk a little bit more about infrastructure funding and Outreach um as I mentioned uh the excuse me the U.S government um declared this the year
of open science so um in May and June of this year so just you know like last month they held a series of listening sessions and it was kind of a very interesting process the White House Office of Science and Technology and Partnerships they actually held a weekly or for two over the course of two weeks they held twice weekly Zoom meetups and anybody could sign up it was open to the public they even had sessions in Spanish that were translated so they really tried to make it you know open and welcoming to all kinds of people who were offering their feedback and a lot of it was geared towards early career researchers because as what we're seeing is that as we put
together these policies of like hey let's let's do open science let's adopt these open science policies what we're also finding is that actually on a systemic level sometimes that's harder to implement than it may sound right so we we want to be collaborative we want to be open but then when you're maybe an early career researcher at an academic institution you may have rules and regulations at your own institution that prohibit it or in some cases actually make it regulatorily unfeasible if regulatory is a word um so I've just I've just noted some of the for the Americans in the room you'll you'll recognize some of these logos here but these are some of the biggest um U.S agencies there's there's NOAA
there's GSA there's there's this Smithsonian institution National Science Foundation NIH nist USDA so um all kind Department of Commerce and if you go onto openscience.gov you'll actually see a listing of not just a list of the government agencies but actually the actual programs that they're implementing to carry forth open science and they've all started they've all initiated actual programs and road maps so it's not just NASA now um this is not just a U.S thing now I I'm actually based here in in Paris so I'm kind of aware of what UNESCO is up to and UNESCO is actually all in on open
science it's really really exciting what UNESCO is doing so the UNESCO open science toolkit is designed to support implementation of the UNESCO recommendation on open science so the recommendation on open science is the first International standard setting instrument on open science so this recommendation was adopted by 193 countries in November 2021 at the 41st session of the UNESCO General Conference and their toolkit is easily accessible on their website and it also it kind of dovetails a little bit with the a little bit with the NASA toolkit in that it sort of walks you through
okay if you're a teacher or if you're an academic or if you're a researcher and you want to start practicing open science then these are some of the things that you can follow these are some of the um the I don't want to say protocols but these are some of the the guidance and the measures and the practices and I also we're here in France so it would be um it just wouldn't be right to not mention the cnrs so the French scientific research organization at the national level also has a plan for open science and this uh this quote here open access makes the movement towards disseminating
scientific production on the internet possible that actually comes from 2015. so open science isn't a new thing open science is a thought and a movement that's been around for over over a decade it's just that we've been I think kind of struggling with how do we how do we implement it how do we have the tools to actually be more collaborative be more sharing protect people's IP have data that's open um so so um I I actually really love this quote as open as possible and as closed as necessary so the European commission report on 2016. so again that's from this cnrs
and I I'd also like to mention because this actually just happened and it was very exciting and it'll stag very nicely into what we're going to be talking about in terms of Open Source open source software and open science can actually sort of really support one another and feed into each other um just uh just last week so the 10th to the 14th NASA and CERN so CERN is of course the nuclear um a regulatory agency down in Geneva um they teamed up and did a whole week-long Summit on accelerating access to open science and they had people it was open to the public too if you wanted to participate virtually which I did it was free if you wanted to go there
um you could excuse me you could go there as well but was what was so great and I think what is so significant about that is we need to remember that CERN is where Tim berners-lee worked as new as a nuclear physicist when he decided or when they as a team decided to make https public right would we ladies and gentlemen would we have the internet as we know it today if https hadn't been made open source public and free for everyone so that so that history I think is is very significant and it's also been
transformative for five plus billion people around the globe today right more than two-thirds of the world's population rely on their internet for research Commerce entertainment and Communications okay so so that's I think that's kind of where we're at we're at the point of like if we're gonna start using blockchain as tooling then um we need to think about what's come before us how did they how did they Implement governance when we were talking about this new thing called https and it feels like you know it feels like 15 20 years ago was a long time ago but I'm old enough to know that that really wasn't that long ago at all
so um here's just some additional resources there's great resources out there but open source science white paper of course the Jupiter notebooks probably a lot of you are familiar with the Jupiter notebooks and lab 2 ITC another great organization num focus is teamed up with IBM num focus is also um you know Jupiter jupiter.org and I really like this um quote by Alexi who works with both numb focus and the open source science which is kind of a they're sort of this they're sort of the same organization um Science and Technology okay so we aspire to convene these two
great Community efforts of the modern era by bringing together scientists and Technology developers to drive a new open era of progress so how a lot of people are looking at this nowadays is that we're not really going to have open science unless we actually figure out how to best practices Implement technology along with it right because it's all about it's all about data it's not all about data a lot a large part of it is Data okay so here we are at blockchain so home at last I know this is a blockchain conference so um so tool is for open science so I hear I'm going to mention um just just very briefly on one on only
one slide our project which is Frontier registry and I mentioned it because open science is a nice idea but how do we implement it so at that certain NASA conference uh last week they had a whole morning devoted to open source software and how open source software can actually work to be the implementation tool for for open science and I couldn't agree more actually because right now what a lot of the people in open science are saying is that okay we have policy actually this this is kind of what they're saying um Anna persick who runs the UNESCO division on on open science she says we have infrastructure so look at it as a
pyramid okay we have infrastructure then we have capacity building then we have incentives for the scientists and the researchers and then we have policy and right now what we have is we have policy at the open science level from the blockchain perspective we have all kinds of infrastructure but it's not being used or applied towards open science yet now I think that that's maybe kind of where D side comes into the picture right us desires are some of the first people who are kind of trying to Mastermind how can we use these blockchain tools to carry forth openness inclusivity accessibility reproducibility right transparency so
um Frontier Frontier registry is in an alpha release it's the on-chain publishing scientific publishing platform that we built and it's just an alpha release we got a little bit of a micro Grant from from polygon so it's just on the test net now and then we're looking to build it into beta but it's basically on-chain publishing right so if you're a researcher and you're like okay I just had this really great breakthrough but and I want to collaborate but I don't have the fifteen thousand dollars to pay nature or Springer or elsevier to publish my research um but I want to show it to my my colleagues I want to get their feedback
um so how what you know what do I do do I just put it in a do I put this Cutting Edge research in a drawer and let it not see the light of day because I need to protect my IP which is reasonable I there that I don't find any fault in that actually but if we have tools that allow researchers and scientists to actually share their work in in a way that protects their IP and makes it so that they will be recognized rewarded and have attribution for their work then let's let's do that let's do that because I feel that that is what's going to open up the floodgates of collaboration and that's what we're trying to do with Frontier registry
um there's a video um I'm not going to play the video right now but um so open science and and blockchain and then DSi so I would say that um Desai or decentralized science so I think the term Desai is still being defined by the ecosystem so it often it often right now implies the use of defy tools such as tokenized data but it's a very young movement it really only gained traction from like East Denver 2022 when I published Frontier registry as an ipnft that was February 2022 and DSi was not yet a trending hashtag in fact it
wasn't even a hashtag so that's that's how how young this movement is blockchain for science um I think has been a concept that is being has been thrown around for a little while and again blockchain tooling for open science implementation so more broadly interprets uses of the blockchain for scientific research and sharing such as like we discussed earlier Fair findable accessible interoperable reusable so again I think um I'm not really trying to uh I'm not trying to um compare apples and oranges although I wouldn't call it Desai and open science apples and oranges I'd call them I'd call them kissing cousins really actually I would say that that they can
really be very supportive of of one another and one can help accelerate I think I think Desai can help Implement open science and I think open science can help legitimize Desai because a lot of the things that I'm finding as I try to bridge the Two Worlds of say being a government contractor and then also being part of the the blockchain ecosystem is that sometimes buzzwords can have different reactions right so sometimes if you say d side people are like is that is that defy I mean what you know and then sometimes the the brain will just kind of like shut off like oh that's not something I don't want to get into crypto I'm a science
I'm a scientist right um and then but then when you talk about open science there's a there's a very strong recognition nowadays that in terms of implementing open science new tools are going to have to be not just created but actually used so oh um all right so so enough of me um talking talking what I'd love to do now is um actually if it's okay I would like to have us break into a few um a few groups and I did bring some some pens and some Bits of Paper and what I'd love to do is to see if amongst yourselves like four maybe groups of
four or five um we could sort of just do maybe a five minute or so um brainstorm amongst amongst yourselves to um you know choose some kind of a a scientific need you know cure cancer is always an easy one but um you know climate relief um you know energy Justice um um you know replanting Wildlife devastated lands Wildfire devastated lands it could be something or maybe you're already working on something very urgent that you could um that you could um uh find a you know to try to solve for um and then we could um we can you know
meet back after a bit of a of a of a collaboration and I think what we'd like to do is try to solve for accessibility transparency reproducibility and inclusivity um and maybe just the spark a little bit of of thought what we're doing at Frontier Dao is we're trying to actually solve for um for energy so our um our our sort of our big vision is uh is Fusion Energy and what we'd really like to see is um to use the blockchain tools to democratize energy right to actually render energy as a public good and we feel that Fusion Energy has holds that
promise um I'm not going to go too too deep into Louise about Fusion Energy because that's its whole its whole own subject um but let's just say that what we're trying to do is um systems Engineers so that bits and bytes become friends with Adams so um and it's just all about accelerating research and collaboration through open science tools enabled by the blockchain uh yeah okay so let me let me stop let me go back to that slide so um I was just going to do like a quick time check because I wanted to oh I'd like to break the room out into
um like small groups just to oh 13 minutes okay all right cool so um I have I have some pens and I have some paper if you might want to just maybe you could maybe even just turn turn to your neighbor in your in your um you can maybe just turn to your neighbor in your chairs and I've got some pens and papers if you'd like to just come up with like you know one or two suggestions as to what what aspect of blockchain would you use to solve for what problem do you see in scientific research thinking with the guiding principle of accessibility transparency reproducibility and
inclusivity um or maybe there's questions first if you have a question just raise your hand and we will give you a microphone second I had questions about the incentives because well I I'm not really a specialist of this of research in general but as far as I understand most of the research is privately funded and I was wondering what were the incentives for private institutions to
go into open science or to use blockchain because it seems like it's pretty good for a non-profit organizations but maybe less for the private sectors but I don't really know yeah that that's a good question well um I think open science is going to touch on the private sector differently from from the public sector um some of the case some of the use cases that I was bringing up are actually federally funded research institutions and so in the United States we actually have a mandate and also for example CERN Works under this eater which is the big Fusion conglomerate down in Provence here which has 37 countries as it's
um collaborators they're all under um like regulation to actually share their their data so for example in the United States any any federally funded research has to be made public so so you're you're bringing up a great um example for for private um but this but I think that would be a little bit of a different conversation if we're talking say I don't want to name a name but like a big pharmaceutical or a big yeah yeah so I've got some papers if and I've got some pens if you guys just want to kind of um uh collaborate for we'd have like five minutes
um and then maybe come back to the to the group and see if you have any suggestions um the most interesting to participate it's really really important if if somebody
thank you yeah yeah Define the problem and then and then and then try and then try and find it or suggest a solution or brainstorm about a solution yeah and uh basically uh yeah just just do whatever comes comes up you know what I mean like if you're um if you're if you're a researcher at an academic institution and you're like oh um you know I need to I need to publish this but I don't want to wait six months for a legacy publisher to actually give me the go-ahead how would I use
blockchain to publish my work but also make it um you know protect my IP yeah okay but if somebody don't have a pencil tell we will give you a pencil say s scientific may affect the utility blockchain
me um the accessibility transparent transparency transparency inclusivity and reproducibility yeah producer and every usability a reusability yeah yeah [Music]
okay how's it going yeah okay to be more specific Ally well you you could think about you in your in your line you could think about like regenerative like a regenerative issue like maybe replanting trees or
something how could we use the blockchain to replant trees because earth science is a big part as well or them yeah okay they're the best idea foreign but
for the sake of conversation it's important because probably many people who are going to um if I mean maybe it may be something you know but I mean but it's probably not going to log in here do you need a pen okay hey how's it going any you're solving all the world's problems yeah I don't I don't anybody to give
away their like best ideas but I just thought it could be good for for conversation than to get okay all right okay okay all right so I'll probably wrap it up and maybe so how about how about one more minute and then we'll reconvene and maybe share some of what uh what we were working on together uh just for like the final five minutes oh yeah yeah
all right yeah I gotcha okay I'm sorry okay all right thank you do we have a do we have a time do we have a time check yeah you know small oh 16 16 . oh perfect okay all right so we're good the next one starts at as the next one will start in 3 45 okay so all right yeah so until
1540 we can be here if it will be one or two minutes more not a problem okay okay perfect perfect okay so maybe we'll come back together um as a as a room and maybe share some of the stuff that that we um came up with I know that um some people were thinking you know I I think some of the I think some of what um what
we fall victim to in the blockchain space to be honest is that we get so um um familiar with all of the tooling that we know about and we and we forget that we are a little bit a little bit in a bubble like we are we are kind of experts on certain things and we forget that there's like a whole world out there that actually doesn't doesn't know about this so if you think that you didn't come up with something brilliant I bet you you did I bet you what you came up with is going to be brilliant for a lot of people out there so um can we let's start sharing the mics who wants to who wants to talk about what they what they came up with somebody want to start just raise the hand
hi and so I wrote series three things to to talk about uh first one is uh Cobalt bleaching uh due to the temperature who are going up the second one is carbon released by the permafrost same thing Anderson one is a bit different it's a Lyme disease due to ticks expansion so yeah three things to debate did your team come up with any any ideas about how to use the blockchain to Tool any of that not directly here but I have some ideas for for
some of these points about coral bleaching uh some companies are working on it to to create like hybrid corals who can support more than two or three degrees about the permafrost it's other people are working with uh an old cow I don't know in English but it's a The Rock and the yak okay so and they're also walking is a reason a lot of people are working on the mammoth I don't know in English I will say Mahmud maybe same world Mammoth
Mammoth the ancient um and because uh it's one of the idea who because they can hit a lot of lands they can keep the permafrost iced and so the carbon release will be lower so some scientific working on it and about the ticks expansion and the lime this is uh it's a big problem for a lot of people and I don't have I don't have the solution hi we are lip science and we are currently building uh with uh in real support University French University a
solution who is answering uh that was that was you asked you're asking now so we are actually rebuilding a system to allow a factors of research to publish with a blockchain and to share their work openly yeah so there is a lot of blockchain tools used for that and it's pretty long to just enumerate them all right so I understood that you were saying you work with a big academic
institution and your company is life like lib lipsions so it's kind of like libertacion so libsions yeah okay open science and that you're seeing you're recognizing that using blockchain tools for publishing is a very uh great way to implement okay understood great um the idea we had was more around the allocating funds so if you take a decentralized autonomous organizations you could think about putting the funds in one of
them and then thinking how am I gonna give um votes to different actors to make sure the the funds are allocated um in the most optimal way so you could say well people that put funds gain votes but you could also say people that contribute to the objectives of the organization and that are validated by peer review gain votes on the funds too so it's not anymore only the people that put funds in it it's also the people that contributed the most towards to your objectives and uh so you could think that it might push influence towards skilled and knowledgeable people
that are validated by by their peer basically but that would probably be a really ambitious project but uh yeah that'll be interesting yeah great so I understood you to say to use a dow structure so that people can actually participate as contributors in a monetary sense but also in in effort and in skill and in Talent right into the collective and then thereby have governance into what next research gets done or what project gets funded is that correct exactly yeah excellent yeah that's a very alternative methods of funding is a very exciting element of what we can what blockchain unleashes absolutely yeah who else
um uh so we figure out that um the data storage uh using the blockchain technology is actually very resilient one and maybe it could be used for things like storing data that that cannot be tampered and must be must be secure so for example either medical data or just vulnerable scientific data like data about humans uh it could be stored on chain uh I mean not sure for example stored on ipfs and then anchored on
chain so this new technologies allow creating this systems for storing data very securely and the same thing could be used for or use for example for the proofs of author the authenticity of the of the papers so for example if you find a paper you know that this is actually the version which somebody posted and it was peer-reviewed and it's uh it's like it's the real thing and it's not just some some copycat or just some fake information uh so this is this is for the for the data storage and the other idea we had was about the patent pools uh where they can be much more transparent and much more accessible
um when they are when they're for example tokenized and stored on chain because then it's very easy to track the ownership so it's easy to prove that actually I have access to this pool but on the other hand it's Unstoppable as in anybody can buy it so it's no longer a gated uh Castle full of lawyers who are giving away or not giving away the rights it's just like anybody can just go and buy a shower um yeah so this could also make it more transparent and more more robust so yeah these are these are the ideas excellent yeah those were all really excellent excellent points um I know we're running short on time and I think one more person has something to say okay so you guys are neuroscientist and
I'm an economist I don't know if you're okay with it great um my suggestion would be something that I've been thinking for quite some time there is a thing called complimentary currencies and these are currencies that act as an enhancer of local economic activity and perhaps with implementation of token based like systems like cbdc's you could create a tokenized monetary policy that is based on a jurisdiction so so in theory if you want to increase the development of agriculture in a region that doesn't have Finance like financing you could create some sort of economic incentives that increase the velocity of money for those tokens
within jurisdiction or if you want to increase wealth creation within a jurisdiction doesn't have enough money you can create Ultra like super sound money which is like deflationary Theory to be what these people have but you can continue that without needing any additional exchange of that token it could be used outside the jurisdictions as like a dollar or a Euro would be um and theoretically that could help make a much more flexible monetary policy uh incentivize people to grow regions that are underdeveloped or have been stagnant and you can share that data publicly to try to see if you can create a globalized monetary policy
that's something that I believe you could use tokens and blockchains for and it is scientific research if you count economics as science I don't know if anybody here doesn't some people don't that's that would be my suggestion sure great yeah economics is of course the science political sciences the science social science yeah excellent and I like how you um you used agriculture as an example but I would imagine that what you were just putting forth could be used for any kind of a subset whether it's uh you know Neuroscience or or climate technology or it could be any jurisdiction really right I think we may be out of time any one last one probably me oh good
um you know to do peer review you need reviewers and to have like high quality High skill experience reviewers it's very difficult myself has been has to be a reviewer in by many papers and Conference and I contact that because I don't have that much time and it's not a good you know it's not rewarded my time so how to create an incentive for that you probably we could use blockchain to trace any review and moreover you know when you do peer review you may have an interaction between the researchers that published the first iteration of the paper
and if you could trace or track any um constructive review and give like an incentive to take time to make a constructive review and not just make a very fast one because you have to do it then you know you would have like something that is more valuable to improve the final paper and if you have a better you know it would lead to better results at the end a better favor if you trick if you can use blockchain to track all contribution from the reviewers and reward them by having them on the final paper and then also think about how to give an incentive to transfer that to the
industry in a proper way where it's easy to use to solve real life problems and so if you can track the contribution all the long all the way from the beginning of the research to the participation of the reviewers until you make it usable for the industry then you could ultimately reward all the contributors from the from the beginning of the chain and blockchain can be useful for tracking all this and have like a yeah distribution key that is decided collectively and automatically reward everyone yeah yeah yeah great that was great all great contributions and and the last the finders did you correctly it's that we
peer review gets absolutely no reward there's no incentivization for it it's a hard job um and so and it's also un unrecognized and so it I want to incentivize it but also to to to recognize it with some kind of attribution or as we were talking about in open science it means to be to acknowledge the the collaborative effort of all yeah great awesome I want to thank you all very very much for this Seance Uber session and I couldn't have been done without all of you so thank you so much for all your great contributions thank you [Applause] [Music]