Moving Beyond Pokémon Go: Augmented Reality and Crypto in Physical Gaming
ETHCC 4 · July 2021 · 48:33
Dan Komorny introduces a planned platform combining augmented reality and crypto with live-action games such as airsoft, paintball and laser tag. He places the concept alongside science-fiction visions of immersive physical gaming.
Speakers
Topics
From ETHCC 4, hosted by Ethereum France.
Transcript
okay hi everyone so we'll be starting with the video and that will be followed by death by powerpoint [Music] [Music]
[Applause] [Music] [Music]
so [Music] [Music] [Music] all right so what you just seen was our
promo video that we shot in chernobyl in the happier pre-corona times we are call reality and we are uh on the intersection between all of the cool emerging technologies so it's not just crypto it's it's drones it's the ui hardware and it's augmented reality and the multiverse as well so first let me introduce what we are actually about we started very humble beginnings in a friend's kitchen literally on one kitchen table five five to six years ago in 2015 and uh we've been from that point we've been we we never considered ourselves like
okay like this is something we can be turning eventually into any sort of serious business it was all uh open source open source from the start who wanted to come aboard by all means let's join and let's let's start working on this on this uh cool thing these these drones what you see what you saw in the video and what you will see in the on the on the next slides as well so as the time progressed we we of course we did hackathons where we uh introduced more and more concepts more and more technology uh bluetooth bluetooth beacons ultra wideband
i would go too much into into tech details uh but uh we we possess quite quite serious technical background as you will see on the on the slides as well all right um berlin berlin uh is uh as you know is a quite famous city for european city for startups and both hardware crypto the saying the scene is quite uh quite lively there but for us it was at that point of time it was since the project was still in the in the open source phase we weren't uh basically the finances weren't ending up and with the founding members moved with the founding with the
movement of the founding members to the west to the east actually to the to the ukraine we decided to move the whole project from from berlin to ukraine western ukraine or as well all right so moving on in 2019 we started working on on furthering our use case what we actually want to do with this with this robots over this drones and this this technology and we realized there's a huge huge uh segment in uh in uh physical gaming not not in digital one that hasn't been touched by any innovation for
for years almost almost decades and that segment is uh live action gaming airsoft uh paintball any any basically any sort of live-action shooting game that you uh use some sort of arenas or friends to engage in in some sort of pretended hostilities so so to speak um moving on we we started working on on the third prototype in june 2019 you saw you saw one of the the prototypes in the in the chernobyl video and uh quickly we realized that the turrets or basically like the
ground ground forces aren't enough so what do we need else we need something that flies right we are not yet in most of these airsoft and paintball games don't take place on at sea or drivers so we realize we need to go there and as you saw in the video there was the development of the drone drone gunship prototype and also that was shortly followed by by the shooting the video in internal build in 2020 we opened our first first physical location in our web in western ukraine the showroom showroom is is currently full of our of our prototypes on our of
our products that that you can see there unfortunately as everybody we know in march 2020 the the whole coronavirus shot shut us down so we've been we've been basically we have this this nice room nice showroom in in the way that we yet still haven't had a good good use for but we hope that that will change with the uh with the uplifting of restrictions all right and also we can see from the from the start of the last year uh from from may 2020 we started dabbling with augmented reality which was
uh what you see there the current reality point boyd was augmented arena concept um we want to put we want to put augmented reality glasses on players for for these live action games and for for airsoft and paintball games okay and now finally in our in our current phase where we started to add our crypto use cases for us and uh we we basically we believe the the metaverse we are taking a little bit of different different approach to the metaverse if you're familiar the title of the talk is beyond moving beyond pokemon go
so what pokemon go actually does is they uh build this this a award you are looking at augmented reality through your phone screen right and you can do it anywhere anywhere you are you don't have to be dressed for the occasion you don't have to be in some sort of specially designated playing zone it's just you pick up your phone and then you fall in the ditch if you if you've seen any news that there have been a lot of pokemon go players that that's actually why when it got first famous a couple years ago when a lot of players started falling into ditches and from the bridges while they were chasing the pokemons so we actually look at this like okay
perhaps there might be a there might be a different different approach how to how to actually achieve or conjure the metaverse so the basis of our approach is we are taking a tangible physical layer such as the the airsoft and the paintball arenas and then we are mixing it up mixing them up with the hardware that you already saw in the in the in the video and that's that would be that would be the major difference from from mentioned pokemon go because we really believe you need to start with something physical tangible you are already there you should be there you all dressed for the game you your your friends there they're also dressed for the game and
you should be basically that no no other no other reason for you to be there just to play the game and on top we follow with the first abstract layer which is uh software so in in our case it would be a suit of applications for uh for smartphones um that that aim to take the uh if you're familiar with any any online shooter all of your like battlefields call of duties all of the stuff fortnites we basically are taking the the the matchmaking and the game orchestration layer and we are going to put in we are putting it in the in the smartphone application for the players live in their field so suddenly if you
are if you've ever been i'm a former i'm a former uh professional counter strike player and uh also airsoft fan and a paintball paintball player and what i've been always missing is communication just a really simple means how to communicate um the the level of games all across the board is very well it's very uneven right you have your you have your players who have who scrunch together 200 300 bucks get their first first uh shooter their first rifle and some gear that's tactical pants that he uses for fishing stuff like that and then on the other end you have uh you have the professionals
who basically recreate the special forces militaries and they they are they are spending thousands of dollars for this equipment and part of this equipment is of course oops part of the this part of this equipment is of course uh the communication bulky talkies that we use and this is this is the first thing that we that we solve with uh with our software is the is the communication between players simple application on on android or ios paired with it with a cheap bluetooth earphone and suddenly you have now means to communicate with all of your team which also gets me to to the other part
of the of the application player rankings player stats matchmaking we are heavily focused on developing the esports uh esports scene with the uh with our with our gaming platform as well and esports players will be the probably the the biggest group that will be interested in in the professional uh professional uh solutions that we have all right moving on the the last part the the last part of the of the pyramid is ar augmented reality uh if you've been to the to the previous talk
you've you've seen uh there was a there's the word metaverse being thrown around and this is where we actually come in with our with with the final step of the pyramid so now you have now you have the these arenas now you have this cool hardware now we have supporting software to be to play in a game like this and well now you what the last step of the pyramid is the the actual code reality what conrealto stands for it stands for consistent reality meaning it's the reality that we all agree upon at this at this at this very moment and it's usually very
very temporary in nature this is this is the the site of uh our first b2b customers that we that we already signed um obviously you need you need a lot of space in order to be able to place these places all these robots all these turrets for players to just to get their get their tactics get there get their strategies and the arena arena operators like like this uh again this is our first b2b partner they have been very forthcoming when they when they saw what what we are actually dealing with they
basically signed signed with them immediately and if you know if you are if you are airsoft or paintball player you know come talk to me if you want to see something like this or something what we are doing um something that we are doing come see me and after after the talk and we can we can chat all right so this is the this is the just to just just to sum it up what are we dealing with arena robotics custom drones turrets and uh small vehicles the you already saw the drone and turrets the small vehicles are still for the time we upon appended the small vehicles i'll admit it was because of the the factor factor of the cool the definitely the drones and turrets look
much much cooler than those those tiny tiny cars but we are getting to them eventually as well what else custom player equipment big guns custom guns and arena gear and already mentioned arena glasses so originally what we planned to bring one of these we call this a little monster we wanted to bring is bring this here from ukraine but unfortunately european union customs weren't very happy about when they when they saw this in the car so
it had to stay you'd have to stay outside the european union but as you see our audio visual team they acted very quickly they took it back to our hq and they shot this this video which showcases what the buddhist what it actually does and how it how it looks all right so for the for the next next portion of the hardware this this specifically relates to the uh to the to the big guns and to to their player gear
we took it from a little bit from the from the fashion sense paris is a fashion city so our two very charming models esmeralda wearing a airsoft minigun based on the m134 vulcan and the psycho killer black and here yolanda dressed in the concept of the of the player armor that we eventually plan uh that we eventually want the players to use in their games and as you see uh he's also wearing hololens which i have uh here as well and for the q a we have some cool live nft presentation for you guys in store so um oh there should be plenty of time to
uh to show you the actual nft concept in in-game all right this is this is one of our other uh partners that we partnered with as you see these guys are focused on creating augmented reality glasses for rugged environment so it's mostly law enforcement officers and firefighters and basically any sort of rugged environment where you would need something you can drop you can spill spillwater on or even even shoot a small cable caliber projectile into it for the i can speak a little bit more about the um you i mentioned i mentioned hololens so
how how all of this actually ties together the hololens perhaps some of you know hololens is a strict device used for development it will probably never become a consumer device it's really not easily easily achievable not ready for mass market very hard to get but the the features al the development features are already there and the it's it's already suitable for for the coming future you will also see on the on the coming slides but basically apple apple has a big one is cooking a big one already patented for 2022 we are expecting a major ar glasses launch from apple which
should be should kick start the the augmented reality glasses evolution all right a little bit overview of this of the software what you see these are the these are the mock-ups from from the application and the the summary of the auto functionality not sure if you can see me from here already mentioned team comes a matchmaking player profile stats and we are slowly approaching the actual crypto in the crypto and augmented reality um one of the one of the last last partners regarding regarding software perhaps some of you are familiar with avatar sdk
they they have a very very neat and very simple solution how to create your own personalized 3d avatars this this is done from from one picture and as you see and roughly 15 seconds of computing time of your standard 2020 mid market smartphone so this is pretty impressive and of course we would want two players to start creating these avatars and actually replace themselves for the for the for the games itself and uh slowly slowly and not not just not just for our games but for other uh other platformers as well where they can use digital representations of themselves instead of their
[Music] player or the standard standard pictures all right so moving to uh moving to the intersection of the crypto augmented reality and and the methods so just as we as we believe that um ethereum with their you're now mostly familiar with these with these two lines or these two technical terms erc20 erc721 but um i'm assuming most of you is not are not familiar with the augmented reality part of the metaverse which we assume will be gltf and glb these two are the 3d model formats
and in the q a session what basically what you will see in those in when you put on the hololens those are those are the basically the gldf gltf files modeled as as 3d models in augmented reality or holograms so to speak so we deem these two to be the basic basic building blocks of of the of the metaverse and uh for the to prove my point i've uh uh i've selected a couple of a couple of use cases like why actually why would you use why would you use scripter for something like this like why just don't go with the sql database right the digital
stuff well um what we what we want to do is of course we don't want to and and we see this of course i'm not pointing fingers or anything but we see a little bit of this king of the silo mindset where everybody tries to build their own solution and then but in our estimation actually only hampers user and the developer acquisition and increase for for your project so you will you will see we don't have even vr at this point moment we are chain agnostic i won't go too much into into technical details but we want to basically to start starting partnerships with other
projects i already talked to uh to the bosun folks i don't see them there but uh yeah we are we are very open to uh to uh partnerships in this space but it would come to nfts and of these fds doesn't really matter okay so uh for the for some for some arguments if you ever anybody i assume gamers at least at least at least some if you're familiar with any sort of any sort of traditional premium a premium currency it's usually either it's devalued or as as as we see you cannot really use it anywhere you cannot do with any anything besides besides using it in
uh in there in the in the in the company store and the company companies game and it doesn't really do do anything beyond just generating revenue for uh for the company and uh if you follow that the the the newest development in in uh blockchain uh in gaming blockchain um innovations then uh if you're following stuff like xenfinity you see like there's already already pretty functioning play to earn model uh from uh from what i read on on crypto twitter there's already players in in countries like
i think it's philippines or bangladesh out earning their their average monthly salaries with just by farming farming these axes and uh we also we believe that the vr we are quite hedged against any sort of if you're familiar with the terminology any sort of grind like if anybody if anybody has the stamina to play airsoft game 24 hours or 16 hours then go to sleep and play again like by all means i'm pretty sure the arenas will be just happy that they will sell a lot of a lot of bbs and a lot of a lot of paintballs all right so moving on oops this is uh this is our implementation of
the for the for the fungible token in the game you will see in the in the queue for the q a session for the live hololens presentation we are using actually this representation of we call it credit if any of you played any sort of sci-fi cyberpunk game basically the credit cheats are those single swipe cards you find thrown somewhere you approach poop plus 100 credits that's so that's that's how they work and we have them we have them here prepared in augmented reality later we named we named the token uh the actual spelling is cipher and as i understand that we are we're on the in the ethereum ethereum conference and the
fox in ethereum doesn't have the problem but just there's just something delicious you know the common reality federal reserve it drives all the bitcoin max is just just mad you know when they see federal reserve written written in the name of the token okay um for for for this part we uh we are teaming up with the professional gaming students the gaming the game design studio from kiev called room eight and just to uh just to focus on the game on the game economy part of the of the whole project we really want to make sure that we don't create just just just another coin so so to speak we really focused on creating the game economy in such a way
that it will have the uh both the deflationary and inflationary parts as of this moment we are there we've been we've been discussing creating a dao but then we actually realized that at this point it doesn't make any sense if we see there's that there's there's uh there's a push from from the community to go into into this space i mean of course we are open but at this moment we we don't we don't see basically any reason to go the ego did away all right the nft use case which is which is pretty interesting as well what is
if you've attended any any blockchain gaming talk you probably saw a lot of a lot of companies work on the on the cross platform they'll plant for for multiple blockchains for their for their erc summon some 21 tokens what is what is actually the the original part in that that we are adding in is the unique game scenarios part so we want the players to create their own unique game scenarios that they will be able to package as an nft and sell them either trade them with other players put them as a as a stake in the in the live action game or put it on an online nfd marketplace and somebody can
can buy it and play this play this game in in their arena in their part part of the world yes okay now here's the uh here's the nfd in-game concept that you will be you'll be able actually to to fiddle with these 3d models as well but i'd like to show you like how does it how does it actually look in terms like we have some sort of technical difficulties foreign
uh i so as you see there's still some uh
there's still some wonkiness with the with the interaction the gestures and by the way this is stay state of the art 20 20 20 20 21. uh the the the the the wonkiness is still there it's obviously it's still still not not ironed out the kings are there but the redeem it's very important for us to already already start working on on the augmented reality on basically on the parts of the of the of the modeling in the augmented reality by placing the models uh dealing with the with the with the interaction and such all right so what are the actual reasons
for for for augmented reality to to use already mentioned the the physical games and again it's not just these aggressive shooty games like airsoft and paintball there's all i don't know what have you hide and seek treasure hunts like uh the the digital innovation hasn't touched this industry probably since the start so there's like two thousand years five thousand whatever of people just using their imagination when playing their physical games and then a short span twenty thirty years of digital games and digital games got extremely interesting over a short short period of time and if you
if you actually ask probably even even for you like would you like to put some some some gear in let's take the fantasy settings some some swords some armor and helmet and slap each other in the forest or do you want to just stay comfy in your in your house and the play whatever rpg or rpg or game games like that so this is this is what we address like the with the with the addition of augmented reality we want the games the physical the physical gaming the live action gaming to become interesting and perhaps even more interesting than the digital games itself uh
also the uh the the second point we we can already see then this goes back also to the to the to the metahorse part we already see uh the parts of the digital board like it's like it's like almost like they are trying to break out from there from the digital prism uh the the players playing the playing the physical physical games playing the uh airsoft arsenal paintball games they're already taking these elements from from uh from the shooters from your from battlefields and uh we see with uh with uh when we when we travel around and we ask even even these arena operators they they are quite desperate
just with the fact like it gets pretty boring there's no other way around it you can only have so much fun when you have team of five to ten guys and you are shooting shooting at each other in exactly the same way okay round one round five round ten and what now right so this is the the this is uh this is the the point where the the customization and the repliability and all of the all of the basic all the cool factors that you saw that you see in the in the online shooters that uh have their have their place in uh we see these elements have have naturally their place in the in the physical uh physical gaming as well
um i would like to talk a little bit more about the uh about the metaverse namely the uh the augmented reality part uh i for that i borrowed a couple of slides from neil trivette's talk from from three months ago it relates it's very interesting from from the point of view that we are we are at the crypto conference right and these guys they were at their own i think this this okay this was probably either siggraph or or some 3d graphics or computer graphics related related conference and yet they already perceive the metaverse to be uh like the the part that is missing is is crypto and you will see on the on the
on the coming slides for a little bit of short of death edition for for those of you who don't know i think at the third day of uh of of conference it has to be you had to hurt it multiple nobody knows exactly what is what is nanotechnology what is uh i don't know a couple couple of other technological aspects like everybody at this point everybody has their own definition for for metaverse but usually as you see it relates it relates to neil stephenson 1992 book snow crash where it was where it was uh uh first first mentioned and generally speaking like we are we are heavily influenced by the
by the cyberpunk and the cyberpunk genre and this is this is the exactly the slide that that i was talking about and as you see online economies and currencies and again these guys these are computer graphics guys these are not they have they have nothing nothing in common with with with crypto or anything and yet they already perceive that something like a cryptocurrency would be and should be part of the of the metaverse as well so what do we have the the actual current challenges from the obvious obvious ones that you saw
the hololens it was very hard to acquire the the in the last year 2020 the coronavirus managed almost impossible to acquire but we we pulled through we got couple and from from there on we started developing these concepts and these 3d models also mentioned uh apple for the for the next year coming coming with their ar flagship device a lot of a lot of people are are porting towards to be the big breakthrough ar ar event for 2022. we'll see also mentioned the ecosystem the console consolidation you have you
have plenty of plenty of small players most of the big players your htc's facebook's oculus they are still they're still i wouldn't say locked but they are basically they're they're still dealing with vr instead and uh instead of ar we believe the ar will be much much bigger than vr for a very simple reason in ar you still can trip when you when wearing these augmented reality glasses but in vr it's absolutely guaranteed that you will you cannot basically you cannot leave the room you need to have the boundaries right so it's not it's not so it's not so easy to uh to have the same kind of experiences for for vr as as in ar
for here i would i would also uh like to point um if you google chroma gallium they are very uh both bold underdogs challenging challenging the whole so far so far it looks like they are vaporware but uh we'll see so i'll give them a shot if you google the term you'll see they have they have the most most impressive implementation of the ar glasses so far biggest field of view i would say also cheapest lightest okay that's it so too many soft
all right so uh so it seems like we don't have time for the for the live nft presentation but just to take the edge of from all the guns and evil killer robots and evil ai we created a spin-off of the uh of our project and this this is specifically for for the for the younger younger children so something they they can they can enjoy in augmented reality [Music]
so [Music] [Music] so
[Music] [Music] thank you so if you have any question
you can you feel free to to meet him at the conference you