Filecoin Filecoin Orbit, 26 Oct 2021

Previous Meeting Next Meeting

⏯

youtube image

►

From YouTube: State of the Art: Flash Demos on The Best Dev Tooling

Description

Like all decentralized protocols, the true strength of a project is measured by interest from the developer community. We've selected the most interesting projects building the tools that make developers' live easier when they choose to build on Filecoin. These are five-minute flash demos that will walk you through the project.

A

I'm here to talk about estuary, which is uh a next-generation, ipfs, node and archival storage tool uh and used for retrieval on the file coin network. um So I will start with um kind of giving a shout out to, I think, just a uh a lot of the open source work that goes into making estuary um a lot of this is by the protocol labs team by people in the ecosystem.

A

Over six years of, like thought and research going to all this and huge shout outs to people like stephen allen, who've made building estuary something possible, and if you want you can go into our github repo and you can look through all of our code. Everything is open source, so we're hoping that you take it. You use it. You fork it whatever. You need to do to build on top of filecoin and you can learn how we make storage deals and kind of have the same success.

A

We know that most people, though they're looking for something simple, like a lot of users, just want to be able to drag and drop files, and um you know upload them to the file coin network.

A

Before I think when filecoin launched, we didn't really have a good story for this, but today now we have many tools: you'll hear from web3 storage and ft storage as well for how easy it is to get data onto the filecoin network, and I think this is going to be a game changer, because now that you can do this and you can upload a file, you can get a link back. The feedback is so much faster.

A

I think it's going to make a huge difference, and so what people really want to see is proof that my data is on filecoin, and so what s3 does with all the tooling that you just saw and with a simple gui? You can know that your deal is on unchained and not only that you have the receipt, so you can click on a proposal receipt before the deal is made and you can see the file coin deal receipt as well. You can actually see how long the deal is going to be on chain.

A

You can see the retrieval links. You can see how big it is, and so we're really excited about the next stages of this and the improvements to tooling. That will allow people to add more data to the filecoin network, and so what's the point right so the point is you have valuable data? You want to make your data valve available to the world and ensure it's archived and retrievable from anywhere.

A

You need a simple tool to upload that data and proof that data exists, and I think today is going to be awesome because there's going to be so many really cool tools that we've made over the last six months. That really demonstrate how much easier it is to get data on chain into file coin and so estuary, where we kind of sit in the tool chain.

A

Is that we want to make uploading data to filecoin and replicating that data around the world, a five minute problem right so log in upload a file and retrieve the cid from any ipfs gateway boom? That's done right and then you can kind of go from there and know that as we work behind the scenes, you'll get that data stored on at least six storage providers, and so we have tools like the verify, your cid page, where you'll know exactly which providers in the world that data.

A

You know where that data lives and I think that's a massive improvement to tooling and I think there's a lot to do here that we can improve on, and so we're really excited from this point to see. What's next, we also provide a variety of ways. So one way to look at estuary as a tool as a next generation. Ipfs node, is that you can upload your data through many means we can give us a single file and we'll preserve the unix fs structure.

A

For that you can give us a cid, that's already pinned to an ipfs, node somewhere else and we'll put that to the filecoin network, or you can upload a car file, so all the all the innovation around packing data into different trees. You know we can take advantage of that and you can put that data onto the file coin network.

A

So uh we're not thinking in a rigid way, like there's only one way that you can use um the file coin network, we're actually thinking more broadly, so many developers can just simply you know, contribute open source code to our tooling, uh actually, all of our tooling right, the entire existing screen and make improvements and upload data.

A

So let's take a thousand foot view. I think um you know I here's a little map of the world, so you can see you know, uh you know how broadly, we think- and you know we'll- have some storage providers here and there use some peer ids and that's current state of the file coin network and we'll have some asteroid nodes and these estuary nodes will be making storage deals, and this is kind of like the rough sketch of what we were thinking right. So just you know how do we?

A

How do we start making putting these nodes around the world, so they can make deals and as we grow up and as we improve as an open source project that anyone can take and run themselves, we have, you know broader visions around like if there's data everywhere in every major city. You know we can help uh final. You know data to those storage providers and provide a place to do a lot of really cool things. Around post-processing of data and et cetera.

A

So estrella is just the beginning of that to report on some of our performance. You know we have 17 000 deals on chain as of last week. Twenty one thousand of them successful: uh eight million plus files, uh five hundred terabytes um of uh pinned ipfs data, so you can get that from any ipfs gateway.

A

uh 151 terabytes of total steel storage- and you know, 111 111 uh storage providers are working with us, which is, you know, has been great um they've been super helpful, so you know we couldn't have this performance without great collaboration with the storage fires around the world. They come from everywhere and they give us a lot of feedback and they're they're. Really, I have to say they have temperance around.

A

You know just we have some bugs and we work together to fix them, and I just want to say I really appreciate all of you and thank you for working with us, and so the goal here, of course, is to keep these charts going up to the right, and so uh we are just on boarding data every day. In fact, by today, looking at the numbers, you know we're at 34, 000 file coin deals, 288, terabyte, steel storage on just our one estuary node.

A

So if you can imagine an entire web of these estuary nodes, uploading data and deduping data, uh it's just really exciting. So um how do developers use s3? I don't have much time, but you can find me on the internet and you can you know, look at our open source docs. You can write code into these docs too. You can, you know, get an invite for estrea here.

A

So if you want to use it, you want to use the api and quickly jump into here, and you know, follow our tutorials and I'm always available for any questions you may have. Apis are really simple. You have a curl example, you have a react example and you can reach us on twitter at a research group, and I hope to hear from you soon and thank you for the time and thank you, everyone, all the open source contributors who helped us do this. We really appreciate it.

B

Hi everyone, I'm kadir, I'm the pm for web3.storage and web zero storage is an easy, open and free way for developers to work with ipfs and falcoin. I'm sure you have heard it many times already today, but ipfs is appear to be a distributed file system that addresses files based on their content, not their location and filecoin, of course, is the incentive layer for that. The cryptocurrency-based, decentralized storage network and jimmy has already talked about why that is important, and what that gives you one thing.

B

Traditionally, that's been uh difficult to do, uh for new developers in particular was uh running your own infrastructure to work with ipfs and interfacing directly with filecoin can also be a little bit challenging because it's the storage marketplace and web 0 storage aims to make the process of storing data on this decentralized storage network as simple as possible, and for the initial launch, we've focused on providing a really awesome experience for web developers in particular, so we have a great javascript client and an http api and it's all lovingly tailored to make web developers really happy.

B

So, as I said, we have a client library for javascript that works in the browser and that works in node. We also have a client library for go, um but the only thing you have to do is essentially sign up, get your api key and store something in content addressable way and in distributed storage in less than five minutes on this on the screen, you can see the code, I think it's like less than 10 lines and people actually have used this in their applications.

B

Just copy paste and you're good to go and retrieving is even easier, so you can again use our client library to do that, but you can also retrieve from any ipfs node and from any gateway url.

B

We have awesome amazing, docs with tutorials concepts and a complete api reference and website storage set is simple, open and free, and the open part is the open architecture. It might be a little intimidating to look at it like this, but basically web 3.storage will never lock you in part of that is with ipfs.

B

So if you want to move to some other service in the future, you can just dump the cids and import them somewhere else that supports ipfs, because when you give us your files in either as car files or as um as raw files, what we do is we pin them for you so they're available uh in we have the pinata cluster, but also just uh through the peer-to-peer network, and what we do then is uh make them available in file coin.

B

So if you don't storage is not available for whatever reason your data is stored in distributed storage via file coin, and it can be retrieved by anyone no need to go through web serial storage.

B

um So this is the files listing page and it shows you all the things that you've uploaded to web studio storage and you can see again the cids there. So those are the cids that you can just copy and get access to from anywhere, and you can also see the storage providers and those are the uh falcon storage providers and following the links there, you can get all the details necessary to retrieve it from the filecoin network.

B

This is the storage api that gives you the same thing that you can get through the file listing in an api and uh best of all all of this is completely free, so no strings attached up to a terabyte and above that that we we ask you that you work with us to. Let us know what your plans are. So we can scale the service with your needs, and we can do that because of the economics of falcoid, because the more storage providers store useful data, the more they're rewarded.

B

So our costs are the overhead of running web2.storage. Then we don't pay for data storage, and neither do you and um like in very simple terms. It's like file, because storage providers commit their hard disk space to the falcon network.

B

There are significant block rewards for doing so and which translates into real world profits and, as you can see, from the cashbacks, this incentivizes falcon storage providers to continue committing additional artists based on the network and when, when they store data from users on the network, their likelihood of winning block rewards goes up by a big factor factor of 10x and, as you can see, uh the potential profits that you made by starring real user data, and this is such a powerful incentive for falcon storage providers to store user data, such as the data from webster.storage that they are willing to offer free storage in order to get this block reward.

B

Multiple and as long as blocker voice continues to be a powerful incentive for falcon storage providers, which will be true for a very long time. Search should be free for all verified users on the falco network, and that allows us to offer uh free storage on filecoin, through web3d storage and, um to recap, web3d storage is super simple: to use, you'll be storing and retrieving files in minutes, and it's using open standards will never lock you in that's the power of content addressing and distributed storage, it's completely free to store and retrieve from.

B

So if that all sounds good and you want to give it a try head over to web2.storage sign up and follow our simple, getting started, guide browser docs find out how to build simple, serverless, apps and apps and join us on the ipfs discord and the web3 storage channel in slack.

B

C

Okay, hi everyone, I'm yousef, and I'm here to talk about nft storage, which is thankfully could here just explain almost everything you need to know about antidote storage, because it's very much like web3dot storage. uh In fact, we launched nft storage a few months before, and web3 storage sort of builds on the same premise, so we've got um the only difference really is nft. Storage is for nfts. So it's for the media assets, images, video whatever and also the metadata that you're going to use to describe those assets.

C

So what I'm going to try and do is give you a literal five-minute demo. How do you get stuff on the web or into nfp? That's george, a cheated tiny bit. I've already created a node project and I installed the dependencies. I've installed the nft storage package, but there's an empty source file here, so I'm gonna, say index.mjs and then we'll start importing stuff, so import, nft, storage from nfp storage and I'm also going to pull in this file thing and then I'm going to grab some stuff.

C

So I can read things from the disk, so import file system, all that, um and actually I'm going to super cheat and copy paste all this boring stuff from a working version, because time is running out, so we've got imports and this is just to read in the file and we're going to need an api token. So back here on the site, I can go to my api keys. I've already logged in since this is the speed run version and I can copy.

C

I can create a new api key once I'm signed in and copy it to my clipboard here now, I'm going to just make a global variable and paste it in in a real app. Of course you would want to protect your token, but we're I'll be throwing this one away. So all right, the stage is set. We've got uh everything we need, so I'm gonna make a function here.

C

Async function store, nft and it takes a file name and the name of the nft and the description string right and so then I make an nft storage, client.

C

New nft storage pass in the token and all right, so we got a client and now I'm going to read in the file.

C

Read file file name and then I'm actually I'm going to be using the store method, which is a little fussy about what kind of um file data it will accept. It wants you just to adhere to the metadata standard called grc 1155, so it wants the mime type to be included. So I'm going to use a thing called an npm package called mime to look that up from the file name, so type equals mime, dot, lookup image file, name all right, and then now I'm going to make a file object to contain the image.

C

This is going to be image, equals new file pass in the raw data, the bytes of the file and then also give it the file name and the content type. Okay. So now I have a file object, which is the same kind of object that you would have in a browser context, but here it's like a node polyfill and then now I can call the client method, so I'm going to return, client dot store and it takes image, name and description fields. uh This is all defined in that metadata standard I was talking about.

C

You can also optionally give it. You know, whatever properties you want here um and if you want to, you, can store any arbitrary data with nft storage that doesn't fit. This schema with a different store blob function, if you're interested in that all right. So now I have this again some copy paste from uh before for the boilerplate stuff. This is just a main function. That's going to read in some arguments and then call the function that we just defined.

C

Okay, so now fingers crossed this might actually work if I do node index and then give it some da some arguments.

C

Sadly, I forgot to code up a progress bar here, but hey it worked yes, so uh this first part is the cid of the root, which is actually a graph that contains a sort of a sibor object and then all the image that uploaded all the data there and everything else is linked to that graph. But you can easily get to just the metadata.json.

C

This is the bit you want to include empty when you're seeing this is the part that goes on chain and if you, if we had time, I would load this up in my pfs gateway and show you guys the thing, but you'll have to take my word for it.

C

Since I think I am running low on time um all right, let's see, I think that is probably all I've got um if you have have questions about nft storage. Well, first of all, let me first, let's say what might be the most important thing that I forgot to mention. It is also free, like web 3.storage, um there's no limits on how much you can upload.

C

We just want to make sure that you're using it for nft data at some point we might uh validate that these that are actually being included in nfts on chain um and yeah. We're also planning to add other nft related features. So we encourage people to use this instead of web 3.storage for nfts, so we can kind of tailor it to the needs of nft creators.

C

All right, um I think, that's all I got oh actually wow. My sp I was speedier than I expected. I have two minutes left. I just just looked at the clock, so um I could ramble on a little bit about nft.storage for a second. I suppose um we do have api documentation and um we've got client libraries that are in all kinds of languages.

C

A

C

Distinction between nft storage and web through dot, storage, uh okay, oh the time, is up all right number one. I'm done.