Filecoin / Bacalhau - Compute over Data

On Tuesday, 5th September 2023, we were delighted to host the 'Using Lilypad for Decentralised AI and ML' workshop for the Open Data Hack powered by Filecoin! A big thank you goes out to Ally Haire from Lilypad for holding the workshop!

Ready to build? Check out our Hacker Pack on Notion for all the resources, workshop dates and bounties:
https://encodeclub.notion.site/Open-D...

Open Data Hack powered by Filecoin:
Join the Open Data Hack Powered by Filecoin and showcase your skills! This three-week online event provides opportunities for developers to improve their skills and work on projects in the Filecoin ecosystem. Technical workshops and mentoring sessions are available for all levels of experience. Complete challenges and compete for prizes!

Useful Resources:
Questions zone: https://discord.com/channels/70579992...

Join the Community
🐥 Encode Twitter: https://twitter.com/encodeclub
🗣 Encode Discord: https://discord.gg/encodeclub

About Encode Club
Encode Club is a web3 education community learning and building together through fantastic programmes with the leading protocols in the space. Together we organise programmes like education series, bootcamps, hackathons, and accelerators both online and in person. We then help our community get jobs and funding for projects and startups. Read more here: https://www.encode.club/

About Filecoin
Filecoin is the L1 blockchain and storage network poised to power the open data economy. The Filecoin Virtual Machine brings programmability to Filecoin and has gained traction with thousands of developers who are building exciting new projects and companies!

Timestamps:
00:00:00 - Introduction
00:01:20 - Lilypad Vision
00:03:00 - Lilypad Technicals
00:05:00 - Lilypad Applications
00:06:24 - Getting started with Lilypad
00:26:00 - Ideas for Hack
00:27:00 - Community and Resources

Verifiable, truly internet-scale distributed compute networks are necessary for the next stage of web3 development. A lot of discussion has gone into friendlier UX & scaling blockchain over the past year, culminating in account abstraction & ZK proofs. However, the next frontier for computing is really at the data layer - to build truly decentralised applications that can run at internet scale requires more efficient off-chain computation (that isn’t a centralised backend!). This opens up the door to so many opportunities unavailable in the web2 world including ML DAOs, decentralised AI, DeSci & applications that take advantage of both the features of blockchain and the the power of distributed compute (eg. Waterlily.ai)

Speaker: Ally Haire

#DecentralizedStorage #filecoin #filecoinfoundation #web3 #blockchain #DWeb #cryptocurrency #crypto #decentralization #ai #generativeart #nft #collab #opensource #web3 #stablediffusion #generativeai #artificialintelligence #art #Filecoin #Lilypad #DistributedComputing #GenerativeAI #Web3 #DecentralizedInternet #Blockchain #AI #MachineLearning #IPFS #OpenSourceAI #CryptoEconomics #PeerToPeer #FILParis2023

The latest innovations in decentralized storage and blockchain technology are unveiled at FIL Paris 2023. Join Molly Mackinlay, Protocol Labs's lead for engineering and research, as she delves into the Top 3 Filecoin Breakthroughs in 2023. The video highlights Filecoin's mission to create a resilient and efficient foundation for humanity's information, the Filecoin master plan, and critical updates on storing, retrieving, computing, and scaling the Filecoin ecosystem.

Molly's insight into the remarkable achievements in robust retrievals, programmable compute, and global scalability presents a roadmap for Filecoin's current and future contributions to Web3. Her insider view explores areas like the Filecoin Virtual Machine, Lassie, Saturn, and more, all aimed at achieving faster retrievals, compute over data, and a decentralized storage network.

Learn how the Filecoin network, the world's largest decentralized storage network, is powering transformative changes in data handling and security. Discover how over 1.2 exabytes of data are being onboarded and how innovative technologies like Filecoin Saturn enable web3 CDNs and fast retrievals.

Engage with the future of data and blockchain technology. Watch now and become part of the Filecoin ecosystem!

Speaker: Molly Mackinlay

#DecentralizedStorage #filecoin #filecoinfoundation #web3 #blockchain #DWeb #cryptocurrency #crypto #decentralization #Filecoin #FILParis2023 #Blockchain #MollyMackinlay #DataOnboarding #FilecoinBreakthroughs #IPFS #GlobalScalability

LILYPAD: Why Distributed Compute is the Next Frontier for Filecoin & Web3 - presented by Ally Haire at Filecoin Unleashed Paris 2023 - https://filecoinunleashed.io/

Link to the video mentioned in the presentation: https://www.youtube.com/watch?v=aK12PRx8V0k

Exciting news! We're rebooting our Computer Over Data Working Group, where developers come together to share their approaches to decentralized compute and AI.

Join @DeveloperAlly & Silent Spring in chatting to HackFS winners DefiKicks, Daggle and Tentai about their compute over data projects!

Demo a application that use both Bacalhau and FEVM

This talk will focus on plans for expanding bacalhau in the web3 space, including ongoing work on the Lilypad Project, and the enabling user apps it can provide such as Waterlily.ai

Anti-cheating mechanisms and pricing models for decentralized computing platforms.

Compute networks like Bacalhau have enable users to execute trustless tasks over immutable data stored in IPFS. Now with Project Lilypad, developers can create full stack immutable applications by combining the the programmability and payments of FVM smart contracts with the off chain immutable infrastructure of IPFS and Bacalhau.

In this talk we'll cover the architecture of Project Lilypad and some fun new use cases it enables such as generative art (Project Waterlily), community building with generative NFTs, and enhanced Decentralized Finance (DeFi) primitives.

--
IPFS þing is a week-long gathering for the IPFS implementers community - April 2023, Brussels, Belgium.

Join Ally Haire, Developer Relations Lead at the Filecoin Foundation for a live-stream on creating NFTs on FEVM (using stable diffusion), and a walkthrough of Lilypad, which is creating a new model for ethical AI-art creation that pays the original artists for their work in Waterlily.

Once every month, the Starfleet teams get together to share progress in their projects in the format of a demo

[Compute Over Data] Bridging On Chain Payments and Off Chain Compute: Ethical Art, Generative AI, & Style Transfer - Overview of Bacalhau, FVM, Lilypad bridge, and Waterlily AI art project
Presenter: Wes Floyd

Compute Over Data enables trivial execution of functions against data stored in the IPFS/Filecoin network as easy or easier than existing solutions (Spark, Hadoop, etc)
Compute Over Data WG - https://www.cod.cloud/
Bacalhau Project - Learn more here https://docs.bacalhau.org/
GitHub https://github.com/bacalhau-project/bacalhau
Docs: https://docs.bacalhau.org/
Subscribe: https://bacalhau.substack.com/

We use these sessions for:
- Sharing progress made. These can be done in the format of a live demo, showcase of anything shipped (e.g. papers, architecture docs, etc) and any other kind of achievement that feels worth sharing with the group.
- Cross pollination opportunities made. Where folks get to learn about what others are doing and ask question on how they did it
- A way to keep project pace. Demo Days can be used as goalpost for delivering all the sprints results on time

To get involved, come find us on Filecoin Slack (https://filecoin.io/slack) and IPFS Discord (https://discord.gg/uSEwz3Dgsa)

You can also follow along with PL EngRes WG priorities and progress in realtime on our public Notion page (https://bit.ly/3tH34Vt)

The aim of Project Lilypad is to create an integration for users to call Bacalhau jobs in their solidity smart contracts and hence enable interactions and innovations between on-chain and off-chain compute.

This video takes a first look at running a Stable Diffusion job and a verifiable random number function (via drand) directly from a smart contract on #FEVM

Lilypad Github: https://github.com/bacalhau-project/lilypad

============================================================
About Bacalhau:

Currently Filecoin is known for being a decentralised storage and retrieval network, providing over 17 EiB of distributed data storage capacity to the world through thousands of Storage providers globally.

We can think of this distributed storage layer of Filecoin as the Layer 0, while the ability to perform on-chain computation - or computation over state with FVM brings Layer 1 capabilities to the Filecoin stack.
Bacalhau then brings the additional capability for off-chain verifiable compute loads on large data to the Filecoin Network.. Making for some powerful tools enabling new and innovative applications to arise.

Bacalhau is a platform for faster, cost efficient, and more secure distributed computation, by running jobs next to where the data is generated and stored. Bacalhau enables users to run arbitrary Docker containers and WebAssembly (WASM) images as tasks, meaning little (or no) rewriting of the workflows that already work.

Why Bacalhau?
⚡ Process jobs fast: Jobs in Bacalhau are processed where the data was created and all jobs are parallel by default.
💰 Low cost: You get to save on ingress/egress fees you encounter whenever you move data around since jobs are processed where the data is created, as well as reusing idle computation (where available)
🔒 Secure: Data is not collected in a central location before processing, meaning all scrubbing and security can be applied at the point of collection, and a far more granular, code-based permission model.

What will you build with Bacalhau??

Links:
🌐 See more examples on the docs: https://docs.bacalhau.org
🦄​ Follow our twitter @BachalauProject
👨‍👩‍👦‍👦 Join the chat: #bacalhau on the Filecoin Slack Channel (visit filecoin.io to join)

Join Zak Ayesh of Protocol Labs for a workshop titled "Building Applications with Filecoin & FEVM".

We are incredibly excited to welcome back a community favorite: From June 2-21, 2023 we are joining forces for the fourth year in a row with Protocol Labs, one of the ecosystem's biggest open-source research, development, and deployment laboratories. Their projects include IPFS, Filecoin, libp2p, and many more.

If you enjoyed last year's HackFS event, strap in—because this year will be even more phenomenal!

For the first time, we will have prizes from The Filecoin Virtual Machine (FVM) for a HackFS, a runtime environment for smart contracts (also called actors) on the Filecoin network. FVM brings user programmability to Filecoin, unleashing the enormous potential of an open data economy. We are excited to respond to a highly requested community demand after our successful hacks FVM Space Warp in February of this year and Hack FEVM which took place in November of last year with this!


-----------------

Follow us: https://twitter.com/ETHGlobal​
Check us out: https://ethglobal.co​m
Email us at: hello@ethglobal.com

Join Ally Haire of Filecoin for a workshop titled "Making Data Useful with Decentralised Compute".

We are incredibly excited to welcome back a community favorite: From June 2-21, 2023 we are joining forces for the fourth year in a row with Protocol Labs, one of the ecosystem's biggest open-source research, development, and deployment laboratories. Their projects include IPFS, Filecoin, libp2p, and many more.

If you enjoyed last year's HackFS event, strap in—because this year will be even more phenomenal!

For the first time, we will have prizes from The Filecoin Virtual Machine (FVM) for a HackFS, a runtime environment for smart contracts (also called actors) on the Filecoin network. FVM brings user programmability to Filecoin, unleashing the enormous potential of an open data economy. We are excited to respond to a highly requested community demand after our successful hacks FVM Space Warp in February of this year and Hack FEVM which took place in November of last year with this!


-----------------

Follow us: https://twitter.com/ETHGlobal​
Check us out: https://ethglobal.co​m
Email us at: hello@ethglobal.com

Join Ally Haire of Filecoin for a workshop titled "Making Data Useful with Decentralised Compute". A hands on workshop on how to bridge FVM to powerful distributed compute for running AI, ML and more with Bacalhau & Lilypad & how these projects are building new paradigms for the data economy.

We are incredibly excited to welcome back a community favorite: From June 2-21, 2023 we are joining forces for the fourth year in a row with Protocol Labs, one of the ecosystem's biggest open-source research, development, and deployment laboratories. Their projects include IPFS, Filecoin, libp2p, and many more.

If you enjoyed last year's HackFS event, strap in—because this year will be even more phenomenal!

For the first time, we will have prizes from The Filecoin Virtual Machine (FVM) for a HackFS, a runtime environment for smart contracts (also called actors) on the Filecoin network. FVM brings user programmability to Filecoin, unleashing the enormous potential of an open data economy. We are excited to respond to a highly requested community demand after our successful hacks FVM Space Warp in February of this year and Hack FEVM which took place in November of last year with this!


-----------------

Follow us: https://twitter.com/ETHGlobal​
Check us out: https://ethglobal.co​m
Email us at: hello@ethglobal.com

Join Alison Haire from Filecoin for a workshop titled "AI Art NFTs on FEVM with Bacalhau Stable Diffusion".

Hack the future of Filecoin! The launch of the Filecoin Virtual Machine is almost here. Come celebrate this momentous occasion and launch your first FVM application alongside hundreds of developers worldwide. Complete with talks and workshops from ecosystem leaders like Filecoin founder Juan Benet, get ready to explore the frontier of web3 and win over $150,000+ in prizes.


-----------------

Follow us: https://twitter.com/ETHGlobal​
Check us out: https://ethglobal.co​m
Email us at: hello@ethglobal.com


#ethereum #web3 #blockchain #eth

In this video we walk through how to make your very own open source Text to Image script (stable diffusion on a GPU) and how to run it on Bacalhau - the decentralised computation platform.

This example aims to show how easy and efficient it is to analyse large datasets with Bacalhau - you do not need any prior knowledge of data science or machine learning to build along with us here!

This is example is built in python using the Tensorflow machine learning library and based on stable diffusion for text to image processing and aims to inspire you to build your own models to run on Bacalhau! Feel free to 'show us what you got' by connecting with us in Slack!

Full example documentation can be found here:
👉 https://docs.bacalhau.org/examples/model-inference/stable-diffusion-gpu/


00:00 Intro: Building a Text to Image Model with Stable Diffusion
01:05 The Text to Image Model in Action!
04:45 Why Build with Bacalhau?
10:45 Bacalhau & the Filecoin Virtual machine (FVM / FEVM)
11:00 Bacalhau Architecture & Job lifecycle
14:10 Machine Learning & Stable Diffusion Primer
16:25 Let's code! Setup
17:25 Building & Testing the Text to Image Scripts on Google Collab
21:50 A Great Dane in Paris
23:00 Dockerising the build
23:30 Running our open source DALL-E model on Bacalhau
26:10 Pizza with no topping
27:10 Get in touch & stay updated!

============================================================
About Bacalhau:

Currently Filecoin is known for being a decentralised storage and retrieval network, providing over 17 EiB of distributed data storage capacity to the world through thousands of Storage providers globally.

We can think of this distributed storage layer of Filecoin as the Layer 0, while the ability to perform on-chain computation - or computation over state with FVM brings Layer 1 capabilities to the Filecoin stack.
Bacalhau then brings the additional capability for off-chain verifiable compute loads on large data to the Filecoin Network.. Making for some powerful tools enabling new and innovative applications to arise.

Bacalhau is a platform for faster, cost efficient, and more secure distributed computation, by running jobs next to where the data is generated and stored. Bacalhau enables users to run arbitrary Docker containers and WebAssembly (WASM) images as tasks, meaning little (or no) rewriting of the workflows that already work.

Why Bacalhau?
⚡ Process jobs fast: Jobs in Bacalhau are processed where the data was created and all jobs are parallel by default.
💰 Low cost: You get to save on ingress/egress fees you encounter whenever you move data around since jobs are processed where the data is created, as well as reusing idle computation (where available)
🔒 Secure: Data is not collected in a central location before processing, meaning all scrubbing and security can be applied at the point of collection, and a far more granular, code-based permission model.

What will you build with Bacalhau??

Links:
🌐 See more examples on the docs: https://docs.bacalhau.org
🦄​ Follow our twitter @BachalauProject
👨‍👩‍👦‍👦 Join the chat: #bacalhau on the Filecoin Slack Channel (visit filecoin.io to join)

In this video we walk through how to analyse Ethereum data on Bacalhau.

This example aims to show how easy and efficient it is to analyse large datasets with Bacalhau.

We'll do this by:
- Running a local Analysis of a subset of ethereum data
- Using Bacalhau to analyse this same data subset
- Using Bacalhau for batch processing the entire ethereum dataset captured and plotting the transaction volumes against block datetimes.

Full documentation for this example can be found here:
👉 https://docs.bacalhau.org/examples/data-engineering/blockchain-etl/


00:00 Intro to Bacalhau
02:50 Analysing Ethereum Data with Bacalhau
06:00 Local Analysis of a subset of Ethereum Data
09:50 Using Bacalhau to analyse the same subset of Ethereum Data
16:30 Massive Scale Analysis of the full Ethereum Dataset with Bacalhau

============================================================
About Bacalhau:

Currently Filecoin is known for being a decentralised storage and retrieval network, providing over 17 EiB of distributed data storage capacity to the world through thousands of Storage providers globally.

And we can think of this distributed storage network as being the layer zero of the Filecoin Architecture Network because ..
Storage is really only the start!

Bacalhau is aiming to revolutionise the way we compute and analyse over and with the data on both the Filecoin network and elsewhere by providing a platform for public, transparent, and optionally verifiable computation.

It enables users to run arbitrary Docker containers and WebAssembly (wasm) images as tasks against data stored in the InterPlanetary File System (IPFS)

It operates as a peer-to-peer network of nodes where each node has both a requestor and compute component

What will you build??

Links:
🌐 See more examples on the docs: https://docs.bacalhau.org
🦄​ Follow our twitter @BachalauProject
👨‍👩‍👦‍👦 Join the chat: #bacalhau on the Filecoin Slack Channel (visit filecoin.io to join)

No description provided.

Project Bacalhau is focused on helping projects increase trust via open data processing pipelines. This talk describes how Project Bacalhau is working to improve the state of Decentralized Science via public data processing use cases.

Over three days in April 2022, we brought together 50+ people from across the ecosystem (Starfleet, OuterCore and PLN) to discuss opportunities and architecture of Compute over Data.

- Core problems to be solved across analytics platforms
- How to meet data engineers/scientists with the tools they use today
- Vision (familiar, simplified, collaborative) and high level roadmap for Bacalhau

Learn more: https://www.protocol.ai
Subscribe to Protocol Labs: https://youtube.com/@protocollabs?sub_confirmation=1
Follow Protocol Labs on Twitter: https://www.twitter.com/protocollabs

Computer over Data Summit returns in 2023!
Dates: May 9-10
Location: Boston, MA
Registration: https://www.codsummit.io