Gitcoin Grants Data Portal
{"type": "project", "title": "Gitcoin Grants Data Portal", "logoImg": "bafkreifauq3d25y3rhyataxlt63hm25adll257o34xbj5exwhvy7474jqy", "website": "https://davidgasquez.github.io/gitcoin-grants-data-portal/", "bannerImg": "bafkreianaqqd2nafvggkouzsmbj4zcihaexma7gexdgswm6udpc53bs2tm", "createdAt": 1709238839292, "userGithub": "davidgasquez/gitcoin-grants-data-portal", "credentials": {}, "description": "# Gitcoin Grants Data Portal\nOpen source, serverless, and local-first data hub for Gitcoin Grants data to improve data access and empower data scientists to conduct research!\n\nVisit the portal [website](https://davidgasquez.github.io/gitcoin-grants-data-portal/) to download weekly updates of Gitcoin data packaged as analysis-ready `.parquet` files!\n\nInstead of fetching data such as donations, projects, rounds or passport scores from multiple APIs you can now get it all from one place, packaged and cleaned!\n\nThe Gitcoin Data Portal [repository](https://github.com/davidgasquez/gitcoin-grants-data-portal) contains code and artifacts to help process Gitcoin Grants data from the Grants Stack Indexer API. \n\n📦 Data portal Pipeline is an instance of [datadex](https://github.com/datonic/datadex) allowing you to:\n\n- Add new data sources to the portal, collaborate on better models (ala Dune) or submit an interesting analysis\n- Don't ask, fork it and improve the models, add a new source or update any script\n- Declarative stateless transformations tracked in git, executed in GitHub Actions and published to IPFS \n- Data, artifacts (like the entire DuckDB database), and models all version controlled.\n- Share and explore dashboards and reports with the world!\n\n📦 Key Features\n\n- Code, data and infrastructure are fully open source.\n- Uses open standards/formats and modular components (Parquet, IPFS, dbt, Dagster).\n- Permissionless!\n- Clone and edit things away! You're not blocked by any API rate limits, or closed data like in Dune.\n- All other git features like branching, merging are available because all the data is transformed declaratively as code.\n- Decentralized!\n\nThe project runs on a laptop, a server, a CI runner (that's the way is working right now) or a even decentralized compute network like Bacalhau. Oh, it even works in GitHub Codespaces so you don't even need to setup anything locally!\n\nData is stored in IPFS. You can run it locally, and it'll generate the same IPFS files if nothing has changed. The more people run it, the more distributed the IPFS files will be!\n\n📦 Extra\n\n- It supports all the cool things data engineers want; typing, tests, materialized views, dev branches\n- Uses best practices (declarative transformations) and state of the art tooling (DuckDB + Dagster + DBT + Quatro).\n- It has integrated publishing platform to surface Jupyter notebooks with useful analyses.\n\n\nMade by [DavidGasquez](https://twitter.com/davidgasquez), [DistributedDoge](https://twitter.com/DistributedDoge) and always open to new [contributors](https://github.com/davidgasquez/gitcoin-grants-data-portal)!\n", "logoImgData": {}, "bannerImgData": {}, "projectTwitter": "davidgasquez"}