{"id":"fNPg3X_nYuo","title":"Exploring the NEAR Data Stack - Pavel Kudinov - Near Day at ETHDenver 2023","description":"Join NEAR's community:\nWebsite: https://near.org/\nReddit:   / nearprotocol  \nDiscord: https://near.chat/\nMedium:   / nearprotocol  \nBlog: https://near.org/blog/\nTwitter:   / nearprotocol  \nGitHub: https://github.com/near  https://github.com/nearprotocol\nDev Docs: https://docs.near.org/\nCreate a wallet: https://wallet.near.org/create\nApps on NEAR: https://awesomenear.com/\nLearn to Build On NEAR: https://www.near.university/\nGrants & Funding: https://near.org/grants/\n#Blockchain #FutureisNEAR #NEAR #nearprotocol\n#nft #dao","channel_name":"NEAR Protocol","published_at":"2023-03-17T00:00:00.000Z","thumbnail_url":"https://img.youtube.com/vi/fNPg3X_nYuo/hqdefault.jpg","transcript_text":"sorry for the glitch it worked thank you so much we got through and let's see if I can change the slides yeah oh that works too all right so let's talk about near data stack it's a basically a set of tools that allows you to get access to the whole blockchain history and query it it all started with the modification of the indexer node it's basically a full blockchain node that you can modify with the rust code extract the data from each block as it gets finalized on chain and store it somewhere so that was the beginning and then later we introduced last year we introduced the near Lake it's a way to stream blocks to your server which is actually 25 times cheaper than running your own node and much faster much easier to maintain it it's actually a cool a full storage of all near blocks in Json format that follows near core schema so it's fully compatible with the internal formats of the blockchain node it's capable of streaming 300 blocks per second to your server and actually sometimes even faster uh we already have more than 100 indexers running on the mainnet in a lot of different languages including JavaScript and rust that we support officially and then Community build and thank you community members for contributing uh python go Ruby and some others and we see more and the most important thing here is that this near Lake is always up to date with a network we make sure it's it's always the case and we also migrated Explorer near Explorer to use near Lake most of the blocks on your blockchain are indexed using JavaScript indexers and so today I'm happy to introduce the near Lake Primitives library that makes it even easier for you to build indexers you don't have to learn a lot about the internals of near blockchain receipts how events are stored Etc we brought a lot of helper methods for you so that you write much less code and you can access all this data much easier it's already available in npm as a JavaScript library and rust will be available later this month um sometimes you need to be alerted about things that are happening on the blockchain so if you happen to be building an indexer just for that we also got you covered what you can do is you can log into pagoda.co and create an alert on all the things that are happening on blockchain so we support triggers for successful and failed actions we support events function calls and account balance changes you can then once you set up the alert you can set up a destination for that alert it could be a web hook and then you can build pretty much any logic you want there's also a telegram and email support out of the box and if you ever miss the alert it's available on on console for you to see many adapts require access to tokens to user tokens FTS nfts near balance so we have a solution for that as well uh last year we introduced tokens API at last near con and since then we improved its performance and added support for all the fungible tokens that were created before the nap standard for fungible tokens was approved on uh near blockchain so we support all the popular tokens and if you create a new token yourself right now if it's following the standard it will appear in that API almost immediately we have interactive docs on Pagoda you and you can grab an API key and try it out and building custom indexers require you running your own infrastructure right you need to have a server in the cloud you need to have a database running you need to have an API to serve data to your front ends and you need to scale all of that to sustain the traffic of hopefully a mention of your project on some popular uh magazine right so today I'm thrilled to announce the new near query API it's a fully managed serverless platform to build indexer functions in the cloud and get graphql apis for that uh in our first version we're focusing on empowering developers or near boss so what we did is we create we created a bunch of widgets that could be used to develop indexers right inside of near bus you don't have to leave your browser you don't have to leave your tab you don't have to install anything on your laptop you just go to near bus you write the indexer code in JavaScript which is just one function and you here's the example of you know the indexer function for extracting near posts from near boss right from the blockchain and you'll also submit the database schema on chain right away this is a ddl schema SQL ddl schema we support postgres out of the box We'll add more uh more databases later the code and the DDR schema is stored on chain so it's a same experiences building widgets and once you store the data on chain we spin off an indexer function for you automatically and we create a database for you and we generate a graphql API that is instantly available and you can go to playground and see what's going on in like whether your indexer is working properly and while the indexer catches up with the network because you could have asked to start indexing let's say two three months ago or right from Genesis while it catches up with the network you can already integrate this graphql endpoint into your widgets on your boss again not living near boss tab on your browser you can also write logs from indexers to make sure they work properly and you can watch the status of the indexer at which block it is at this very moment the team is working extremely hard and thank you to the data platform team they've worked extremely hard to make this widgets working the invite only access to near boss widgets builder for indexers will be available in April subscribe to our waitlist and we will to make sure we will notify you and I'll be at the booth or near near booth tomorrow morning so if you want to chat about your use case and not necessarily about query API but also about nearly can any other data needs that you have I'm happy to talk about your use cases thank you so much","transcript_synced_at":"2026-11-04T03:52:12.777Z","segments":[{"start_seconds":0,"text":"sorry for the glitch it worked thank you so much we got through and let's see if I can change the slides","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=0s"},{"start_seconds":7,"text":"yeah oh that works too all right so let's talk about near data stack it's a basically a set of tools that allows you","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=7s"},{"start_seconds":14,"text":"to get access to the whole blockchain history and query it it all started with the modification of the indexer node","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=14s"},{"start_seconds":22,"text":"it's basically a full blockchain node that you can modify with the rust code extract the data from each block as it","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=22s"},{"start_seconds":29,"text":"gets finalized on chain and store it somewhere so that was the beginning and then later we introduced last year we","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=29s"},{"start_seconds":37,"text":"introduced the near Lake it's a way to stream blocks to your server which is actually 25 times cheaper than running","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=37s"},{"start_seconds":46,"text":"your own node and much faster much easier to maintain it it's actually a cool a full storage","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=46s"},{"start_seconds":55,"text":"of all near blocks in Json format that follows near core schema so it's fully compatible with the internal formats of","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=55s"},{"start_seconds":63,"text":"the blockchain node it's capable of streaming 300 blocks per second to your server and actually","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=63s"},{"start_seconds":71,"text":"sometimes even faster uh we already have more than 100 indexers running on the mainnet in a lot","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=71s"},{"start_seconds":79,"text":"of different languages including JavaScript and rust that we support officially and then Community build and thank you community members for","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=79s"},{"start_seconds":87,"text":"contributing uh python go Ruby and some others and we see more and the most important thing here is that this near","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=87s"},{"start_seconds":95,"text":"Lake is always up to date with a network we make sure it's it's always the case and we also migrated Explorer near","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=95s"},{"start_seconds":104,"text":"Explorer to use near Lake most of the blocks on your blockchain","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=104s"},{"start_seconds":112,"text":"are indexed using JavaScript indexers and so today I'm happy to introduce the near Lake Primitives library that makes","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=112s"},{"start_seconds":121,"text":"it even easier for you to build indexers you don't have to learn a lot about the internals of near blockchain receipts","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=121s"},{"start_seconds":130,"text":"how events are stored Etc we brought a lot of helper methods for you so that you write much less code and you can","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=130s"},{"start_seconds":138,"text":"access all this data much easier it's already available in npm as a JavaScript","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=138s"},{"start_seconds":144,"text":"library and rust will be available later this month um sometimes you need to be alerted","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=144s"},{"start_seconds":153,"text":"about things that are happening on the blockchain so if you happen to be building an indexer just for that we also got you covered what you can do is","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=153s"},{"start_seconds":161,"text":"you can log into pagoda.co and create an alert on all the things that are happening on blockchain so we support","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=161s"},{"start_seconds":170,"text":"triggers for successful and failed actions we support events function calls and account balance changes you can then","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=170s"},{"start_seconds":178,"text":"once you set up the alert you can set up a destination for that alert it could be a web hook and then you can build pretty much any logic you want there's also a","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=178s"},{"start_seconds":186,"text":"telegram and email support out of the box and if you ever miss the alert it's available on on console for you to see","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=186s"},{"start_seconds":195,"text":"many adapts require access to tokens to user tokens FTS nfts near balance so we","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=195s"},{"start_seconds":205,"text":"have a solution for that as well uh last year we introduced tokens API at last near con and since then we improved its","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=205s"},{"start_seconds":213,"text":"performance and added support for all the fungible tokens that were created before the nap standard for fungible","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=213s"},{"start_seconds":219,"text":"tokens was approved on uh near blockchain so we support all the popular tokens and if you create a new token","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=219s"},{"start_seconds":228,"text":"yourself right now if it's following the standard it will appear in that API almost immediately","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=228s"},{"start_seconds":235,"text":"we have interactive docs on Pagoda you and you can grab an API key and try it out","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=235s"},{"start_seconds":244,"text":"and building custom indexers require you running your own infrastructure right you need to have a server in the cloud","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=244s"},{"start_seconds":252,"text":"you need to have a database running you need to have an API to serve data to your front ends and you need to scale","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=252s"},{"start_seconds":260,"text":"all of that to sustain the traffic of hopefully a mention of your project on some popular uh magazine right so today","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=260s"},{"start_seconds":271,"text":"I'm thrilled to announce the new near query API it's a fully managed serverless platform to build indexer","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=271s"},{"start_seconds":279,"text":"functions in the cloud and get graphql apis for that uh in our first version we're focusing","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=279s"},{"start_seconds":287,"text":"on empowering developers or near boss so what we did is we create we created a","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=287s"},{"start_seconds":294,"text":"bunch of widgets that could be used to develop indexers right inside of near bus you don't have to leave your browser you don't have to leave your tab you","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=294s"},{"start_seconds":303,"text":"don't have to install anything on your laptop you just go to near bus you write the indexer code in JavaScript which is just one function","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=303s"},{"start_seconds":311,"text":"and you here's the example of you know the indexer function for extracting near posts from near boss right from the","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=311s"},{"start_seconds":319,"text":"blockchain and you'll also submit the database schema on chain right away this is a ddl schema","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=319s"},{"start_seconds":330,"text":"SQL ddl schema we support postgres out of the box We'll add more uh more databases later","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=330s"},{"start_seconds":337,"text":"the code and the DDR schema is stored on chain so it's a same experiences building widgets","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=337s"},{"start_seconds":347,"text":"and once you store the data on chain we spin off an indexer function for you automatically and we create a database","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=347s"},{"start_seconds":355,"text":"for you and we generate a graphql API that is instantly available and you can go to playground and see what's going on","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=355s"},{"start_seconds":362,"text":"in like whether your indexer is working properly and while the indexer catches","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=362s"},{"start_seconds":369,"text":"up with the network because you could have asked to start indexing let's say two three months ago or right from Genesis while it catches up with the","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=369s"},{"start_seconds":378,"text":"network you can already integrate this graphql endpoint into your widgets on your boss again not living near boss tab","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=378s"},{"start_seconds":387,"text":"on your browser you can also write logs from indexers to make sure they work properly and you can","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=387s"},{"start_seconds":394,"text":"watch the status of the indexer at which block it is at this very moment","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=394s"},{"start_seconds":401,"text":"the team is working extremely hard and thank you to the data platform team they've worked extremely hard to make","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=401s"},{"start_seconds":408,"text":"this widgets working the invite only access to near boss widgets builder for indexers will be","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=408s"},{"start_seconds":416,"text":"available in April subscribe to our waitlist and we will to make sure we will notify you and I'll be at the booth or near near","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=416s"},{"start_seconds":426,"text":"booth tomorrow morning so if you want to chat about your use case and not necessarily about query API but also about nearly","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=426s"},{"start_seconds":433,"text":"can any other data needs that you have I'm happy to talk about your use cases thank you so much","url":"https://www.youtube.com/watch?v=fNPg3X_nYuo&t=433s"}],"youtube_url":"https://youtube.com/watch?v=fNPg3X_nYuo","url":"https://near-pedia.xyz/videos/fNPg3X_nYuo"}