{"id":"BC5B0PrCphM","title":"Pagoda Community Session (December '22)","description":"Join Tiffany, the PM for Data Platform, diving into the Data Decision Tree, changes to indexer, and more!.\n------------------------------------------------------------------------------------------\nJoin NEAR's community:\nWebsite: https://near.org/\nReddit:   / nearprotocol  \nDiscord: https://near.chat/\nMedium:   / nearprotocol  \nBlog: https://near.org/blog/\nTwitter:   / nearprotocol  \nGitHub: https://github.com/near  https://github.com/nearprotocol\nDev Docs: https://docs.near.org/\nCreate a wallet: https://wallet.near.org/create\nApps on NEAR: https://awesomenear.com/\nLearn to Build On NEAR: https://www.near.university/\nGrants & Funding: https://near.org/grants/\n#Blockchain #FutureisNEAR #NEAR #nearprotocol\n#nft #dao","channel_name":"NEAR Protocol","published_at":"2022-12-05T00:00:00.000Z","thumbnail_url":"https://img.youtube.com/vi/BC5B0PrCphM/hqdefault.jpg","transcript_text":"welcome to another Community session uh Pagoda platform uh today we have Tiffany the product manager for data platform of the Pagoda platform and uh she'll be taking us through a few things so yeah whenever you have whenever you're ready go ahead thank you Josh um hi I'm Tiffany and I'm excited to introduce the ecosystem of our data platform recent changes and also our road maps in general so yeah let's get started yep um awesome so let's get started with the data platform decision tree and so I'm not sure if I shared this publicly before but um I don't think so it's a little it's a little tiny if we can zoom in a little bit Yeah I will yeah um in general um we want to develop the the plans we have for all the products and we separate them by three large stack here um and you can see in different colors of course um one is the building stack which is the green portion we're going to go over each one by one very quickly and the second portion is the observability stack so it's everything oh tools and products we are going to develop for the observability functionality and the last portion is the growth section the growth stack so this is all the growth tools or marking tools or any tools that are going to age and help the projects to grow so let's get started with the first tree here so um I and I can zoom in even more if we want to um but the Let's uh the the little red box saying that start here and the prompt I have here overall The Guiding and the mission of this data stack um building stack is the I am building my D app and I need to read and write data from the blockchain so I think I mentioned it last time um the blockchain from a data perspective could be understand as like a big giant database so um so yeah as a result you need to read data and write data from that big database um and the first question we have here is actually do you want to use a managed infrastructure so we know a lot of folks out there actually um want to have their own set of infrastructure and um you know and we definitely want to offer that as an option here so if your answer is no to the managed infrastructure then you can definitely have your own node running and you can run your node to power the RPC calls and we have the product called indexer framework that you can use that node to power and index your data yourself and if your answer is yes and you're like you know what I don't you know like I want just less stuff managed service good quality you know less work on my end of course that's we're here to help and the first question is do you want to write to the blockchain and read the most primitive data and if the answer is yes it's something we're all familiar with is start using the RPC and Pagoda RPC actually provides a premium RPC service with a really good SLA that is coming and we have a couple functionalities also stats page you know request Explorer all of that to help you monitor your usage as well as help you debug more easily and we have a 100x RPC project which will enable us to merge the archival node and the regular node so you actually don't need to separate it by you know I need to if it's data in within the five app pokes I need to use one or the other you don't need to worry about that anymore so next we have do you want to search through box chunks transactions accounts contracts events tokens and filter them by standard parameters of choice so examples of this will be you know if I want to get a certain blocks at a certain timestamp right if I want to get certain transactions sent by Josh or Austin received by Tiffany um then you will be able to use these API endpoints to filter them directly so no more complex filtering and all of that just get the information you need by input the parameters you need you can understand it as like a you know a filter or search function with a set of filters and hence the API is there to to help with that um and we are thinking about renaming this enhanced API words just because it's not intuitive so we will love any feedbacks suggestions on how we rename it okay next is do you need custom data points and functionalities within your within your smart contracts or custom aggregations so that is you know related to if you want to plug in a Time series table you know something related to the the maximum or the minimum in the seven day range or 24 hours range or even you know more complicated things like that you know it's not covered by an enhanced API so we do have something else that that's here to help um so the query API is actually going to enable this whole custom experience of the data points that you care about within your smart contract and in particular to your own application as well as you know you can design or Define your own way of aggregation so yeah and we are in active development of query API as well and we are hoping to release a MEP or beta version uh very soon and we'll have a web page that we're going to spin up for you guys to sign up if you're are interested in the beta testing so we're gonna get you in early so to get a first peek of what this product is about um also if you don't if none of these fulfill your uh your needs or requirements and um you're like you know what I you know none of these fulfill my requirements of data which I hope is very unlikely which is by Design um but if you still think think you have a very particular use case extreme you know very big big load of data you want a curry um then we have these near Lake and near Lake framework that you can use so what this does is we actually grab we actually run our node and index all the data dump it in an S3 bucket so it's actually also a managed service you don't need to manage your own node you need to manage the upgrade of the node or core you know all of all of that fun stuff we actually take care of all of that for you and you can just use an S3 bucket which is you know something a lot of people are familiar with at data Lake which with an AWS and you can pay for the data you read and you can build indexers on top and we have a indexer near like index or framework to help with that and also we're in a process of developing a more easier and more advanced version of the near Lake indexer framework so a couple of comments and feedback we get from Community around so like framework is that it's still pretty complicated you know you have to go through some details so we're sure coding a lot of them in and from now on you know you're probably gonna look at you know getting a blocks information before probably like 20 30 different lines of codes now it's probably going to be less than 10. so it's a pretty big significant significant Improvement on on that framework as well and we're in active process of collaborating with couple of community members to build more templates and examples around these two so it will also be an increase in improved in usability okay moving on so once you have your data and you know what you want um there are a couple ways that you want to access that data so you have the option of getting that data to push to you using a websock and web hooks um we are we know that Community are requesting uh this this feature or this functionality and we definitely hear that and we are in the planning of development of that um and how do I know if my usage and if these endpoints are running fine so this links to the whole observability stack that we're going to go through next we have a lot of observability tools that can help you with understanding how your data flows how your infrastructure runs and lastly is what else can I do with my data so these are some non-uh non-determined still being decided still been planned and scoped out tools but we hope to offer no code integration tools like sap here to get your data out of the blockchain and you know connecting to wherever you need and we hope to connect to oracle's question connectors and all that's really expend your data to be used in you know different scenarios and different use cases so that's the building stack and like I mentioned in here the observability status already previewed so I'm going to go through that now for observability stack the prompt here is you want a tools for monitoring and maintenance to help you easily debug and there are two sections in observability one is the visibility into your infrastructure and the API request you make and the second portion is visibility into a spark contract and its operational details that is the two areas we identified as the most helpful for developers in terms of the observability portion so let's go through the first one on the left the visibility into the infrastructure so for you definitely want to understand your usage and the performance you know latency any bugs errors that happens with the RP RPC or API calls all the API calls you made using Pagoda services and Pagoda API stats are there to help and it will have um do we have a screenshot I think we do okay yeah I think we do have a screenshot here in a documentation around what does that look like right now so uh the statistic page will have a Time series of how many requests you make um and as well as the breakdown by the method type and we're adding more to it as well so um stay tuned and you will be able to get you know your uh not not so Advanced grafana but we're we're working towards that um and next stop we have the get alerted if the API request is failed so you definitely want to know like what happens or any potential incidents as soon as it you know could have could occur so we want to you know monitor it from the API level um and this is also a product that's not been scoped but we realize that there's a need and next we have the go through request to better debug so once you know that your API request is filled then how do I you know how do I easily debug that what is actually going you know wrong with with my API request and we are actually going to dump all the logs record and dump all the locks and visualize it in a request logs explore kind of format for you so you can actually see what's going on with the API request the returns response and potentially we can collaborate with other tools that you use in the near ecosystem to actually track your bug all the way to the contract level um cool so the next um on the right we have the visibility into smart contrast operational details so the first one is the our old train Explorer um you know you want to understand and troubleshooting smart contract Behavior digging into any particular box transactions receipts anything like that you can easily go to explore and do that search we are in we are having multiple initiatives to improve explore improve the breathability usability and all of that so um stay tuned and we look forward for your feedback as well and your input on what you think needs to be improved on explore and second we have the know and react activity and incident and and I care about before my user so this focus on the smart contract and non-chain activity it's also a product that we'll probably are familiar with hopefully is the Pagoda alerts and triggering you can actually set a couple of conditions about your smart contract you know such as like the failed request sorry fill transactions or particular function calls or particular events and we're in process of implementing um you know like more powerful alerts and triggers and the more intelligent portion of that will be hopefully anomaly detection using the data um and this is also not been scoped and it's uh you know something that we want to develop but um you know it's it's a fun fun things to be part and next is understand my running costs on here so we do have a couple of folks really interested and really wanting to know about their storage cost and gas cost and you know how is house used um you know like how where is it allocated how it's calculated and we definitely want to do a better job in visualizing them and giving the visibility visibility of those usage so yeah so that's also in scope implant um and next and last but not least we have the growth stack so once you have your project up and running you know you probably would care about like I really want to maximize my impact and growth to the community to your users to scale your product to scale your business and here we also have two portion one is have a dashboard for business intelligence purpose for my D app and we already have a pagoda analytics dashboard available in console which provides you with analysis of transaction tvl my users gas you know all of that fun information about your smart contract and your on channel activity and next we want to have like the build your own dashboard portion that's if that's something that you are interested about you want to you know Define your own metrics then you have the ability to do so more things we want to plan for the template dashboard is also we know there are needs for our projects to actually build dashboard for the VC purpose um for for them to review or you know to pitch to fundraise so we we will be working with you know a couple of experienced VC experts to help build dashboards available for those purposes and there will be more other purposes dashboard that could be built and developed with consultation from the experts so hopefully those will also be in direct help with our projects to grow and um to maximize their impact and the last portion is you'll want to grow your diab and this is from some fun stuff using data so um once you do want to unders and understand your users better for personalization optimization so Pagoda insights is a product that we're planning um to use the on-chain data that we have and to build a custom or accounts profile account 360 profile it will all be anonymous for sure it will be just based based on a con con address um but but yeah so like this will be a big data data science machine learning all that you can say fun stuff we want to build for to analyze uh how you know each user is and are they more for example like parameters will be are they more prone to D5 or they're more prone to nfts are there active member of daos um you know are there high frequency Trader or a low frequency buyer so all those fun stuff will be available and we hope to have those to help you know the projects on chain um to easily you know like understand their users better and know where they can Target their users and potentially do some fun stuff with personalization um and their recommendation you know customize their customer experience all of that this is also not yet been developed but it's in active planning and last is do you want to increase your customer Outreach channels and we are thinking about creative ways to connect to other marketing tools that Pier was one uh with zapier you can actually connect to multiple Dimensions multiple tools that's available in the web tool world in the marketing perspective um so yeah we definitely want to utilize the data in that perspective as well this has not yet been scoped or resource allocated but this is on our mind so yeah that's all of the decision tree and um we are in a process working with our fellow devrel team here um to create a public page for these decision trees so you can actually look at it offline yourself looking at the documentation we have and yeah and speaking of documentation uh that's next section I want to go through and this is also you know collaboration with the brilliant team here at the deaf world team especially Damien um and yeah so we have made some changes in our documentation and we're around indexers so we hear is that you know we definitely want to have indexer as a concept to be better introduced and better understand by the community why is it documentation for index or a separate page you know we get questions like that so we actually merge them uh now and all available in the near docs so if you go on the first landing page for in your docs you can actually see the indexer portion um here and then you can go in and there's Concepts about introduction to indexers we merged some of the content we have for indexer documentation that we already created so it's actually here available now in the events topic and the indexer is a whole topic and the concept section and there are a couple of tools that we mentioned earlier around index or framework and like framework for your indexer building so you can actually look at them see read read about them look at what's going on and we also have another amazing portion here is near data flow so one uh plain points we realize about building indexers or the whole concept of indexers or reading data from the blockchain that we hear from a developer is that the how data flow is actually on your blockchain or how data is stored in near blockchain or how you know it's a structure on your blockchain is very not clear it's like hard to understand you know it's uh uh you know like it's it's complicated to figure out and that's like the high highest barrier of entry in building the indexer for a lot of our developers so we actually created a huge portion here about data flow on here and you have you know a little cute video that we created for for you to explain the concept you also have the word version of this of that video here um so you can go through it's very clear to see you know from chunks to from blocks to chunks to charts even and how transactions become execution outcome receipts and how it's returned and all of that relationship here we also have another newly released page that's called data on a blockchain and this is also a high level introduction on like the read data right data of um of you like anyone writing to near Boston I'm reading data from manure blockchain and we're gonna explain it in a really easy to understand way with some real life examples and how it's related to the data tools we offer and you can also find a little decision tree here that's the most recent one and then this is much smaller than we see earlier but this is our current state of what it is and that in the decision tree and the data tools at your ecosystem so you can refer to this as like you know what's going on right now what are the things I can use and last but not least you have this token transfer flow which is also explaining you know what's going on if you have a transaction that you want to track and this is also you know very important area and in a developed uh I believe in the develop area we also have um yeah we have indexer for Explorer here so um you want if you wanted to monitor the user activity we also have a couple of examples and important information that you can use for you know query the blockchain history using the indexer for Explorer and so you can also migrate to near Lake framework we know we know a lot of projects we're using index or framework before and they will like to use near Lake framework just because you know they it's easier you don't need to run your own node all of that really good benefits so there's some code you can also use to migrate to near Lake framework um and easily and we have a couple of folks already did this and replied was really good about this tutorial it's really easy to use and really smooth transition and we also have a couple of other tutorials around near Lake indexers in the example and tutorial section and you have you know more than a couple of getting started JS basic you know Python tutorial nft indexers it's more advanced version and like I said we are in the process of working with more community members to actually build those and Excel scale those into more use case driven um uh tutorials as well so not only in an FD indexer but also a D5 you know more it's coming so yeah that's everything I want to share for the updates here it's mostly around the plan for a data platform team and the things we have done on documentation side which is something we realized and we received feedback from the community saying that you know they would this was something that they would appreciate to be improved to see improvements on and yeah so that's that's all I have today awesome thank you thank you so much Tiffany super appreciate it Austin did you have anything to add to the conversation today no Tiffany Crusher that was awesome thank you so much Tiffany awesome cool well yeah I don't see any questions in the audience uh yeah if you have any questions please feel free to ask them now uh otherwise yeah we could probably wrap up a little bit early and upload it to YouTube and uh yeah if you have any questions there please feel free to leave a comment thanks everyone appreciate it we'll see you next time","transcript_synced_at":"2026-11-04T03:55:03.258Z","segments":[{"start_seconds":9,"text":"welcome to another Community session uh Pagoda platform uh today we have Tiffany","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=9s"},{"start_seconds":17,"text":"the product manager for data platform of the Pagoda platform and uh she'll be taking us through a few things so yeah","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=17s"},{"start_seconds":26,"text":"whenever you have whenever you're ready go ahead thank you Josh um hi I'm Tiffany and I'm excited to","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=26s"},{"start_seconds":34,"text":"introduce the ecosystem of our data platform recent changes and also our","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=34s"},{"start_seconds":41,"text":"road maps in general so yeah let's get started yep um awesome so","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=41s"},{"start_seconds":50,"text":"let's get started with the data platform decision tree and so I'm not sure if I shared this publicly before but","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=50s"},{"start_seconds":59,"text":"um I don't think so it's a little it's a little tiny if we can zoom in a little bit Yeah I will yeah","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=59s"},{"start_seconds":71,"text":"um in general um we want to develop the the plans we have for all the products and we separate them by three large stack here","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=71s"},{"start_seconds":80,"text":"um and you can see in different colors of course um one is the building stack which is the green portion we're going to go over","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=80s"},{"start_seconds":88,"text":"each one by one very quickly and the second portion is the observability stack so it's everything oh tools and products we are going to develop for the","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=88s"},{"start_seconds":96,"text":"observability functionality and the last portion is the growth section the growth stack so this is all the growth tools or","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=96s"},{"start_seconds":105,"text":"marking tools or any tools that are going to age and help the projects to grow so let's get started with the first","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=105s"},{"start_seconds":113,"text":"tree here so um I and I can zoom in even more if we want to um but the Let's uh the the little red","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=113s"},{"start_seconds":122,"text":"box saying that start here and the prompt I have here overall The Guiding and the mission of this data stack um building stack is the I am building","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=122s"},{"start_seconds":131,"text":"my D app and I need to read and write data from the blockchain so I think I mentioned it last time um the blockchain from a data perspective could be understand as like","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=131s"},{"start_seconds":140,"text":"a big giant database so um so yeah as a result you need to read data and write data from that big database","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=140s"},{"start_seconds":148,"text":"um and the first question we have here is actually do you want to use a managed infrastructure so we know a lot of folks out there actually","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=148s"},{"start_seconds":156,"text":"um want to have their own set of infrastructure and um you know and we definitely want to offer that as an option here so if your answer is no to","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=156s"},{"start_seconds":165,"text":"the managed infrastructure then you can definitely have your own node running and you can run your node to power the RPC calls and we have the product called","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=165s"},{"start_seconds":174,"text":"indexer framework that you can use that node to power and index your data yourself and if your answer is yes and you're","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=174s"},{"start_seconds":181,"text":"like you know what I don't you know like I want just less stuff managed service good quality you know less work on my","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=181s"},{"start_seconds":189,"text":"end of course that's we're here to help and the first question is do you want to write to the blockchain and read the most primitive data and if the answer is","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=189s"},{"start_seconds":198,"text":"yes it's something we're all familiar with is start using the RPC and Pagoda RPC actually provides a premium RPC","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=198s"},{"start_seconds":204,"text":"service with a really good SLA that is coming and we have a couple functionalities also stats page you know","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=204s"},{"start_seconds":212,"text":"request Explorer all of that to help you monitor your usage as well as help you debug more easily and we have a 100x RPC","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=212s"},{"start_seconds":222,"text":"project which will enable us to merge the archival node and the regular node so you actually don't need to separate","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=222s"},{"start_seconds":228,"text":"it by you know I need to if it's data in within the five app pokes I need to use one or the other you don't need to worry","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=228s"},{"start_seconds":235,"text":"about that anymore so next we have do you want to search through box chunks transactions accounts contracts events","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=235s"},{"start_seconds":242,"text":"tokens and filter them by standard parameters of choice so examples of this will be you know if I want to get a","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=242s"},{"start_seconds":250,"text":"certain blocks at a certain timestamp right if I want to get certain transactions sent by Josh or Austin received by Tiffany","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=250s"},{"start_seconds":259,"text":"um then you will be able to use these API endpoints to filter them directly so no more complex filtering and all of","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=259s"},{"start_seconds":266,"text":"that just get the information you need by input the parameters you need you can understand it as like a you know a filter or search function","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=266s"},{"start_seconds":274,"text":"with a set of filters and hence the API is there to to help with that um and we are thinking about renaming this enhanced API words just because","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=274s"},{"start_seconds":283,"text":"it's not intuitive so we will love any feedbacks suggestions on how we rename it okay next is do you need custom data","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=283s"},{"start_seconds":292,"text":"points and functionalities within your within your smart contracts or custom aggregations so that is you know related","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=292s"},{"start_seconds":300,"text":"to if you want to plug in a Time series table you know something related to the the maximum or the minimum in the seven","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=300s"},{"start_seconds":307,"text":"day range or 24 hours range or even you know more complicated things like that you know it's not covered by an enhanced","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=307s"},{"start_seconds":315,"text":"API so we do have something else that that's here to help um so the query API is actually going to enable this whole custom experience of","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=315s"},{"start_seconds":324,"text":"the data points that you care about within your smart contract and in particular to your own application as","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=324s"},{"start_seconds":331,"text":"well as you know you can design or Define your own way of aggregation so yeah and we are in active development of","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=331s"},{"start_seconds":339,"text":"query API as well and we are hoping to release a MEP or beta version uh very soon and we'll have a web page that","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=339s"},{"start_seconds":347,"text":"we're going to spin up for you guys to sign up if you're are interested in the beta testing so we're gonna get you in early so to get a first peek of what","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=347s"},{"start_seconds":355,"text":"this product is about um also if you don't if none of these fulfill your uh your needs or requirements and","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=355s"},{"start_seconds":364,"text":"um you're like you know what I you know none of these fulfill my requirements of data which I hope is very unlikely which is by Design","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=364s"},{"start_seconds":372,"text":"um but if you still think think you have a very particular use case extreme you know very big big load of data you want a curry","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=372s"},{"start_seconds":379,"text":"um then we have these near Lake and near Lake framework that you can use so what this does is we actually grab we","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=379s"},{"start_seconds":388,"text":"actually run our node and index all the data dump it in an S3 bucket so it's actually also a managed service you don't need to manage your own node you","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=388s"},{"start_seconds":395,"text":"need to manage the upgrade of the node or core you know all of all of that fun stuff we actually take care of all of that for you and you can just use an S3","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=395s"},{"start_seconds":404,"text":"bucket which is you know something a lot of people are familiar with at data Lake which with an AWS and you can pay for the data you read and you can build","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=404s"},{"start_seconds":413,"text":"indexers on top and we have a indexer near like index or framework to help with that and also we're in a process of","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=413s"},{"start_seconds":420,"text":"developing a more easier and more advanced version of the near Lake indexer framework so a couple of comments and feedback we get from","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=420s"},{"start_seconds":427,"text":"Community around so like framework is that it's still pretty complicated you know you have to go through some details so we're sure coding a lot of them in","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=427s"},{"start_seconds":436,"text":"and from now on you know you're probably gonna look at you know getting a blocks information before probably like 20 30","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=436s"},{"start_seconds":443,"text":"different lines of codes now it's probably going to be less than 10. so it's a pretty big significant significant Improvement on on that","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=443s"},{"start_seconds":451,"text":"framework as well and we're in active process of collaborating with couple of community members to build more templates and examples around these two","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=451s"},{"start_seconds":459,"text":"so it will also be an increase in improved in usability okay moving on so once you have your data and you know what you want","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=459s"},{"start_seconds":467,"text":"um there are a couple ways that you want to access that data so you have the option of getting that data to push to you using a websock and web hooks","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=467s"},{"start_seconds":476,"text":"um we are we know that Community are requesting uh this this feature or this functionality and we definitely hear","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=476s"},{"start_seconds":483,"text":"that and we are in the planning of development of that um and how do I know if my usage and if these endpoints are running fine so this","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=483s"},{"start_seconds":492,"text":"links to the whole observability stack that we're going to go through next we have a lot of observability tools that can help you with understanding how your","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=492s"},{"start_seconds":499,"text":"data flows how your infrastructure runs and lastly is what else can I do with my data so these are some non-uh","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=499s"},{"start_seconds":506,"text":"non-determined still being decided still been planned and scoped out tools but we hope to offer no code integration tools","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=506s"},{"start_seconds":515,"text":"like sap here to get your data out of the blockchain and you know connecting to wherever you need and we hope to connect to oracle's question connectors","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=515s"},{"start_seconds":523,"text":"and all that's really expend your data to be used in you know different scenarios and different use cases","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=523s"},{"start_seconds":531,"text":"so that's the building stack and like I mentioned in here the observability status already previewed so I'm going to","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=531s"},{"start_seconds":538,"text":"go through that now for observability stack the prompt here is you want a tools for monitoring and maintenance to help you easily debug and there are two","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=538s"},{"start_seconds":547,"text":"sections in observability one is the visibility into your infrastructure and the API request you make and the second","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=547s"},{"start_seconds":555,"text":"portion is visibility into a spark contract and its operational details that is the two areas we identified as","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=555s"},{"start_seconds":562,"text":"the most helpful for developers in terms of the observability portion so let's go through the first one on the left the","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=562s"},{"start_seconds":569,"text":"visibility into the infrastructure so for you definitely want to understand your usage and the performance you know latency any bugs errors that happens","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=569s"},{"start_seconds":578,"text":"with the RP RPC or API calls all the API calls you made using Pagoda services and Pagoda API stats are there to help and","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=578s"},{"start_seconds":587,"text":"it will have um do we have a screenshot I think we do okay yeah I think we do have a","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=587s"},{"start_seconds":596,"text":"screenshot here in a documentation around what does that look like right now so uh the statistic page will have a","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=596s"},{"start_seconds":603,"text":"Time series of how many requests you make um and as well as the breakdown by the method type and we're adding more to it","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=603s"},{"start_seconds":611,"text":"as well so um stay tuned and you will be able to get you know your uh not not so","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=611s"},{"start_seconds":618,"text":"Advanced grafana but we're we're working towards that um and next stop we have the get alerted if the API request is failed so you","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=618s"},{"start_seconds":627,"text":"definitely want to know like what happens or any potential incidents as soon as it you know could have could occur so we want to you know monitor it","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=627s"},{"start_seconds":635,"text":"from the API level um and this is also a product that's not been scoped but we realize that there's a need and next we have the go through","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=635s"},{"start_seconds":644,"text":"request to better debug so once you know that your API request is filled then how do I you know how do I easily debug that what is actually going you know wrong","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=644s"},{"start_seconds":653,"text":"with with my API request and we are actually going to dump all the logs record and dump all the locks and visualize it in a request logs explore","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=653s"},{"start_seconds":662,"text":"kind of format for you so you can actually see what's going on with the API request the returns response and potentially we can collaborate with","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=662s"},{"start_seconds":669,"text":"other tools that you use in the near ecosystem to actually track your bug all the way to the contract level","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=669s"},{"start_seconds":677,"text":"um cool so the next um on the right we have the visibility into smart contrast operational details","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=677s"},{"start_seconds":684,"text":"so the first one is the our old train Explorer um you know you want to understand and troubleshooting smart contract Behavior digging into any","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=684s"},{"start_seconds":693,"text":"particular box transactions receipts anything like that you can easily go to explore and do that search we are in we","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=693s"},{"start_seconds":701,"text":"are having multiple initiatives to improve explore improve the breathability usability and all of that so um stay tuned and we look forward for","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=701s"},{"start_seconds":710,"text":"your feedback as well and your input on what you think needs to be improved on explore and second we have the know and react activity and incident and and I","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=710s"},{"start_seconds":718,"text":"care about before my user so this focus on the smart contract and non-chain activity it's also a product that we'll probably are familiar with hopefully is","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=718s"},{"start_seconds":727,"text":"the Pagoda alerts and triggering you can actually set a couple of conditions about your smart contract you know such","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=727s"},{"start_seconds":734,"text":"as like the failed request sorry fill transactions or particular function calls or particular events and we're in process of implementing","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=734s"},{"start_seconds":743,"text":"um you know like more powerful alerts and triggers and the more intelligent portion of that will be hopefully","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=743s"},{"start_seconds":750,"text":"anomaly detection using the data um and this is also not been scoped and it's uh you know something that we want to develop but um you know it's it's a","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=750s"},{"start_seconds":759,"text":"fun fun things to be part and next is understand my running costs on here so we do have a couple of folks really interested and really wanting to know","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=759s"},{"start_seconds":768,"text":"about their storage cost and gas cost and you know how is house used um you know like how where is it allocated how it's calculated and we","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=768s"},{"start_seconds":777,"text":"definitely want to do a better job in visualizing them and giving the visibility visibility of those usage so","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=777s"},{"start_seconds":784,"text":"yeah so that's also in scope implant um and next and last but not least we have the growth stack so once you have","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=784s"},{"start_seconds":793,"text":"your project up and running you know you probably would care about like I really want to maximize my impact and growth to","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=793s"},{"start_seconds":800,"text":"the community to your users to scale your product to scale your business and here we also have two portion one is","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=800s"},{"start_seconds":807,"text":"have a dashboard for business intelligence purpose for my D app and we already have a pagoda analytics dashboard available in console which","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=807s"},{"start_seconds":816,"text":"provides you with analysis of transaction tvl my users gas you know all of that fun information about your","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=816s"},{"start_seconds":823,"text":"smart contract and your on channel activity and next we want to have like the build your own dashboard portion that's if that's something that you are","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=823s"},{"start_seconds":831,"text":"interested about you want to you know Define your own metrics then you have the ability to do so more things we want to plan for the","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=831s"},{"start_seconds":838,"text":"template dashboard is also we know there are needs for our projects to actually build dashboard for the VC purpose","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=838s"},{"start_seconds":846,"text":"um for for them to review or you know to pitch to fundraise so we we will be working with you know a couple of experienced VC experts to help build","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=846s"},{"start_seconds":854,"text":"dashboards available for those purposes and there will be more other purposes dashboard that could be built and developed with consultation from the","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=854s"},{"start_seconds":861,"text":"experts so hopefully those will also be in direct help with our projects to grow and um to maximize their impact and the last","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=861s"},{"start_seconds":870,"text":"portion is you'll want to grow your diab and this is from some fun stuff using data so um once you do want to unders and understand your users better for","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=870s"},{"start_seconds":879,"text":"personalization optimization so Pagoda insights is a product that we're planning um to use the on-chain data that we have","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=879s"},{"start_seconds":887,"text":"and to build a custom or accounts profile account 360 profile it will all","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=887s"},{"start_seconds":894,"text":"be anonymous for sure it will be just based based on a con con address um but but yeah so like this will be a","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=894s"},{"start_seconds":902,"text":"big data data science machine learning all that you can say fun stuff we want to build for to analyze uh how you know","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=902s"},{"start_seconds":909,"text":"each user is and are they more for example like parameters will be are they more prone to D5 or they're more prone","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=909s"},{"start_seconds":916,"text":"to nfts are there active member of daos um you know are there high frequency Trader or a low frequency buyer so all","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=916s"},{"start_seconds":926,"text":"those fun stuff will be available and we hope to have those to help you know the projects on chain um to easily you know like understand","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=926s"},{"start_seconds":934,"text":"their users better and know where they can Target their users and potentially do some fun stuff with personalization um and their recommendation you know","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=934s"},{"start_seconds":942,"text":"customize their customer experience all of that this is also not yet been developed but it's in active planning","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=942s"},{"start_seconds":949,"text":"and last is do you want to increase your customer Outreach channels and we are thinking about creative ways to connect to other marketing tools that Pier was","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=949s"},{"start_seconds":957,"text":"one uh with zapier you can actually connect to multiple Dimensions multiple tools that's available in the web tool","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=957s"},{"start_seconds":965,"text":"world in the marketing perspective um so yeah we definitely want to utilize the data in that perspective as well this has not yet been scoped or resource","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=965s"},{"start_seconds":973,"text":"allocated but this is on our mind so yeah that's all of the decision tree and um we are in a process working with our","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=973s"},{"start_seconds":982,"text":"fellow devrel team here um to create a public page for these decision trees so you can actually look at it offline yourself looking at the","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=982s"},{"start_seconds":991,"text":"documentation we have and yeah and speaking of documentation uh that's next section I want to go through and this is","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=991s"},{"start_seconds":998,"text":"also you know collaboration with the brilliant team here at the deaf world team especially Damien um and yeah so we have made some changes","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=998s"},{"start_seconds":1007,"text":"in our documentation and we're around indexers so we hear is that you know we definitely want to have indexer as a concept to be better introduced and","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=1007s"},{"start_seconds":1016,"text":"better understand by the community why is it documentation for index or a separate page you know we get questions like that so we actually merge them uh","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=1016s"},{"start_seconds":1024,"text":"now and all available in the near docs so if you go on the first landing page for in your docs you can actually see the indexer portion","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=1024s"},{"start_seconds":1033,"text":"um here and then you can go in and there's Concepts about introduction to indexers we merged some of the content","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=1033s"},{"start_seconds":1039,"text":"we have for indexer documentation that we already created so it's actually here available now in the events topic and the indexer is a whole topic and the","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=1039s"},{"start_seconds":1048,"text":"concept section and there are a couple of tools that we mentioned earlier around index or framework and like framework for your indexer building so","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=1048s"},{"start_seconds":1055,"text":"you can actually look at them see read read about them look at what's going on and we also have another amazing portion","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=1055s"},{"start_seconds":1063,"text":"here is near data flow so one uh plain points we realize about building indexers or the whole concept of indexers or reading data from the","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=1063s"},{"start_seconds":1071,"text":"blockchain that we hear from a developer is that the how data flow is actually on your blockchain or how data is stored in","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=1071s"},{"start_seconds":1078,"text":"near blockchain or how you know it's a structure on your blockchain is very not clear it's like hard to understand you know it's uh uh you know like it's it's","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=1078s"},{"start_seconds":1086,"text":"complicated to figure out and that's like the high highest barrier of entry in building the indexer for a lot of our developers so we actually created a huge","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=1086s"},{"start_seconds":1094,"text":"portion here about data flow on here and you have you know a little cute video that we created for for you to explain the concept you also have the word","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=1094s"},{"start_seconds":1103,"text":"version of this of that video here um so you can go through it's very clear to see you know from chunks to from blocks to chunks to charts even and how","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=1103s"},{"start_seconds":1112,"text":"transactions become execution outcome receipts and how it's returned and all of that relationship here we also have another newly released page that's","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=1112s"},{"start_seconds":1120,"text":"called data on a blockchain and this is also a high level introduction on like the read data right data of um of you like anyone writing to near","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=1120s"},{"start_seconds":1129,"text":"Boston I'm reading data from manure blockchain and we're gonna explain it in a really easy to understand way with some real","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=1129s"},{"start_seconds":1136,"text":"life examples and how it's related to the data tools we offer and you can also find a little decision tree here that's","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=1136s"},{"start_seconds":1143,"text":"the most recent one and then this is much smaller than we see earlier but this is our current state of what it is and that in the decision tree and the","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=1143s"},{"start_seconds":1152,"text":"data tools at your ecosystem so you can refer to this as like you know what's going on right now what are the things I can use and last but not least you have this","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=1152s"},{"start_seconds":1161,"text":"token transfer flow which is also explaining you know what's going on if you have a transaction that you want to track and this is also you know very","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=1161s"},{"start_seconds":1169,"text":"important area and in a developed uh I believe in the develop area we also have","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=1169s"},{"start_seconds":1178,"text":"um yeah we have indexer for Explorer here so um you want if you wanted to monitor the user activity","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=1178s"},{"start_seconds":1185,"text":"we also have a couple of examples and important information that you can use for you know query the blockchain history using the indexer for Explorer","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=1185s"},{"start_seconds":1193,"text":"and so you can also migrate to near Lake framework we know we know a lot of projects we're using index or framework before and they will like to use near","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=1193s"},{"start_seconds":1201,"text":"Lake framework just because you know they it's easier you don't need to run your own node all of that really good benefits so there's some code you can","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=1201s"},{"start_seconds":1209,"text":"also use to migrate to near Lake framework um and easily and we have a couple of folks already did this and replied was","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=1209s"},{"start_seconds":1217,"text":"really good about this tutorial it's really easy to use and really smooth transition and we also have a couple of","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=1217s"},{"start_seconds":1224,"text":"other tutorials around near Lake indexers in the example and tutorial section and you have you know more than","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=1224s"},{"start_seconds":1231,"text":"a couple of getting started JS basic you know Python tutorial nft indexers it's more advanced version and like I said we are in the process of working with more","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=1231s"},{"start_seconds":1240,"text":"community members to actually build those and Excel scale those into more use case driven um uh tutorials as well so not only in","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=1240s"},{"start_seconds":1247,"text":"an FD indexer but also a D5 you know more it's coming so yeah that's everything I want to share for the updates here it's mostly around the plan","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=1247s"},{"start_seconds":1257,"text":"for a data platform team and the things we have done on documentation side which is something we realized and we received feedback from the community saying that","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=1257s"},{"start_seconds":1265,"text":"you know they would this was something that they would appreciate to be improved to see improvements on and yeah so that's that's all I have today","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=1265s"},{"start_seconds":1274,"text":"awesome thank you thank you so much Tiffany super appreciate it Austin did you have anything to add to the conversation today no Tiffany Crusher","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=1274s"},{"start_seconds":1283,"text":"that was awesome thank you so much Tiffany awesome cool well yeah I don't see any questions in the audience uh","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=1283s"},{"start_seconds":1290,"text":"yeah if you have any questions please feel free to ask them now uh otherwise yeah we could probably wrap up a little bit early and upload it to YouTube and","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=1290s"},{"start_seconds":1299,"text":"uh yeah if you have any questions there please feel free to leave a comment thanks everyone appreciate it we'll see","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=1299s"},{"start_seconds":1307,"text":"you next time","url":"https://www.youtube.com/watch?v=BC5B0PrCphM&t=1307s"}],"youtube_url":"https://youtube.com/watch?v=BC5B0PrCphM","url":"https://near-pedia.xyz/videos/BC5B0PrCphM"}