NEAR Data Center --- Open Call for questions, thoughts and data projects

Hi fellow NEARians, we want to kick off our first initiative at the NEAR Data Center, an open call for thoughts, questions regarding everything around data of NEAR, and gather data projects in development in the ecosystem.

Join NEAR Data Center here if you have not Telegram: Join Group Chat
Here is the Introduction of the Guild

What we are looking for

1. Questions about NEAR that we could answer using data from the blockchain
2. Data Tools that you think are missing in the Ecosystem (for example: leaderboards, stats pages, data alert/monitor tools, indexing tools, etc.)
3. Metrics you want to see which are not available yet
4. Data Projects that you are developing, or projects that you know is under development
5. Any ideas you want to share in the context of NEAR Data Center

How we want to use what you replied

Guide for the future development of the NEAR Data Center guild in terms of development area and prioritization.
For data projects, support and showcase.

How you can participate and earn rewards

1. Reply with a comment to this post with your thoughts and questions

1600×449 75.8 KB

1. Go to Data Center Page on SputnikDAO <Link here: Sputnikfund> and create a new proposal, select payout in the category

1600×858 131 KB

1600×858 107 KB

1. Get the Link of your forum Reply

1600×369 70.1 KB

1. Go to Proposal Page on SputnikDAO and past your reply link

1600×910 118 KB

1. Provide your account id on the Target field

2. If you don’t have a NEAR account, you can create on here https://wallet.near.org/

1600×910 120 KB

1. Leave your username/id on the NEAR forum in the Description field, just to make sure we can find and reward you

2. You may add descriptions of your proposal if you want to

1600×910 139 KB

1. Hit Continue to go to the next page, Fill out the Payout amount

2. Based on the current NEAR price (~$4.5-$5), we suggest the amount here to be no more than $5 NEAR, any proposals more than this amount will be denied.

1600×910 71.7 KB

1. You will be directed to this page on wallet to authorize a 0.1N transaction fee for the proposal

1600×846 62.3 KB

Your proposal will be open for up to 7 days of voting. If more than half of the council members vote YES for the proposal, you will receive the amount requested in your account.

I have an idea to build a virtual reality area (VR-DAO will love this) of NEAR data. Everything is intuitive, easy to understand for those who are approaching Near for the first time. I’m imagining it as a library!

@TRENDHEO
Love the idea! Please let us know how we can support the development of the project and looking forward to it!

I might be being naive and this data may well be readily available, but is there currently a way to identify unique members of DAOs on-chain?

So, how many unique NEAR wallets are involved with SputnikDAO.

With Astro, this metric will be way more relevant since there’ll be an opportunity to join as a member rather than just the Council AFAIK.

Just dropping this here – I’ve been playing around with on-chain indexing concepts, and have a PoC live currently:

Contract Integration

Integrate task triggers directly inside on-chain contracts

Cron-Near/contracts/blob/main/examples/cross-contract/src/lib.rs

use near_sdk::{
    borsh::{self, BorshDeserialize, BorshSerialize},
    collections::Vector,
    env, ext_contract,
    json_types::{Base64VecU8, U128},
    log, near_bindgen,
    serde::{Deserialize, Serialize},
    serde_json,
    AccountId, BorshStorageKey, Gas, PanicOnDefault, Promise,
};

near_sdk::setup_alloc!();

/// Basic configs
pub const ONE_NEAR: u128 = 1_000_000_000_000_000_000_000_000;
pub const NANOS: u64 = 1_000_000;
pub const MILLISECONDS_IN_MINUTE: u64 = 60_000;
pub const MILLISECONDS_IN_HOUR: u64 = 3_600_000;
pub const MILLISECONDS_IN_DAY: u64 = 86_400_000;

This type of data is great for trustless sources of aggregated values, think of historical price based oracles directly sourced contract-to-contract.

Hey everyone! My team has been working hard to set up an indexer that listens for specific methods on a specific contract (taking into consideration cross-contract calls) and also has the capability to do view calls to the blockchain when interpreting the methods. We just updated it today, and it is now also capable of connecting and passing information to web APIs. The current implementation connects to a CRUD API, and listens for specified methods on specific contracts of the user’s choosing and interprets those methods to keep a database synced with the blockchain. It is up-to-date with the recent nearcore update (v1.21.0). If you are interested in something like this, check out GitHub - Fayyr-Organization/fayyr-indexer: Contains code for running the Fayyr Indexer . The logic should work for any web APIs with a valid URL. If anybody does decide to use our indexer, my team is available to answer any questions, and we’d also love to hear about your projects and how you’re using it!

@David_NEAR

Thank you for the question, yes, this number can definitely be queried from the chain data.
We will add this to our key metrics to track and keep this in mind when we plan data efforts related to the DAOs on NEAR.
I am sure this will also be valuable for many DAOs on NEAR.

@hodlr Thank you so much for sharing this!
This is definitely valuable for many projects on NEAR, would love to know more about it and support the development and applications!

@mariavmihu Thank you so much for sharing!
I believe many of the projects on NEAR will find the Fayyr indexer very helpful!
Would love to know more and support your team further!

As shared yesterday with @tiffanygyj, I think Forensic (relating to or denoting the application of scientific methods and techniques to the investigation of crime) is a hot topic in the DeFi space.

Not only because the bridge between regulation and DeFi is being made, but also because the total amount of money lost by blockchain hackers is getting close to $22b.

Although NEAR is by design permissionless, it’s a question of time before users experience on-chain KYC. Mostly to begin with Dapps that conduct regulated activities such as trading and lending. Yet, that first / entry layer of security is often not enough and does not prevent any malicious actions down the road.

A forensic tool should be relevant from that point. As recently mentionned on another thread.

[…] Building the most secure network won’t prevent a hack. Keeping the analogy, I think companies should take for granted that they will be hacked one day, and therefore spend more resources downstream. For example, how to make sure the data the hacker has access to is useless / unexploitable.

A forensics tool like Elliptic on NEAR would be a first step. The ability to identify and track any fraudulent or malicious wallet and share this information with on-chain and off-chain partners would make real world interactions close to impossible, ultimately making the risk / reward ratio unattractive for hackers.

A practical and functional way to see that would be first, a tool that can give any first and second degree wallets in connection with a wallet identified as fraudulent. A second step, would be to offer a service to any Dapps to notify their users when they intend to perform a transaction with a wallet identified as malicious.

Just sharing some ideas.

Finally, I like the following quote (A Cypherpunk’s Manifesto by Eric Hughes).

Privacy is not secrecy. A private matter is something one doesn’t want the whole world to know, but a secret matter is something one doesn’t want anybody to know.

@Didier Thank you so much for sharing this idea here, I completely agree that this will be super helpful for projects in the DeFi space and will only be more and more important with time goes by.
I see this as a great project to collaborate with security and forensic related guilds in the NEAR community as well!

Can you build a website that can report transaction volume, investment, account activity of each dapps on the Near ecosystem?

I think it is essential for me to have a update overall of all the entire Near ecosystem. Other sources are unreliable and not have enough information

@AnhKhoa thank you for the question, we are actually in the process of developing a dapp leaderboard that can provide you with these information!
To make sure we cover all you are interested, I wonder what do you mean by investment?

Thanks. I mean that is the amount of money new investor put into project.

@AnhKhoa I see, so the funding status of the project?

yes. thank. have a nice days

I wasn’t able to find the total amount of data stored on the near chain in the near explorer page. As stored data is supposed to be part of the economics through near collateral requirements, It would be nice perhaps to add it to near explorer (and/or to near data center)

Just pointing out that Analytics - NEAR Wiki needs some TLC. Could you add some information about this and other analytics initiatives to the wiki?

Hi @dco thank you for the suggestion.
We will definitely look into that and see if we can publish it on the stats pages we have.

Very difficult to have a index download, and making the data ready. If any detailed documents or Video will be helpful.! ? Working on the project to get the data. This Forum as well a great Idea to have on-board members and thier activities…?

Thank you for the suggestion!
A video of instruction is a wonderful point, I will see how I can get that recorded and share with the community.

Hello! Some questions about main website (near.org) traffic data and onchain data (first of all I am interested in the region of Russia because we are working here but I think it will also be useful for others).

Is it possible to see more about traffic on the website (near.org, wallet.near.org, gov.near.org, etc.)? For example how and which people come to the basement in the link wallet.near.org and the traffic data of this page (how people get to this page, from where, what links on the site they visited before coming here), referral sites and so on.

Further on the blockchain data:

• the age of all wallets;
• the number of wallets by age (ex: 100 wallets - age 1 year, 200 wallets - age 6 months and so on);
• what types of transactions are made by wallets of different ages;
• how many transactions are made by wallets of different ages;
• what most “old” wallets usually do;
• what most “new” wallets usually do.

If we prepare accurate scenarios and descriptions of the Google Analytics and onchain data that we need will you be able to give them? So far these are the most exciting questions for me, thanks.

Hi @crptbrthrs
Thank you for the questions.
Unfortunately our website traffic data is not public at this stage because of privacy matters.

As for the blockchain data, you can access and create queries to analyze them via our public read access of indexer NEAR Indexer Framework | NEAR Documentation
We have also integrated with Graph Protocol NEAR and The Graph Partnership – NEAR Protocol subgraphs which is another option you can explore our chain data. In addition, you can also reference our RPC for a lot of the information you are looking for RPC Endpoints | NEAR Documentation

For the questions you hope to answer, we currently don’t have this kind of data queried and stored in our database, but I believe you will definitely be able to connect to the resources I mentioned above and use timestamps to group and analyze accounts and visualize them.
Please feel free to use NEAR Data Center Telegram group Telegram: Join Group Chat as a resource when you have questions or hope to discuss difficulties you faced or finding people in the community to help you with this data project!

Hope this is helpful!

Great, thanks for the detailed answer!

Hi - your post is several months old but maybe you still need this info. I’m very intrigued by the metrics you are looking to produce. We’re actively curating NEAR data and have just capped off our core tables.

Here’s an example of what we have thus far:
Metrics are NEAR

There’s lots of development yet to do, our GitHub Issues is probably the best place to see a roadmap of what’s to come. We welcome any additions here if there is something you’d like to see!

The data will be made available for free. Currently, we are ensuring quality and accuracy on our sample from 9/1/2021-present, but could grant you early access if that is desired.