Engineering Weekly Update - 2022-04-19
- nearmaxOP 4
Brief Summary
- Monitoring of public endpoints with Catchpoint pays off, we found a root cause for outages in APAC region;
- Public access to Mainnet/Testnet data was briefly disrupted by failing AWX tower jobs;
- We have drastically optimized storage usage on archival nodes which can save up to 2TB of disk space;
- We will be migrating our node infrastructure to more powerful cloud instances;
Results
- Check out NEAR Validators Advisory Board April meeting notes;
- Node team updated archival nodes to not store one database column which can save up to 2TB of storage on Mainnet. We also now GC two other columns which further reduces disk usage;
- Node team fixed issue where calculating epoch info might get node stuck;
- Node team made treatment of blacklisted nodes more efficient;
- Infrastructure team are overhauling cloud security;
- Infrastructure team set up special tool to gather metics from validators in case of the incidents;
- Infrastructure team have integrated monitoring and alerting into NEAR Lake;
- Infrastructure team are considering moving our node instances to TAU or N2 on GCP, depending on which one performs better;
- Infrastructure team are working on creating Mac M1 build pipelines for nearcore;
- Developer Tools added Betanet support to workspaces-rs. We also added sub-account conveniences to workspaces-js;
- Developer Tools team fixed unstructured errors from RPC endpoint;
- Developer Tools added arm64 support for Rust SDK example build scripts;
- Developer Tools created ACI proof of concept;
- Data Platform wrote a tool to move data from S3 to SingleStore;
- Data Platform have semi-ready docs on indexer here. Also check-out video on how data flow in NEAR blockchain;
Call for action
- Infrastructure team are building RPC as a Service team, check out our hiring positions. Also checkout our Site Reliability Engineer roles;
- Explorer team had their first community meeting. Join the next meeting if you care about Explorer dashboard!
Full Reports