{"id":"a6yudl7DYUo","title":"NEAR Legion Growth Check, 2026 Events Preview, Evaluation Guide for Fine-Tuned LLMs by Hugging Face","description":"Hugging Face Evaluation Guidebook: https://huggingface.co/spaces/OpenEva...\n\nJoin the NEAR Legion at https://nearlegion.com/\n\nFollow us on X:   / nearlegion  \n\n#NEAR #nearprotocol #NEARAI #ai #ainews","channel_name":"NEAR Protocol","published_at":"2025-12-06T00:00:00.000Z","thumbnail_url":"https://img.youtube.com/vi/a6yudl7DYUo/hqdefault.jpg","transcript_text":"Good morning, Legion. It's the weekend. But the Legion never sleeps. We haven't done a check in on the growth of the Legion for a while, so let's review where things stand. The Legion is now coming up on three months old. In those three months, we've grown to a small community of about 3500 people. 1800 of you have mapped your location on the Legion map across 838 cities, and more than 100 countries and 100 of you have already reached the ascendant SBT rank. The vision of the Legion has always been long term. We're creating a talent pool in the NEAR ecosystem, a skilled army for promoting the value of NEAR’s vision for AI, and now a physical community that will spread roots in the real world. That's the vision now. That's the vision in the future. It begins in early Q1 2026 with events in Minsk, Lagos, New Delhi, Chicago, Bali, Frankfurt and many other places. If you're nearby, prepare to see marketing materials and definitely attend. These events will then continue in the coming months. In the run up to NEARCON and beyond. Our goal is to host ten events every month for the year of 2026, culminating with ten MetaPool sponsored nodes being allocated to different cities around the world. The one story to focus on over the weekend is this HuggingFace based LLM Evaluation Guidebook. This nice interactive read for learning everything about how the benchmark life cycle works, and how models have evolved and improved in performance over time. This guidebook will tell you everything you need to know about how to evaluate if a model is actually capable of what you're hoping it is, how to create your own evaluation mechanism and the biggest challenges that come with evaluations. If you're ever going to be interested in fine tuning a model in the future, this is a must read primer for preparing to benchmark your specific fine tuned model. It will likely become even more relevant with product plans coming from NEAR AI. That's all for today. We'll do this all again real soon.","transcript_synced_at":"2026-11-03T04:46:19.596Z","segments":[{"start_seconds":0,"text":"Good morning, Legion. It's the weekend. But the Legion never sleeps.","url":"https://www.youtube.com/watch?v=a6yudl7DYUo&t=0s"},{"start_seconds":3,"text":"We haven't done a check in on the growth of the Legion for a while, so let's review where things stand.","url":"https://www.youtube.com/watch?v=a6yudl7DYUo&t=3s"},{"start_seconds":8,"text":"The Legion is now coming up on three months old.","url":"https://www.youtube.com/watch?v=a6yudl7DYUo&t=8s"},{"start_seconds":10,"text":"In those three months, we've grown to a small community of about 3500 people.","url":"https://www.youtube.com/watch?v=a6yudl7DYUo&t=10s"},{"start_seconds":15,"text":"1800 of you have mapped your location on the Legion map across 838 cities, and more than 100 countries and 100 of","url":"https://www.youtube.com/watch?v=a6yudl7DYUo&t=15s"},{"start_seconds":23,"text":"you have already reached the ascendant SBT rank.","url":"https://www.youtube.com/watch?v=a6yudl7DYUo&t=23s"},{"start_seconds":26,"text":"The vision of the Legion has always been long term.","url":"https://www.youtube.com/watch?v=a6yudl7DYUo&t=26s"},{"start_seconds":29,"text":"We're creating a talent pool in the NEAR ecosystem, a skilled army for promoting the value of NEAR’s vision for AI, and now a physical community that will spread roots in the real world.","url":"https://www.youtube.com/watch?v=a6yudl7DYUo&t=29s"},{"start_seconds":39,"text":"That's the vision now. That's the vision in the future.","url":"https://www.youtube.com/watch?v=a6yudl7DYUo&t=39s"},{"start_seconds":42,"text":"It begins in early Q1 2026 with events in Minsk, Lagos, New Delhi, Chicago, Bali, Frankfurt and many other places.","url":"https://www.youtube.com/watch?v=a6yudl7DYUo&t=42s"},{"start_seconds":50,"text":"If you're nearby, prepare to see marketing materials and definitely attend.","url":"https://www.youtube.com/watch?v=a6yudl7DYUo&t=50s"},{"start_seconds":55,"text":"These events will then continue in the coming months. In the run up to NEARCON and beyond.","url":"https://www.youtube.com/watch?v=a6yudl7DYUo&t=55s"},{"start_seconds":59,"text":"Our goal is to host ten events every month for the year of 2026, culminating with ten MetaPool","url":"https://www.youtube.com/watch?v=a6yudl7DYUo&t=59s"},{"start_seconds":67,"text":"sponsored nodes being allocated to different cities around the world.","url":"https://www.youtube.com/watch?v=a6yudl7DYUo&t=67s"},{"start_seconds":72,"text":"The one story to focus on over the weekend is this HuggingFace based LLM Evaluation Guidebook.","url":"https://www.youtube.com/watch?v=a6yudl7DYUo&t=72s"},{"start_seconds":78,"text":"This nice interactive read for learning everything about how the benchmark life cycle works, and how models have evolved and improved in performance over time.","url":"https://www.youtube.com/watch?v=a6yudl7DYUo&t=78s"},{"start_seconds":85,"text":"This guidebook will tell you everything you need to know about how to evaluate if a model is actually capable of what you're hoping it is, how to create your own evaluation","url":"https://www.youtube.com/watch?v=a6yudl7DYUo&t=85s"},{"start_seconds":94,"text":"mechanism and the biggest challenges that come with evaluations.","url":"https://www.youtube.com/watch?v=a6yudl7DYUo&t=94s"},{"start_seconds":97,"text":"If you're ever going to be interested in fine tuning a model in the future, this is a must read primer for preparing to benchmark your specific fine tuned model.","url":"https://www.youtube.com/watch?v=a6yudl7DYUo&t=97s"},{"start_seconds":105,"text":"It will likely become even more relevant with product plans coming from NEAR AI. That's all for today. We'll do this all again real soon.","url":"https://www.youtube.com/watch?v=a6yudl7DYUo&t=105s"}],"youtube_url":"https://youtube.com/watch?v=a6yudl7DYUo","url":"https://near-pedia.xyz/videos/a6yudl7DYUo"}