Ai Research
46%137 posts analysés sur les 12 dernières semaines
Sur les 12 dernières semaines
Moyenne tous posts confondus
Ce mois-ci vs le précédent
137 posts analysés sur les 12 dernières semaines
Sur les 12 dernières semaines
Moyenne tous posts confondus
Ce mois-ci vs le précédent
Pente de progression (6 semaines)
Meilleure semaine : 24 août (238 likes moy.)
Sebastian Raschka, PhD
ML/AI research engineer. Author of Build a Large Language Model From Scratch (amzn.to/4fqvn0D) and Ahead of AI (magazine.sebastianraschka.com), on how LLMs work and the latest developments in the field.
Now we know: The popular Ox Alpha LLM was GLM-5.3-Flash... Compared to GLM-5.2, this new GLM-5.3-Flash model uses: 1) a Kimi Linear-style 3:1 (super*) hybrid attention pattern with 34 Kimi Delta Attention layers (KDA) …
Linas Beliūnas
🔔linas.substack.com🔔 Daily Intelligence on Finance & AI | Scouting FinTech & AI Startups 🦄
Huge: $115 billion FinTech giant Revolut just launched Revolut Research, an AI research unit to build AI models in-house 😳 Unlike other fintechs, Europe’s most valuable startup is not wrapping ChatGPT or Claude in a ba…
Alexia Jolicoeur-Martineau
Principal Researcher @ Microsoft 🐱💻 2025 ARC Prize Winner
Simple beats complicated: We show that switching to a sliding-window attention mask with attention sinks (at no cost) beats linear attention post-training. Huge thanks to my collaborators Rhea Sukthanker, Pashmina Cam…
Pascal BORNET
#1 AI & Automation Thought Leader | Award-Winning Expert | Best-Selling Author | Recognized Keynote Speaker | Agentic AI Pioneer | Forbes Tech Council | 2M+ Followers ✔️
𝗔𝗜 𝗱𝗼𝗲𝘀 𝗻𝗼𝘁 𝗻𝗲𝗲𝗱 𝘁𝗼 𝗱𝗶𝘀𝗼𝗯𝗲𝘆 𝘂𝘀 𝘁𝗼 𝗯𝗲𝗰𝗼𝗺𝗲 𝗱𝗮𝗻𝗴𝗲𝗿𝗼𝘂𝘀. In 2016, an AI playing a boat-racing game discovered that collecting targets produced more points than finishing the race. It …
Catharina Doria, MSc
Educating +800K people on Ethical AI | AI Ethicist | 100 Most Brilliant Women in AI Ethics™ | Top 20 AI Authority in Brazil | AI Literacy | Keynote Speaker
🚨 CALLING FOR RESEARCHERS: If you have written a PAPER on ethical AI or the impact/harms of Generative AI/AI, and would like to share your findings with an audience of 630k people, comment your name below or email me at…
Pallavi Ahuja
AI | Software Engineering | Writes @techNmak
RoPE is one of the main mechanisms modern LLMs use to inject position into attention, but it is often reduced to "rotate Q and K" without explaining why that works. The core idea is geometric. For a token at position m,…
Linas Beliūnas
🔔linas.substack.com🔔 Daily Intelligence on Finance & AI | Scouting FinTech & AI Startups 🦄
Huge if true: Google might have achieved RSI - an AI that improves the systems used to build the next AI 😳 Google has not confirmed it (yet), but Sergey Brin reportedly pushed the company to prioritize AI that can impr…
Linas Beliūnas
🔔linas.substack.com🔔 Daily Intelligence on Finance & AI | Scouting FinTech & AI Startups 🦄
Huge: Google researchers just built an AI system that improves how it improves - without changing the model itself 😳 It’s called Dream-RSI, and it tackles one of the hardest parts of recursive self-improvement: decidin…
Peter Gostev
AI Capability Lead @ Arena.ai
I've asked GPT-6-Astra to read the DeepSeek v4.1 Flash paper and compare it to the original Transformer architecture in 3D - you can zoom in an inspect each element side by side. Things have changed quite a bit. Link to…
Hao Hoang
Senior AI Researcher and Software Engineer. Author of the LLM System Design and RAG Interview Guides and AI Interview Prep (aiinterviewprep.substack.com)
RL training lifted Olmo 3.1 by +0.63 pass@1 on easy AIME problems. On hard ones: +0.03. Researchers at Université de Montréal and the Allen Institute Ai2 call this the Matthew Effect in RL for LLMs: the rich get richer.…