Ventura Labs Ep. 50 - Steffen Cruz and Felix Quinque Felix Quinque, AI Lead, and Steffen Cruz (@macrocrux), CTO & Co-Founder Macrocosmos (@MacrocosmosAI) Timestamps: 1:24 – Introduction 2:12 – Subnet 9’s Transition to IOTA 2:47 – The Problem: Large Language Model Training 4:51 – Layer Groups Overview 5:02 – Defining a Layer in an LLM 6:07 – Layer vs. Dataset Partitioning 7:21 – Data Distribution Among Miners 10:08 – Introducing Pipeline Parallelism 11:18 – Orchestrator: Scheduling & Coordination 15:44 – Validation: Shadow Audits 19:39 – Future of the Validation Process 24:51 – Activation Compression Importance 31:30 – Butterfly All-Reduce Explained 36:43 – Proudest Achievements of Subnet 9 39:33 – Defining Success for IOTA Subnet 46:21 – Advice for Zero-to-One Teams 52:16 – Conclusion & Thanks