top of page
Weekly Digests
Each edition of the Collationist.com newsletter is crafted to deliver the most impactful events, cutting-edge research, insightful articles, valuable resources, engaging interviews, and thought-provoking podcasts—all with concise, sharp annotations for effortless exploration. I’d be thrilled to have you on board—subscribe now via the button to join our growing community!
#
10
Weekly Digest: 20th Sep 2024
Business: $100B Infrastructure fund from Microsoft & Black Rock, App building with Together AI's Llama coder, Apple's beta release of Apple Intelligence, Google Vs US trial - evidence on monopolistic pricing, Full break down of USA Federal budget which is running at $6.2Trillion per annum
Technology: Creating Synthetic data set using Llama 3.1 405B model & NVIDIA Nematron model, Prompt optimisation framework called DSPy, Choosing between LLM Agent frameworks, Finetuning Llama 3 8B model on Together AI with Math Instruct dataset
Resources: AI research paper video log from Arize.AI, UC Berkeley's graduate NLP course (CS288) assignment set, Together AI research blog on open source LLM engineering & research
#
9
Weekly Digest: 13th Sep 2024
Business: OpenAI 1o - complex reasoning model, First civilian spacewalk and the cost, open source consolidation in observability, Warren Buffet's 10 stocks for his 90% wealth, Oracle's supercomputer with Blackwell GPU delivering 2.4ZettaFLOPS, Klarna shutting down all salesforce licenses, AI vision interview with Andrej Karpathy
Technology: Lilian Weng's blog on LLM Autonomous Agents, Moonshot projects in the computing hardware industry, RAG framework from Stanford
Long Read: Goldman Sachs white paper on equity investment strategies to counter concentration risks following the AI-led boom in US stocks
Resources: Lilian Weng's blog on the evolution of various technologies and architectures in deep learning and LLM building
#
8
Weekly Digest: 06th Sep 2024
Business: Alibaba Cloud's Qwen2-VL dominating Video LMs, Ilya Sutskevar's new start-up Safe Super Intelligence garners $1 Billion in funding, Anthropic's increasing competition to OpenAI, End of ApplePay monopoly, Telegraph CEO's free speech tweet, Problem with LMSys's Chatbot Arena
Technology: Magic's 100 Million token context window and architecture commentary
Long Read: ML Common's machine learning benchmark for the chip industry - the increasing competition to NVIDIA in inference space
Resources: Building LLMs ground up - 3 Hour workshop, Physics of LLM Models paper series, ML Learning roadmap for 2024
#
7
Weekly Digest: 29th Aug 2024
Business: China's dominance in humanoid robots, AI to go nuclear, Trouble with Synthetic Data, OpenAI's new investment round from Apple, Fed's early access to OpenAI & Anthropic models, Staggering numbers from Meta & OpenAI on LLM usage and adoption
Technology: Paper - Automated Design of Agentic Systems, Google's new RAG framework - Speculative RAG, Experimental results from 4bit quantization of NVIDIA Minitron models
Resources: A comprehensive guide to LLM technology landscape - A technical paper
#
6
Weekly Digest: 23rd Aug 2024
"Business: FTC banning fake reviews and fake deep porn videos, Meta's silent crawler, Uber/GM partnership on robo-taxi service by 2025, SaaS EV/NTM & FCF Margin slowdowns, North America's data centre build out - 10% addition in 6 months
Technology: IEEE Spectrum Programming Language rankings, AI21Labs releasing Jamba 1.5 models offering 256K token windows
Resources: Silicon Valley Canon - the books they read, AGI Safety from First Principles"
#
5
Weekly Digest: 16th Aug 2024
Business: Chinese startup WeRide IPO in the US, AI pricing strategies in SaaS offerings, Top 10 SaaS KPIs in charts, Deep Mind's robots beating humans in table tennis, Elon's X.ai releasing Grok-2 and its rise to the LLM leaderboard
Technology: 'AI Scientist' - an LLM writing research papers for $15, Falcon Mamba LLMs matching Transformer LLMs in evaluations, Anthropic becomes the first LLM provider enabling prompt caching saving 90% in opex for subscribers
Resources: Software 2.0 - Andrej Karpathy's 2017 article, Best Deep Learning book - Dive into Deep Learning
#
4
Weekly Digest: 09th Aug 2024
Headlines: OpenAI founder dropouts, Compute mania in Generative AI, Google competitor Perplexity scaling, How big tech is circumventing regulation in M&A, New architecture in Neural networks, Long read - Generative AI industry dynamic, Deep Learning Foundations book, Explainer - Attention is all you need
Technology Posts
bottom of page