top of page

Weekly Digests

Each edition of the Collationist.com newsletter is crafted to deliver the most impactful events, cutting-edge research, insightful articles, valuable resources, engaging interviews, and thought-provoking podcasts—all with concise, sharp annotations for effortless exploration. I’d be thrilled to have you on board—subscribe now via the button to join our growing community!

#

10

Weekly Digest: 20th Sep 2024


Business: $100B Infrastructure fund from Microsoft & Black Rock, App building with Together AI's Llama coder, Apple's beta release of Apple Intelligence, Google Vs US trial - evidence on monopolistic pricing, Full break down of USA Federal budget which is running at $6.2Trillion per annum

Technology: Creating Synthetic data set using Llama 3.1 405B model & NVIDIA Nematron model, Prompt optimisation framework called DSPy, Choosing between LLM Agent frameworks, Finetuning Llama 3 8B model on Together AI with Math Instruct dataset

Resources: AI research paper video log from Arize.AI, UC Berkeley's graduate NLP course (CS288) assignment set, Together AI research blog on open source LLM engineering & research

#

9

Weekly Digest: 13th Sep 2024

Business: OpenAI 1o - complex reasoning model, First civilian spacewalk and the cost, open source consolidation in observability, Warren Buffet's 10 stocks for his 90% wealth, Oracle's supercomputer with Blackwell GPU delivering 2.4ZettaFLOPS, Klarna shutting down all salesforce licenses, AI vision interview with Andrej Karpathy

Technology: Lilian Weng's blog on LLM Autonomous Agents, Moonshot projects in the computing hardware industry, RAG framework from Stanford

Long Read: Goldman Sachs white paper on equity investment strategies to counter concentration risks following the AI-led boom in US stocks

Resources: Lilian Weng's blog on the evolution of various technologies and architectures in deep learning and LLM building

#

8

Weekly Digest: 06th Sep 2024

Business: Alibaba Cloud's Qwen2-VL dominating Video LMs, Ilya Sutskevar's new start-up Safe Super Intelligence garners $1 Billion in funding, Anthropic's increasing competition to OpenAI, End of ApplePay monopoly, Telegraph CEO's free speech tweet, Problem with LMSys's Chatbot Arena

Technology: Magic's 100 Million token context window and architecture commentary

Long Read: ML Common's machine learning benchmark for the chip industry - the increasing competition to NVIDIA in inference space

Resources: Building LLMs ground up - 3 Hour workshop, Physics of LLM Models paper series, ML Learning roadmap for 2024

#

7

Weekly Digest: 29th Aug 2024

Business: China's dominance in humanoid robots, AI to go nuclear, Trouble with Synthetic Data, OpenAI's new investment round from Apple, Fed's early access to OpenAI & Anthropic models, Staggering numbers from Meta & OpenAI on LLM usage and adoption

Technology: Paper - Automated Design of Agentic Systems, Google's new RAG framework - Speculative RAG, Experimental results from 4bit quantization of NVIDIA Minitron models

Resources: A comprehensive guide to LLM technology landscape - A technical paper

#

6

Weekly Digest: 23rd Aug 2024

"Business: FTC banning fake reviews and fake deep porn videos, Meta's silent crawler, Uber/GM partnership on robo-taxi service by 2025, SaaS EV/NTM & FCF Margin slowdowns, North America's data centre build out - 10% addition in 6 months

Technology: IEEE Spectrum Programming Language rankings, AI21Labs releasing Jamba 1.5 models offering 256K token windows

Resources: Silicon Valley Canon - the books they read, AGI Safety from First Principles"

#

5

Weekly Digest: 16th Aug 2024

Business: Chinese startup WeRide IPO in the US, AI pricing strategies in SaaS offerings, Top 10 SaaS KPIs in charts, Deep Mind's robots beating humans in table tennis, Elon's X.ai releasing Grok-2 and its rise to the LLM leaderboard

Technology: 'AI Scientist' - an LLM writing research papers for $15, Falcon Mamba LLMs matching Transformer LLMs in evaluations, Anthropic becomes the first LLM provider enabling prompt caching saving 90% in opex for subscribers

Resources: Software 2.0 - Andrej Karpathy's 2017 article, Best Deep Learning book - Dive into Deep Learning

#

4

Weekly Digest: 09th Aug 2024

Headlines: OpenAI founder dropouts, Compute mania in Generative AI, Google competitor Perplexity scaling, How big tech is circumventing regulation in M&A, New architecture in Neural networks, Long read - Generative AI industry dynamic, Deep Learning Foundations book, Explainer - Attention is all you need

#

3

Weekly Digest: 03rd Aug 2024

Headlines: Stanford State of AI report, Q2 Funding growth and deal growth in startup space, IPOs in H2 2024, Framework for LLM Architecture, 20 Opensource AI/ML tools

#

2

Weekly Digest: 26th July 2024

Headlines: New Pricing strategies in SaaS businesses, AI Opensource movement, AI enterprise deployments with Cohere, AI Inference startup survival game and finally Tesla's big plans from Q2 earning call

#

1

Weekly Digest: 19th July 2024

Headlines: Sustainability of AI investments & how it compare with dot com era, Robotaxi's in San Francisco, New deep learning architecture called TTT to reduce compute

Follow

  • X
  • LinkedIn

©2024 Collationist.

bottom of page