Argmax

Mixture of Experts

In this episode we talk about the paper "Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer" by Noam Shazeer, Azalia Mirhoseini, Krzysztof Ma

LoRA

We talk about Low Rank Approximation for fine tuning Transformers. We are also on YouTube now! Check out the video here: https://youtu.be/lLzHr0VFi3Y

15: InstructGPT

In this episode we discuss the paper "Training language models to follow instructions with human feedback" by Ouyang et al (2022). We discuss the RLHF paradigm and how im

14: Whisper

This week we talk about Whisper. It is a weakly supervised speech recognition model.

13: AlphaTensor

We talk about AlphaTensor, and how researchers were able to find a new algorithm for matrix multiplication.

12: SIRENs

In this episode we talked about "Implicit Neural Representations with Periodic Activation Functions" and the strength of periodic non-linearities.

11: CVPR Workshop on Autonomous Driving Keynote by Ashok Elluswamy, a Tesla engineer

In this episode we discuss this video: https://youtu.be/jPCV4GKX9Dw How Tesla approaches collision detection with novel methods.

10: Outracing champion Gran Turismo drivers with deep reinforcement learning

We discuss Sony AI's accomplishment of creating a novel AI agent that can beat professional racers in Gran Turismo. Some topics include: - The crafting of rewards to

8: GATO (A Generalist Agent)

Today we talk about GATO, a multi-modal, multi-task, multi-embodiment generalist agent.

9: Heads-Up Limit Hold'em Poker Is Solved

Today we talk about recent AI advances in Poker; specifically the use of counterfactual regret minimization to solve the game of 2-player Limit Texas Hold'em.

7: Deep Unsupervised Learning Using Nonequilibrium Thermodynamics (Diffusion Models)

We start talking about diffusion models as a technique for generative deep learning.

6: Deep Reinforcement Learning at the Edge of the Statistical Precipice

We discuss NeurIPS outstanding paper award winning paper, talking about important topics surrounding metrics and reproducibility.

5: QMIX

We talk about QMIX https://arxiv.org/abs/1803.11485 as an example of Deep Multi-agent RL.

4: Can Neural Nets Learn the Same Model Twice?

Todays paper: Can Neural Nets Learn the Same Model Twice? Investigating Reproducibility and Double Descent from the Decision Boundary Perspective (https://arxiv.org/pdf/2

3: VICReg

Todays paper: VICReg (https://arxiv.org/abs/2105.04906) Summary of the paper VICReg prevents representation collapse using a mixture of variance, invariance and covarian

2: data2vec

Todays paper: data2vec (https://arxiv.org/abs/2202.03555) Summary of the paper A multimodal SSL algorithm that predicts latent representation of different types of input

1: Reward is Enough

This is the first episode of Argmax! We talk about our motivations for doing a podcast, and what we hope listeners will get out of it. Todays paper: Reward is Enough S