About

Hi, I’m Trenton. I am very interested in to what extent there is convergence between machine learning and neuroscience. I am currently using associative memory models, particularly Sparse Distributed Memory, to investigate this question.

Information about me:

  • I’m a PhD student in the Systems, Synthetic and Quantitative Biology (SSQB) Program at Harvard in the Kreiman Lab (started Sept. 2020). I am supported by the NSF Graduate Research Fellowship.
  • I graduated from Duke University in May 2020 with a self-made major in “Minds and Machines: Biological and Artificial Intelligence”. I was lucky to attend as a Robertson Scholar which provided full funding during all four years, including summer experiences.
  • During my time at Duke I spent a year (June 2018 - May 2019) doing research in Dr. Michael Lynch’s Lab at Duke attempting to use machine learning to design new CRISPR guide RNAs for safer, more effective genome editing. Afterwards, I was affiliated with Dr. Debora Marks’s Lab at Harvard Medical School, first as a summer intern and then through my Senior Thesis research.

I am involved in the movement/philosophy/set of ideas that is Effective Altruism. I am also a fan of prediction markets and make public forecasts on Metaculus here. If the world was void of both interesting research questions and global catastrophic risks(!), you’d find me backpacking around the world with my film camera. I still try to do this when I have time off and get the chance to travel somewhere cool. Have any feedback for me? Please consider filling out this anonymous feedback form so I can learn and grow.

Publications (in reverse chronological order):

Attention Approximates Sparse Distributed Memory
Trenton Bricken*, Cengiz Pehlevan
*(First author)
NeurIPS, December 2021
[paper] [blog-post] [tweet-thread]

MIT Center for Brains Minds+ Machines Talk:

High-content screening of coronavirus genes for innate immune suppression reveals enhanced potency of SARS-CoV-2 proteins.
Erika J Olson*, David M Brown*, Timothy Z Chang, Lin Ding, Tai L Ng, H. Sloane Weiss, Peter Koch, Yukiye Koide, Nathan Rollins, Pia Mach, Tobias Meisinger, Trenton Bricken, Joshus Rollins, Yun Zhang, Colin Molloy, Yun Zhang, Briodget N Queenan, Timothy Mitchison, Debora Marks, Jeffrey C Way, John I Glass, Pamela A Silver
*(First authors)
bioRxiv, March 2021
[preprint] [tweet-thread]

Computationally Optimized SARS-CoV-2 MHC Class I and II Vaccine Formulations Predicted to Target Human Haplotype Distributions.
Ge Liu*, Brandon Carter*, Trenton Bricken, Siddhartha Jain, Mathias Viard, Mary Carrington, David K Gifford
*(First authors)
Cell Systems, July 2020
[paper] [code] [preprint] [tweet-thread]

My Google Scholar profile can be found here.

Resume

My CV (last updated on Nov. 10 2021)

Current Projects

  • My current research is on the extent to which Deep Learning and the brain are convergent. I am using Sparse Distributed Memory, a biologically plausible associative memory model, to investigate these connections.

Past Projects (see GitHub)

  • Upside Down Free Energy - Fall 2020 - Motivated by progress in “Upside Down” supervised reinforcement learning, I tried to connect it Friston’s Free Energy Principle (FEP) and develop more hierarchical versions of FEP. This required first implementing benchmarks of the existing “Upside Down” RL algorithms (see next entry). I was starting to get somewhat interesting results but RL is really hard and I started down the rabbit hole of Sparse Distributed Memory. See the GitHub repository for a draft PDF write up. Thanks to Beren Millidge and Alec Tschantz for their supervision and discussions about this project.

  • RewardConditionedUDRL - Fall 2020 - Open source codebase combining implementations of Reward Conditioned Policies and Training Agents using Upside-Down Reinforcement Learning. The former had no public implementation and the latter had a few implemented as Jupyter Notebooks but that had a number of issues I flagged eg. here and here. I hope this open source codebase will serve to both fully replicate the aforementioned papers and be used as a starting point for further research in the exciting domain of supervised RL.

  • SARS-CoV-2 mutation effects and 3D structure prediction from sequence covariation. - Summer 2020 - Collaborated with the Marks lab to help produce their SARS-CoV-2 mutation effect and 3D structure predictions using EVCouplings.
    Website: https://marks.hms.harvard.edu/sars-cov-2

  • RL Learning Byzantine Fault Tolerant (BFT) Consensus Protocols - Senior Year - Supervised by Dr. Kartik Nayak, final class project turned research project. Investigated the ability for deep reinforcement learning agents to discover and prove BFT consensus protocols. This was a great way to learn more about reinforcement learning but the tasks were too difficult for the agents to learn given the algorithms we were attempting to use. A write up of the project and uncleaned version of the codebase is available here.

  • Protein Generation and Optimization - Supervised by Dr. Debora Marks’s Lab as my Senior Thesis - This research was motivated by the promise of recent developments in our ability to predict protein functionality and the problem of finding novel sequences that maximize this prediction. We tried developing a new solution using invertible neural networks and variational inference to approximate the intractable distribution of any protein function predictor with reason to believe it would outperform Markov Chain Monte Carlo methods. My senior thesis write up of the work and where it seemed to succeed and fail can be found with the codebase here.

  • PyTorch Discrete Normalizing Flows - Winter Break 2019 - Learning about Discrete Normalizing Flows from “Discrete Flows: Invertible Generative Models of Discrete Data”, by Dustin Tran et al. https://arxiv.org/pdf/1905.10347.pdf, I tried implementing them using the coded provided in edward2 but found that none of it worked. I ended up porting all of the code into PyTorch which required making a number of modifications and getting it working on a toy example. This repo as of April 2021 has 63 Github stars and I have had two collaborators help me replicate the results.

  • Tail Free Sampling - Independent project, advice from friends and mentors - Developed a new method to sample sequences from autoregressive neural networks for open-ended sequence generation.

  • Primary and Tertiary Protein AutoEncoder - Final Class Project - Investigated if a deep AutoEncoder could learn the relationship between protein sequence and tertiary structure in order to then do either sequence or structure optimization in the latent space. It didn’t work very well but I learned a lot!

  • Facebook Chatbot for Spaced Repetition Learning - HackDuke 2016 - Spaced Repetition is wonderful and highly neglected. Can we make it more popular and easy to do routinely using a Facebook Chatbot to both harass and motivate us? Got everything working! But there were always more bugs and this didn’t solve the fundamental problem of spaced repetition learning still taking a huge amount of motivation. You could argue that presenting the cards over Messenger just created more distractions.

Other Locations on the Interwebs

I am pretty active on Twitter and sometimes upload my film photography to Instagram and to my portfolio.

Get in Touch

If any of the things I have mentioned are interesting to you please reach out! I love to meet new people.

My email is: lastname firstname at gmail dot com