Hi, I’m a 1B Software Engineering student at the University of Waterloo. I use this blog as a place to keep my WIP notes and thoughts about things that I’m learning about and want to reference at some later time. Because of this, most of the material in this blog is pretty unpolished and sparse, but I hope that some of the material here can be useful in some way.
Please contact me if you have any suggestions, ideas, or comments.
resume - bilal2vec#8916 — email — other profiles
Posts
-
How I (almost) replicated OpenAI's GPT-2 (124M version)
Jul 17, 2020
-
[Extremely WIP]: Make your own fast PyTorch-style ML library in Rust
Aug 2, 2020
-
My remote 1A term in waterloo's software engineering program.
Jan 7, 2021
-
Unorganized notes on Rust's async primitives
Aug 14, 2020
-
Writing down my notes on the adafactor optimizer
Aug 9, 2020
-
A guide for astronauts (now, people doing machine learning) about what to do when things go wrong.
Jul 13, 2020
-
Writing down my notes on memory usage in neural networks
Jul 6, 2020
-
Writing down some of my notes on initializing neural networks
Jul 3, 2020
-
Best Practices for Finetuning Large Transformer Language models
Jun 22, 2020
-
The way you evaluate your language model can have a pretty big effect on validation loss and ppl values. Everyone should clearly report how their language models have been evaluated and try to evaluate their language models similarly to make comparing them easy.
May 14, 2020
-
A collection of useful modules and utilities in PyTorch
Apr 30, 2020
-
I'm taking notes on evaluation metrics in NLP
Apr 16, 2020
-
writing down my notes on the different types of normalization used in neural networks
Mar 29, 2020
-
This was originally a report I made for my ELA class that I've formatted into a blog post
Mar 22, 2020