Published inThe DL·PinnedMember-onlyTransformers from Scratch in PyTorchJoin the attention revolution! Learn how to build attention-based models, and gain intuition about how they work — Update: I created this GitHub repo containing all of the code from this article, plus basic unit tests: fkodom/transformer-from-scratch Why Another Transformer Tutorial? Since they were first introduced in Attention Is All You Need (2017), Transformers have been the state-of-the-art for natural language processing. Recently, we have also seen Transformers applied to computer vision…Deep Learning7 min readDeep Learning7 min read
Published inTowards Data Science·Mar 22Member-onlyIntro to TorchData: A Walkthrough with Conceptual Captions 3MLearn how to use TorchData and DataPipes to efficiently stream large datasets like Conceptual Captions 3M. — Overview When working with large datasets, especially in deep learning, it can be impractical to download them locally for training. Instead, streaming the dataset directly during training can be a more efficient approach. …Pytorch8 min readPytorch8 min read
Published inThe DL·Jun 5, 2022Member-onlyClassifying Handwritten DigitsPart 2 — Intro to Deep Learning Intro to Deep Learning · Code repository · Part 1 — What are Neural Networks? · Part 3 — Better Neural Network Training (coming soon) · Part 4 — Regularization Techniques (coming soon) Preface This article is strongly influenced by ‘Neural Networks and Deep…Deep Learning8 min readDeep Learning8 min read
Jun 2, 2022Member-onlyWhere I Find My Deep Learning News (2022 Update)It’s hard to find reliable sources of information when starting out in deep learning. These will save you time, effort, and headaches. There are tons of free machine learning resources out there, but the sheer volume makes it difficult to sift through them. Not all of them are reliable or…Deep Learning5 min readDeep Learning5 min read
Published inThe DL·May 18, 2022Member-onlyWhat are Neural Networks?Part 1 — Intro to Deep Learning Intro to Deep Learning · Code repository · Part 2 —Classifying Handwritten Digits · Part 3— Better Model Training (coming soon) Preface This article is strongly influenced by ‘Neural Networks and Deep Learning’ by Michael Nielsen. It’s a fantastic book that has become slightly…Deep Learning8 min readDeep Learning8 min read
Published inThe DL·Dec 13, 2020Member-onlyTransformers Viewed as Generalizations of GCNsI show that Graph Convolutional Networks are (almost) a special case of Transformers, and discuss how that affects our interpretation of each. Introduction Transformers and Graph Convolutional Networks (GCNs) have grown tremendously in popularity over the past few years. At first glance, these two model types appear very different. …Deep Learning7 min readDeep Learning7 min read
Published inThe DL·Dec 10, 2020Member-onlyKeeping Up with Deep Learning — 10 Dec 2020Deep learning papers, blog posts, Github repos, etc. that I liked this week. This is the fourth edition of my weekly update on deep learning. Every Thursday, I’ll release a new batch of research papers, blog posts, Github repos, etc. that I liked over the past week. Links are provided…Deep Learning4 min readDeep Learning4 min read
Published inThe DL·Dec 7, 2020Member-onlyWhere I Find My Deep Learning NewsIt’s hard to find reliable sources of information when starting out in deep learning. These will save you time, effort, and headaches. See also: 2022 Update There are tons of free machine learning resources out there, but the sheer volume makes it difficult to sift through them. Not all of…Deep Learning4 min readDeep Learning4 min read
Published inThe DL·Dec 3, 2020Member-onlyKeeping Up with Deep Learning — 3 Dec 2020Deep learning papers, blog posts, Github repos, etc. that I liked this week This is the third edition of my weekly update on deep learning. Every Thursday, I’ll release a new batch of research papers, blog posts, Github repos, etc. that I liked over the past week. Links are provided…Artificial Intelligence5 min readArtificial Intelligence5 min read
Published inThe DL·Dec 1, 2020Member-onlyIntroducing: The DLA New Medium Publication for Deep Learning I’m excited to introduce The DL— a Medium publication with a focus on deep learning. Deep learning has absolutely exploded in recent years. Seemingly every tech company/startup boasts a killer AI feature, and ML-related skills are in extremely high demand. Deep learning research…Artificial Intelligence3 min readArtificial Intelligence3 min read
