Training Vision Transformers with Only 2040 Images
— AK (@ak92501) January 27, 2022
abs: https://t.co/F1IH07RCzy pic.twitter.com/o21cELiURr
Training Vision Transformers with Only 2040 Images
— AK (@ak92501) January 27, 2022
abs: https://t.co/F1IH07RCzy pic.twitter.com/o21cELiURr
CodeRetriever: Unimodal and Bimodal Contrastive Learning for Code Search
— AK (@ak92501) January 27, 2022
abs: https://t.co/lrX5FKqtSc
By fine-tuning with domain/language specified downstream data, CodeRetriever achieves the new sota performance with significant improvement over existing code pre-trained models pic.twitter.com/ZJDAxkljrQ
XManager - A framework for managing machine learning experiments. https://t.co/ykOSBey2Sk #Python #MachineLearning pic.twitter.com/kJ5sqdhfj8
— Python Weekly (@PythonWeekly) January 26, 2022
Implementation of Denoising Diffusion Probabilistic Model in Pytorch https://t.co/xfNQaLjVcK #deeplearning #machinelearning #ml #ai #neuralnetworks #datascience #PyTorch
— PyTorch Best Practices (@PyTorchPractice) January 25, 2022
RePaint: Inpainting using Denoising Diffusion Probabilistic Models
— AK (@ak92501) January 25, 2022
abs: https://t.co/zDuZTlNudr pic.twitter.com/FyDZUUXF1x
A lot of machine learning research has detached itself from solving real problems, and created their own "benchmark-islands".
— Christoph Molnar (@ChristophMolnar) January 24, 2022
How does this happen? And why are researchers not escaping this pattern?
A thread 🧵 pic.twitter.com/uggKd7RsJf
Learning from One and Only One Shot
— AK (@ak92501) January 24, 2022
abs: https://t.co/6tyuja6oMK pic.twitter.com/4IAsQXkuIQ
The more we understand the theory of deep learning, all the cushy ML engineering jobs will become mundane data processing jobs (some might argue it already is), and it will lower the competence/training needed to fill those jobs.
— Delip Rao (@deliprao) January 23, 2022
In Australia education pays off. Unskilled & low-skilled workers struggle financially though. In my column I am suggesting that we want as many unskilled jobs done by students who are upskilling while working in low skilled jobs. Read full article (free):https://t.co/56GOVfZS40 pic.twitter.com/pXyGVu2lph
— Simon Kuestenmacher (@simongerman600) January 23, 2022
interesting modern day alternatives to classic unix tools. love the colours and better readability. https://t.co/fiyCx6H9Wt
— Ankur Handa (@ankurhandos) January 22, 2022
New evidence from @Google that size isn't everything: "While model scaling alone can improve quality, it shows less improvements on safety and factual grounding"
— Gary Marcus (@GaryMarcus) January 21, 2022
Translation: making GPT-3-like models bigger makes them more fluent, but no more trustworthy. https://t.co/BUjQCP6ReZ
data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language
— AK (@ak92501) January 20, 2022
blog: https://t.co/KP0OfddN3O
github: https://t.co/aNp78Sh48v pic.twitter.com/sA02jQpAt1