Training the Deep Neural Networks Cheaply: The Ongoing Research

(This article is based on my experience, my reading on research articles in the field and the talk by Vivienne Sze in NeurIPS 2019)

This image is taken from https://towardsdatascience.com/paper-summary-optimal-dnn-primitive-selection-with-partitioned-boolean-quadratic-programming-84d8ca4cdbfc

Well, when people are talking to how to train the DNN free of charge, people will mostly think of Google Colaboratory or Kaggle Notebooks, but if you want to train a dataset with large resolutions of images and with high…