Training the Deep Neural Networks Cheaply: The Ongoing Research

(This article is based on my experience, my reading on research articles in the field and the talk by Vivienne Sze in NeurIPS 2019)

This image is taken from https://towardsdatascience.com/paper-summary-optimal-dnn-primitive-selection-with-partitioned-boolean-quadratic-programming-84d8ca4cdbfc

Well, when people are talking to how to train the DNN free of charge, people will mostly think of Google Colaboratory or Kaggle Notebooks, but if you want to train a dataset with large resolutions of images and with high number of classes, you will face lots of problems if using these free GPU/TPU platforms. 😞

I have started to become curious 🤔 about how to train the Deep Neural Networks (DNNs) architecture in the most efficient way during me and my students did this Kaggle competition. As our university is just a small postgraduate college and I am almost like the pioneer of the deep learning researcher here, we don’t have sufficient research funding to buy the PCs with good GPU to train our DNNs, so we chose to solely use Google Colab and Kaggle notebooks to compete in that competition.

Trending AI Articles:

1. Basics of Neural Network

2. TensorFlow Object Detection API tutorial

3. TensorFlow Object Detection API: basics of detection (2/2)

--

--

Computer Vision and Deep Learning Research Enthusiast | World Traveller | Self-learner| Foreign Language Learner