Pinboard (nharbour)
https://pinboard.in/u:nharbour/public/
recent bookmarks from nharbourNew optimization method AdaBound (ICLR 2019 paper) - fastai users - Deep Learning Course Forums2019-07-10T10:16:34+00:00
https://forums.fast.ai/t/new-optimization-method-adabound-iclr-2019-paper/39431/6
nharbourForums for fast.ai Deep Learning Courses]]>adamw annealing deep-learning fast.aihttps://pinboard.in/u:nharbour/b:f46704fa0e90/dlib C++ Library: Automatic Learning Rate Scheduling That Really Works2018-02-14T20:37:42+00:00
http://blog.dlib.net/2018/02/automatic-learning-rate-scheduling-that.html?m=1
nharbouroptimizer learning-rate deep-learning dlib annealing early-stopping convergence overfitting over-fitting algorithmhttps://pinboard.in/u:nharbour/b:5298abef9054/Train your deep model faster and sharper — two novel techniques2017-12-11T18:03:57+00:00
https://hackernoon.com/training-your-deep-model-faster-and-sharper-e85076c3b047
nharbourI explain Snapshot Ensembling and FreezeOut that aim to boost accuracy and make deep learning take less time.]]>learning-rate annealing cosine deep-learning fastai cyclicalhttps://pinboard.in/u:nharbour/b:b7fed6ecd858/Learning Rate Schedules and Adaptive Learning Rate Methods for Deep Learning2017-12-11T12:02:54+00:00
https://towardsdatascience.com/learning-rate-schedules-and-adaptive-learning-rate-methods-for-deep-learning-2c8f433990d1
nharbourWhen training deep neural networks, it is often useful to reduce learning rate as the training progresses. This can be done by using pre-defined learning rate schedules or adaptive learning rate…]]>learning-rate annealing deep-learning decayhttps://pinboard.in/u:nharbour/b:cdd6a44cd62f/keras-contrib/snapshot.py at master · farizrahman4u/keras-contrib2017-11-18T00:24:39+00:00
https://github.com/farizrahman4u/keras-contrib/blob/master/keras_contrib/callbacks/snapshot.py
nharbourcosine keras learning-rate annealing deep-learninghttps://pinboard.in/u:nharbour/b:a6a51da7c6de/