Machine LearningLarge Batch Training of Convolutional NetworksYang You, Igor Gitman, Boris GinsburgMachine LearningLarge Batch Training of Convolutional NetworksYang You, Igor Gitman, Boris GinsburgSupplied bibliography entry.Read now
Machine LearningSGDRIlya Loshchilov & Frank HutterMachine LearningSGDRIlya Loshchilov & Frank HutterSupplied bibliography entry.Read now
Machine LearningDecoupled Weight Decay Regularization (AdamW)Ilya Loshchilov & Frank HutterMachine LearningDecoupled Weight Decay Regularization (AdamW)Ilya Loshchilov & Frank HutterSupplied bibliography entry.Read now
Machine LearningSymbolic Discovery of Optimization Algorithms (Lion)Xiangning Chen et al.Machine LearningSymbolic Discovery of Optimization Algorithms (Lion)Xiangning Chen et al.Supplied bibliography entry.Read now
Machine LearningShampooVineet Gupta, Tomer Koren, Yoram SingerMachine LearningShampooVineet Gupta, Tomer Koren, Yoram SingerSupplied bibliography entry.Read now
Machine LearningScalable Second Order Optimization for Deep LearningRohan Anil et al.Machine LearningScalable Second Order Optimization for Deep LearningRohan Anil et al.Supplied bibliography entry.Read now
Machine LearningOptimizing Neural Networks with Kronecker-Factored Approximate CurvatureJames Martens & Roger GrosseMachine LearningOptimizing Neural Networks with Kronecker-Factored Approximate CurvatureJames Martens & Roger GrosseSupplied bibliography entry.Read now
Machine LearningNatural Gradient Works Efficiently in LearningShun-ichi AmariMachine LearningNatural Gradient Works Efficiently in LearningShun-ichi AmariSupplied bibliography entry.Read now
Machine LearningRiemannian Metrics for Neural NetworksYann OllivierMachine LearningRiemannian Metrics for Neural NetworksYann OllivierSupplied bibliography entry.Read now
Machine LearningRevisiting Natural Gradient for Deep NetworksRazvan Pascanu & Yoshua BengioMachine LearningRevisiting Natural Gradient for Deep NetworksRazvan Pascanu & Yoshua BengioSupplied bibliography entry.Read now
Machine LearningMixed Precision TrainingPaulius Micikevicius et al.Machine LearningMixed Precision TrainingPaulius Micikevicius et al.Supplied bibliography entry.Read now