場所：東京都のイベント

[ABI Team Seminar] Talk by Wu Lin (Vector Institute) on \\"Spectral-factorized Positive-definite Curvature Learning\\"

イベント説明

This talk will be held in a hybrid format, both in person at AIP Open Space of RIKEN AIP (Nihonbashi office) and online by Zoom. AIP Open Space: *only available to AIP researchers.
DATE, TIME & LOCATION
Friday May 18th, 11:00 - 13:00, RIKEN AIP Nihombashi Office, Open Space
TITLE
Spectral-factorized Positive-definite Curvature Learning
BIO
Wu Lin is a postdoctoral fellow at the Vector Institute. His research lies at the intersection of differential geometry and machine learning, with a particul ar emphasis on optimization and inference. Currently, his projects investigate geometric approaches with broad implications for large-scale optimization and emerging paradigms in machine learning.
ABSTRACT
Many training methods, such as Adam(W) and Shampoo, learn a positive-definite curvature matrix and a pply an inverse root before preconditioning. Recently, non-diagonal training methods have gained significant attention; however, they remain comp utationally inefficient and are often limited to specific types of curvature information due to the costly matrix root computation via matrix decomposition. To address this, we propose a Riemannian optimization approach that dynamically adapts spectral fact orized positive-defined curvature estimates, enabling the efficient application of arbitrary matrix roots and generic curvature learning. We demonstrate the efficacy and versatility of our approach in positive-definite matrix optimization and covariance adaptation for gradient-free optimization, as well as its efficiency in curvature le arning for neural net training.
ZOOM LINK
Join Zoom Meeting
https://riken-jp.zoom.us/j/95749755604?pwd=YLI8iAtU9aZbK35CSaJ7cutqeCeo82.1
Meeting ID: 957 4975 5604
Passcode: A7dKn396ww

開催日

2025年4月18日11:00 ～ 2025年4月18日13:00

主催者・問い合わせ先

RIKEN AIP Public

開催場所

項目内容
場所RIKEN AIP, Nihombashi Office, Open Space
住所〒103-0027 Tokyo, Chuo City, Nihonbashi, 1-chōme-4-1 Nihonbashi 1-chome Mitsui Building, 15th floor

開催場所の地図

SNS・Bookmark

B!

近隣のイベント

近隣の場所 (直線距離)