Variational Monte Carlo with Large Patched Transformers
Date
Friday November 29, 20241:30 pm - 2:30 pm
Location
STI AProf. Stefanie Czischek
University of Ottawa
Abstract
Large language models, like transformers, have recently demonstrated immense powers in text and image generation. This success is driven by the ability to capture long-range correlations between elements in a sequence. The same feature makes the transformer a powerful wavefunction ansatz that addresses the challenge of describing correlations in simulations of qubit systems. In this talk I consider two-dimensional Rydberg atom arrays to demonstrate that transformers reach higher accuracies than conventional recurrent neural networks for variational ground state searches. I further introduce large, patched transformer models, which consider a sequence of large atom patches, and show that this architecture significantly accelerates the simulations.
Timbits, coffee, tea will be served in STI A before the colloquium.
Upcoming Events
Mar
04
Wednesday
Fusion Energy - Bringing the Power of the Sun and Stars to Earth
Dr. Spencer Pitcher, CEO of Stellarax Group Ltd, gives a talk on fusion energy research and the roadmap for Canada's fusion energy development. General admission is free but registration is required.
Mar
05
Thursday
Special Departmental Colloquium - Fusion Energy Development in Canada
Special Departmental Colloquium - Fusion Energy Development in Canada
Mar
06
Friday
Departmental Colloquium - Nuclear security detectors and Ac225 production at Canadian Nuclear Laboratories
Departmental Colloquium - Nuclear security detectors and Ac225 production at Canadian Nuclear Laboratories