Quantum many-body problems and neural...

22
The University of Electro-Communications 電気通信大学 斎藤弘樹 Quantum many-body problems and neural networks

Transcript of Quantum many-body problems and neural...

Page 1: Quantum many-body problems and neural networkskabuto.phys.sci.osaka-u.ac.jp/~koji/workshop/DLAP2018/...neural networks The University of Electro -Communications Application of machine

The University of Electro-Communications

電気通信大学 斎藤弘樹

Quantum many-body problems and neural networks

Page 2: Quantum many-body problems and neural networkskabuto.phys.sci.osaka-u.ac.jp/~koji/workshop/DLAP2018/...neural networks The University of Electro -Communications Application of machine

The University of Electro-Communications

Application of machine learningto quantum mecanics

Science 355, 602 (2017)

Nat. Comm. 8, 662 (2017)

Page 3: Quantum many-body problems and neural networkskabuto.phys.sci.osaka-u.ac.jp/~koji/workshop/DLAP2018/...neural networks The University of Electro -Communications Application of machine

The University of Electro-Communications

Why neural network?

Science 355, 602 (2017)For example, in quantum spin systems,

N

| ⟩𝛹𝛹 = �𝑆𝑆

𝛹𝛹 𝑆𝑆 | ⟩𝑆𝑆

| ⟩𝑆𝑆 = | ⟩↑↓↑↓↓↑ ⋯ ↑↓↑

many-body quantum state

bases

number of bases ~ exp(N)

Size of Hilbert space explodes with N!

Page 4: Quantum many-body problems and neural networkskabuto.phys.sci.osaka-u.ac.jp/~koji/workshop/DLAP2018/...neural networks The University of Electro -Communications Application of machine

The University of Electro-Communications

Why neural network?

Science 355, 602 (2017)

| ⟩𝛹𝛹 = �𝑆𝑆

𝛹𝛹 𝑆𝑆 | ⟩𝑆𝑆

many-body quantum state

Neural network

Neural network is used as variational wave function.

Size of Hilbert space >> # of network parameters

Page 5: Quantum many-body problems and neural networkskabuto.phys.sci.osaka-u.ac.jp/~koji/workshop/DLAP2018/...neural networks The University of Electro -Communications Application of machine

The University of Electro-Communications

restricted Boltzmann machine

Visible

Hidden

Input

Output

weightshidden variablesbiases

input

How to use neural network?

Science 355, 602 (2017)

Network parameters are optimized to get desired

𝛹𝛹 𝑆𝑆

𝛹𝛹 𝑆𝑆

Page 6: Quantum many-body problems and neural networkskabuto.phys.sci.osaka-u.ac.jp/~koji/workshop/DLAP2018/...neural networks The University of Electro -Communications Application of machine

The University of Electro-Communications

Ground state

Minimize

𝐻𝐻 =∑𝑆𝑆𝑆𝑆′ Ψ∗ (𝑆𝑆) 𝑆𝑆 𝐻𝐻 𝑆𝑆′ Ψ(𝑆𝑆′)

∑𝑆𝑆 Ψ(𝑆𝑆) 2

Ψ(𝑆𝑆) 2Monte Carlo sampling of S with probability ∝

𝜕𝜕 𝐻𝐻𝜕𝜕𝑊𝑊

can be calculated similarly

Science 355, 602 (2017)

= �𝑆𝑆

𝑃𝑃(𝑆𝑆)�𝑆𝑆′𝑆𝑆′ 𝐻𝐻 𝑆𝑆

Ψ(𝑆𝑆′)Ψ(𝑆𝑆)

Page 7: Quantum many-body problems and neural networkskabuto.phys.sci.osaka-u.ac.jp/~koji/workshop/DLAP2018/...neural networks The University of Electro -Communications Application of machine

The University of Electro-Communications

Numerical results

Tranverse-field Ising model (TFI) Antiferromagnetic Heisenberg model (AFH)

TFI (1D 80sites) AFH (1D 80sites) AFH(2D 10x10)

erro

r

α ∝ number of hidden units

Science 355, 602 (2017)

Page 8: Quantum many-body problems and neural networkskabuto.phys.sci.osaka-u.ac.jp/~koji/workshop/DLAP2018/...neural networks The University of Electro -Communications Application of machine

The University of Electro-Communications

Application to Bose-Hubbard model

H. Saito, J. Phys. Soc. Jpn. 86, 093001 (2017)

H. Saito and M. Kato, J. Phys. Soc. Jpn. 87, 014001 (2018)

Page 9: Quantum many-body problems and neural networkskabuto.phys.sci.osaka-u.ac.jp/~koji/workshop/DLAP2018/...neural networks The University of Electro -Communications Application of machine

The University of Electro-Communications

Bose-Hubbard model

hopping interaction

U J

U J

superfluid

insulator

phase transition

Page 10: Quantum many-body problems and neural networkskabuto.phys.sci.osaka-u.ac.jp/~koji/workshop/DLAP2018/...neural networks The University of Electro -Communications Application of machine

The University of Electro-Communications

Bases for Bose-Hubbard model

M sites, N particles

Number of bases satisfying

N M2 2 35 5 12610 10 92,37815 15 77,558,760

many-bodyquantum state

Page 11: Quantum many-body problems and neural networkskabuto.phys.sci.osaka-u.ac.jp/~koji/workshop/DLAP2018/...neural networks The University of Electro -Communications Application of machine

The University of Electro-Communications

Neural networks used in this study

Feedforward network

1. Fully-connected network

2. Convolutional network

Activation function : tanh(x)

Optimization scheme : Adam

Page 12: Quantum many-body problems and neural networkskabuto.phys.sci.osaka-u.ac.jp/~koji/workshop/DLAP2018/...neural networks The University of Electro -Communications Application of machine

The University of Electro-Communications

U dependence

1D 14 sites, 14 particles

Fully connected

14 40

Page 13: Quantum many-body problems and neural networkskabuto.phys.sci.osaka-u.ac.jp/~koji/workshop/DLAP2018/...neural networks The University of Electro -Communications Application of machine

The University of Electro-Communications

Hidden layer dependence1D 14 sites, 14 particles

Fully connected, single hidden layer two hidden layers

Page 14: Quantum many-body problems and neural networkskabuto.phys.sci.osaka-u.ac.jp/~koji/workshop/DLAP2018/...neural networks The University of Electro -Communications Application of machine

The University of Electro-Communications

Convolutional network

Fully connected

L : # of layersC : # of channelsF : filter size

Convolutional

CNN is better than fully connected network.

Translational symmetry

Page 15: Quantum many-body problems and neural networkskabuto.phys.sci.osaka-u.ac.jp/~koji/workshop/DLAP2018/...neural networks The University of Electro -Communications Application of machine

The University of Electro-Communications

Application to few-body problemsin continuous space

H. Saito, arXiv:1804.06521(to be published in JPSJ)

Page 16: Quantum many-body problems and neural networkskabuto.phys.sci.osaka-u.ac.jp/~koji/workshop/DLAP2018/...neural networks The University of Electro -Communications Application of machine

The University of Electro-Communications

Continuous space

𝛹𝛹(𝒙𝒙1,𝒙𝒙2,⋯ ,𝒙𝒙𝑁𝑁)many-body wave function

Fully connected network with single hidden layer

Page 17: Quantum many-body problems and neural networkskabuto.phys.sci.osaka-u.ac.jp/~koji/workshop/DLAP2018/...neural networks The University of Electro -Communications Application of machine

The University of Electro-Communications

Calogero-Sutherland model

harmonic potential interaction

𝛽𝛽 = 2

Exact solution

Page 18: Quantum many-body problems and neural networkskabuto.phys.sci.osaka-u.ac.jp/~koji/workshop/DLAP2018/...neural networks The University of Electro -Communications Application of machine

The University of Electro-Communications

3D problem ---- Efimov trimer

harmonic potential Gaussian attractive interaction

P. Naidon and S. Endo, Rep. Prog. Phys. 80, 056001 (2017)

Page 19: Quantum many-body problems and neural networkskabuto.phys.sci.osaka-u.ac.jp/~koji/workshop/DLAP2018/...neural networks The University of Electro -Communications Application of machine

The University of Electro-Communications

Input of networkCOM coordinate is eliminated using Jacobi coordinate

Rerative distancesare input.

| |

| |

| |

Rotational degree of freedom is eliminated.

Page 20: Quantum many-body problems and neural networkskabuto.phys.sci.osaka-u.ac.jp/~koji/workshop/DLAP2018/...neural networks The University of Electro -Communications Application of machine

The University of Electro-Communications

Results

N = 3

N ≧ 3 Y. Yan and D. Blume, PRA 90, 013620 (2014)Path integral Monte Carlo

Page 21: Quantum many-body problems and neural networkskabuto.phys.sci.osaka-u.ac.jp/~koji/workshop/DLAP2018/...neural networks The University of Electro -Communications Application of machine

The University of Electro-Communications

Other works

Y. Nomura et al., PRB 96, 205152 (2017)

Fermi-Hubbard model

Time evolution of Ising model

S. Czischek et al., arXiv:1803.08321

G. Carleo et al., arXiv:1802.09558

Deterministic with deep Boltzmann

Page 22: Quantum many-body problems and neural networkskabuto.phys.sci.osaka-u.ac.jp/~koji/workshop/DLAP2018/...neural networks The University of Electro -Communications Application of machine

The University of Electro-Communications

SummaryThe neural network method [Carleo & Troyer, Science 355, 602 (2017)] was applied to

Deep convolutional network seems good.

Outlook Time evolution Other systems (frustration, random, …)

H. Saito, J. Phys. Soc. Jpn. 86, 093001 (2017)H. Saito and M. Kato, J. Phys. Soc. Jpn. 87, 014001 (2018)

H. Saito, arXiv:1804.06521

Bose-Hubbard model

Continuous-space problem