Abstract:The possible existence of a quantum spin liquid (QSL) phase, an exotic state of matter with long-range quantum entanglement and fractionalized excitations, in $\alpha$-RuCl$_3$ has sparked widespread interests in exploring QSLs in various Kitaev models under magnetic fields. Recently, a $K$-$J$-$\Gamma$-$\Gamma'$ model has been proposed to accurately describe the compound by fitting the measured thermodynamic data, where $J$ is Heisenberg interaction, and $\Gamma$, $\Gamma'$ are off-diagonal exchanges on top of the dominant Kitaev coupling $K$. Based on this effective model, an intermediate QSL phase in presence of an out-of-plane fields along the $[1 1 1]$ direction, between the low-field zigzag order and high-field polarized phase, has been predicted. By combining density matrix renormalization group (DMRG), exponential tensor renormalization group (XTRG), and variational Monte Carlo (VMC) calculations, we address the nature of this QSL phase in the honeycomb $K$-$J$-$\Gamma$-$\Gamma'$ model under the $[1 1 1]$-direction field. Our DMRG calculations find the algebraic-like decay of spin correlation function, the finite spin scalar chiral order, and lattice nematic order. Together with the XTRG results of power-law specific heat at low temperature, our findings naturally suggest a gapless nematic chiral spin liquid. On the other hand, our VMC study finds a gapped nematic chiral spin liquid with the variational energy very close to that obtained in DMRG. As VMC finds a very small gap that is beyond the current resolution of both ground-state DMRG and finite-temperature XTRG calculations on finite-width cylinders, we resort the full clarification for the nature of the intermediate QSL to future studies. Lastly, we discuss the implications of our results to the recent experiment on $\alpha$-RuCl$_3$ and the QSL-like phase in a similar $K$-$\Gamma$-$\Gamma'$ model.

Spin-Wave Excitations Evidencing the Kitaev Interaction in Single Crystalline Α-Rucl_{3}.

Excitations in the field-induced quantum spin liquid state of alpha-RuCl3

Anisotropic Scattering Continuum Induced by Crystal Symmetry Reduction in Atomically Thin Α–rucl3

Proximate ferromagnetic state in the Kitaev model material α-RuCl3

Evidence for magnetic fractional excitations in a Kitaev quantum-spin-liquid candidate $\alpha$-RuCl$_3$

Identification of magnetic interactions and high-field quantum spin liquid in α-RuCl3

Neutron Spectroscopy Evidence for a Possible Magnetic-Field-induced Gapless Quantum-Spin-liquid Phase in a Kitaev Material Α-Rucl_3

Ultrafast spin dynamics in the proximate quantum spin liquid α-RuCl3

Gapless Spin Excitations in the Field-Induced Quantum Spin Liquid Phase of Alpha-Rucl3

Anisotropic magnetic interactions in a candidate Kitaev spin liquid close to a metal-insulator transition

Theoretical Investigation of Magnetic Dynamics in Α−rucl3

Quantized and unquantized thermal Hall conductance of Kitaev spin-liquid candidate $α$-RuCl$_3$

Fractionalized Excitations Probed by Ultrasound

Chiral excitations and the intermediate-field spin-liquid regime in the Kitaev magnet $α$-RuCl$_3$

Possible intermediate quantum spin liquid phase in α-RuCl3 under high magnetic fields up to 100 T

Possible Realization of Kitaev Spin Liquids in van der Waals Heterostructures of $α$-RuCl$_3$ and Cr$X_3$ ($X$=Cl and I)

Magnetic Anisotropy Reversal Driven by Structural Symmetry-Breaking in Monolayer Α-Rucl 3

Defect-Induced Low-Energy Majorana Excitations in the Kitaev Magnet $α$-RuCl$_3$

Nematic chiral spin liquid in a Kitaev magnet under external magnetic field

$J=1/2$ Pseudospins and $d$-$p$ Hybridization in the Kitaev Spin Liquid Candidates Ru$X_3$ ($X$ = Cl, Br, I)

Resonant Inelastic X-ray Scattering from Electronic Excitations in $α$-RuCl$_3$ Nanolayers