Abstract:The celebrated Kitaev honeycomb model provides an analytically tractable example with an exact quantum spin liquid ground state. While in real materials, other types of interactions besides the Kitaev coupling (K) are present, such as Heisenberg (J) and symmetric off-diagonal (Γ) terms, these interactions can also be generalized to a triangular lattice. Here, we carry out a comprehensive study of the J-K-Γ model on a triangular lattice covering the whole parameter region, using a combination of exact diagonalization, classical Monte Carlo, and analytic methods, with an emphasis on the effects of the Γ term. In the HK limit (Γ=0), we find five quantum phases which are quite similar to their classical counterparts. Among them, stripe-A and dual Néel phases are robust against the introduction of the Γ term, in particular, stripe A extends to the region connecting K=−1 and K=1 for Γ<0. Though the 120∘ Néel phase also extends to a finite Γ, its region is largely reduced compared to the previous classical result. Interestingly, the ferromagnetic (dubbed FM-A) and stripe-B phases are unstable in response to an infinitesimal Γ interaction. Moreover, we find five additional phases for Γ≠0 which are elaborated by both the quantum and classical numerical methods. Part of the parameter space previously identified as the 120∘ Néel phase in the classical study is found to give way to the modulated stripe phase. Depending on the sign of the Γ term, the FM-A phase transits into FM-B (Γ>0) and FM-C (Γ<0) phases with different spin orientations. Similarly, the stripe-B phase transits into stripe-C (Γ>0) and stripe-A (Γ<0) phases. Around the positive Γ point, due to the interplay of the Heisenberg, Kitaev, and Γ interactions, we find a possible quantum spin liquid in a noticeable region with a continuum in spin excitations.

Global Phase Diagram of the Extended Kitaev-Heisenberg Model on Honeycomb Lattice

Topological Quantum Phase Transition in the Extended Kitaev Spin Model

Ground state phase diagram of Kitaev-Heisenberg model on honeycomb-triangular lattice

Global Phase Diagram of a Spin–orbit-Coupled Kondo Lattice Model on the Honeycomb Lattice*

Quantum Phase Diagram of the Bilayer Kitaev-Heisenberg Model

Unveiling the phase diagram of a bond-alternating spin-1/2 <i>K</i>- chain

Valence-Bond Solid phases in the spin-$1/2$ Kekule-Heisenberg model

Phase Diagram for Hole-Doped Kitaev Systems on the Honeycomb Lattice

Unveiling the phase diagram of a bond-alternating spin-$\frac12$ $K$-$\Gamma$ chain

Unveiling the Phase Diagram of a Bond-Alternating Spin- 12 K−Γ Chain

Ground-State Phase Diagram of the Kitaev-Heisenberg Model on a Three-dimensional Hyperhoneycomb Lattice

Comprehensive study of the global phase diagram of the J − K − Γ model on a triangular lattice

Spin-$S\,$ Kitaev-Heisenberg model on the honeycomb lattice: A high-order treatment via the many-body coupled cluster method

Exotic Phase Diagram of a Topological Quantum System

Kitaev honeycomb antiferromagnet in a field: quantum phase diagram for general spin

Assembling Kitaev honeycomb spin liquids from arrays of 1D symmetry protected topological phases

Distinct-Symmetry Spin-Liquid States and Phase Diagram of the Kitaev-Hubbard Model

Phase Diagram and Topological Phases in the Triangular Lattice Kitaev-Hubbard Model

Topological and magnetic phase transitions in the bilayer Kitaev-Ising model

Phase diagram of the Kitaev-Hubbard model: $\mathbb{Z}_2$ slave-spin and QMC approaches

Phase diagram of spin-1/2 J1-J2 Heisenberg model on honeycomb lattice