Abstract:The celebrated Kitaev honeycomb model provides an analytically tractable example with an exact quantum spin liquid ground state. While in real materials, other types of interactions besides the Kitaev coupling (K) are present, such as Heisenberg (J) and symmetric off-diagonal (Γ) terms, these interactions can also be generalized to a triangular lattice. Here, we carry out a comprehensive study of the J-K-Γ model on a triangular lattice covering the whole parameter region, using a combination of exact diagonalization, classical Monte Carlo, and analytic methods, with an emphasis on the effects of the Γ term. In the HK limit (Γ=0), we find five quantum phases which are quite similar to their classical counterparts. Among them, stripe-A and dual Néel phases are robust against the introduction of the Γ term, in particular, stripe A extends to the region connecting K=−1 and K=1 for Γ<0. Though the 120∘ Néel phase also extends to a finite Γ, its region is largely reduced compared to the previous classical result. Interestingly, the ferromagnetic (dubbed FM-A) and stripe-B phases are unstable in response to an infinitesimal Γ interaction. Moreover, we find five additional phases for Γ≠0 which are elaborated by both the quantum and classical numerical methods. Part of the parameter space previously identified as the 120∘ Néel phase in the classical study is found to give way to the modulated stripe phase. Depending on the sign of the Γ term, the FM-A phase transits into FM-B (Γ>0) and FM-C (Γ<0) phases with different spin orientations. Similarly, the stripe-B phase transits into stripe-C (Γ>0) and stripe-A (Γ<0) phases. Around the positive Γ point, due to the interplay of the Heisenberg, Kitaev, and Γ interactions, we find a possible quantum spin liquid in a noticeable region with a continuum in spin excitations.

A continuum compass model on the honeycomb lattice: phase diagram from tensor networks

A Continuum of Compass Spin Models on the Honeycomb Lattice

Quantum Phase Transitions in the Triangular Coupled-Top Model

Quantum Phase Transition of the One-Dimensional Transverse-Field Compass Model

Quantum Phase Transition in the One-Dimensional Period-Two and Uniform Compass Model

Quantum Phase Transitions and Scaling Behaviors of Extended 1D Compass Spin-Chain Model

A Tale of Two Quantum Compass Models

Assembling Kitaev honeycomb spin liquids from arrays of 1D symmetry protected topological phases

Magnetic properties of nanoscale compass-Heisenberg planar clusters

Exact solution of the geometrically frustrated spin-1/2 Ising-Heisenberg model on the triangulated Kagome (triangles-in-triangles) lattice

Topological phases of the compass ladder model

Topological Quantum Phase Transition in the Extended Kitaev Spin Model

Symmetric Spin-Orbital-hubbard Model on Honeycomb Lattice: an Origin of Kitaev Model and Beyond

Emergent Phases in a Compass Chain with Multisite Interactions

Subsystem symmetries, critical Bose surface, and immobile excitations in an extended compass model

Tuning into the Kitaev Spin Liquid Phase: A Spin Model on the Honeycomb Lattice with Two Types of Heisenberg Exchange Couplings

Phase diagram of a square lattice model of XY Spins with direction-dependent interactions

Global Phase Diagram of the Extended Kitaev-Heisenberg Model on Honeycomb Lattice

Ground state properties of the Heisenberg-compass model on the square lattice

Comprehensive study of the global phase diagram of the J − K − Γ model on a triangular lattice

Microscopic Roadmap to a Yao-Lee Spin-Orbital Liquid