Abstract:We study the following nonlinear Schrödinger system which is related to Bose–Einstein condensate: {[ -Δ u +λ _1 u = μ _1 u^2^*-1+β u^2^*/2-1v^2^*/2, x∈Ω ,; -Δ v +λ _2 v =μ _2 v^2^*-1+β v^2^*/2-1 u^2^*/2, x∈Ω ,; u≥ 0, v≥ 0 in Ω , u=v=0 on ∂Ω . ]. Here Ω⊂ℝ^N is a smooth bounded domain, 2^*:=2N/N-2 is the Sobolev critical exponent, -λ _1(Ω )<λ _1,λ _2<0 , μ _1,μ _2>0 and β 0 , where λ _1(Ω ) is the first eigenvalue of -Δ with the Dirichlet boundary condition. When β =0 , this is just the well-known Brezis–Nirenberg problem. The special case N=4 was studied by the authors in (Arch Ration Mech Anal 205:515–551, 2012 ). In this paper we consider the higher dimensional case N≥ 5 . It is interesting that we can prove the existence of a positive least energy solution (u_β , v_β ) for any β 0 (which can not hold in the special case N=4 ). We also study the limit behavior of (u_β , v_β ) as β→ -∞ and phase separation is expected. In particular, u_β -v_β will converge to sign-changing solutions of the Brezis–Nirenberg problem, provided N≥ 6 . In case λ _1=λ _2 , the classification of the least energy solutions is also studied. It turns out that some quite different phenomena appear comparing to the special case N=4 .

On the Brezis-Nirenberg Problem in a Ball

Ground State and Multiple Solutions for a Critical Exponent Problem

On a Brezis–Nirenberg Type Quasilinear Problem

Remarks on a Brezis–Nirenberg's Result

The Fractional Brezis-Nirenberg Problems on Lower Dimensions

On Kirchhoff type equations with critical Sobolev exponent and Naimen's open problems

Positive Least Energy Solutions and Phase Separation for Coupled Schrödinger Equations with Critical Exponent: Higher Dimensional Case

Blowing-up solutions for the Choquard type Brezis-Nirenberg problem in dimension three

On the Brézis–Nirenberg Problem

Sign-changing Solutions and Phase Separation for an Elliptic System with Critical Exponent

NONRADIAL SOLUTIONS FOR COUPLED ELLIPTIC SYSTEM WITH CRITICAL EXPONENT IN EXTERIOR DOMAIN

Critical exponent Neumann problem with Hardy-Littlewood-Sobolev nonlinearity

On The Global Branch Of Positive Radial Solutions Of An Elliptic Problem With Singular Nonlinearity

Nonlocal critical exponent singular problems under mixed Dirichlet-Neumann boundary conditions

Existence of Least Energy Positive Solutions to Critical Schrödinger Systems in R3.

Least Energy Positive Solutions for D-Coupled Schrödinger Systems with Critical Exponent in Dimension Three

On the Choquard equation with double critical Sobolev exponents in RN

On an Elliptic Problem with Critical Exponent and Hardy Potential

Uniqueness and nondegeneracy of least-energy solutions to fractional Dirichlet problems

Uniqueness for the Brezis–Nirenberg Type Problems on Spheres and Hemispheres

The Brezis-Nirenberg problem in 4D