IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 62, NO. …...A. Robust Receive Beamforming In a design...

16
IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 62, NO. 5, MARCH 1, 2014 1093 Randomized Algorithms for Optimal Solutions of Double-Sided QCQP With Applications in Signal Processing Yongwei Huang, Member, IEEE, and Daniel P. Palomar, Fellow, IEEE Abstract—Quadratically constrained quadratic programming (QCQP) with double-sided constraints has plenty of applications in signal processing as have been addressed in recent years. QCQP problems are hard to solve, in general, and they are typ- ically approached by solving a semidenite programming (SDP) relaxation followed by a postprocessing procedure. Existing post- processing schemes include Gaussian randomization to generate an approximate solution, rank reduction procedure (the so-called purication), and some specic rank-one matrix decomposition techniques to yield a globally optimal solution. In this paper, we propose several randomized postprocessing methods to output not an approximate solution but a globally optimal solution for some solvable instances of the double-sided QCQP (i.e., instances with a small number of constraints). We illustrate their applica- bility in robust receive beamforming, radar optimal code design, and broadcast beamforming for multiuser communications. As a byproduct, we derive an alternative (shorter) proof for the Sturm-Zhang rank-one matrix decomposition theorem. Index Terms—Robust receive beamforming, optimal radar waveform, multicast downlink beamforming, homogeneous quadratically constrained quadratic program (QCQP), semide- nite programming (SDP) relaxation. I. INTRODUCTION T HE problem formulation and effective solution of a quadratically constrained quadratic program (QCQP) has recently obtained ubiquitous applicability in signal processing for wireless communications, radar, microphone array speech processing, etc. An equivalent matrix form of a QCQP is a rank-one constrained semidenite programming (SDP). It is known that SDP is a major class of convex optimization problems and can be solved polynomially via an interior-point method (e.g., see [1], [2]). However, SDPs with rank-one constraints (i.e., QCQP problems) are, in general, NP-hard (see Manuscript received July 10, 2013; revised November 27, 2013; accepted De- cember 06, 2013. Date of publication January 02, 2014; date of current version February 06, 2014. The associate editor coordinating the review of this manu- script and approving it for publication was Prof. Martin Haardt. This work was supported by the Hong Kong RGC under Research Grant 617911. Y. Huang is with Department of Mathematics, Hong Kong Baptist Univer- sity, Kowloon Tong, Kowloon, Hong Kong (e-mail: [email protected], [email protected]). D. P. Palomar is with Department of Electronic and Computer Engineering, Hong Kong University of Science and Technology, Clear Water Bay, Kowloon, Hong Kong (e-mail: [email protected]). Color versions of one or more of the gures in this paper are available online at http://ieeexplore.ieee.org. Digital Object Identier 10.1109/TSP.2013.2297683 [3]–[6] and references therein), but they can still be approxi- mated by solving the SDP relaxation plus a postprocessing for nding a rank-one solution in a randomized or deterministic manner (e.g., see the comprehensive surveys [7], [8] and the book chapter [9] from a perspective of signal processing). Interestingly, when the number of constraints in a nonconvex QCQP is not too large, the QCQP can be solved in polynomial time (e.g., see [7], [9]–[20]), namely, its SDP relaxation is tight, and thus such class of QCQPs are convex in a hidden way. Herein, we further focus on the class of solvable 1 QCQPs and some interesting applications in signal processing, both of which are equally important. A modern approach to solve a QCQP includes a postprocessing scheme to polynomially construct optimal or suboptimal solutions of the rank-one SDP problem, following the resolution of the SDP relaxation problem (which outputs a general-rank solution). For a solv- able QCQP, there are several postprocessing methods in the literature to retrieve a rank-one optimal solution from the SDP relaxation. Among them, a classical one is the rank-reduc- tion procedure (also termed “purication”) for generating a lower-rank solution from a high-rank candidate (see [11], [3], [9], [18]), while another (more direct) approach to extract a rank-one solution is due to the specic rank-one decomposition theorems (see [13], [15], [17]). For a QCQP with two inhomo- geneous constraints, a rank-one solution procedure consisting of solving the quadratic feasibility problems was proposed in [14], [21]. More generally, for a separable QCQP with struc- tured constraints, an indirect rank-one solution approach via the dual solution was derived in [22], [23], [19]. In this paper, we consider a randomized postprocessing pro- cedure to construct a rank-one solution of the SDP relaxation problem, emphasizing the application to interesting problems arising in signal processing. The proposed randomized algo- rithms are very different from the existing ones (i.e., the rank-one decomposition technique, the rank-one reduction procedure): These existing ones are deterministic as opposed to our prob- abilistic approach. The proposed methods, which deliver the exact optimal solution, are not to be confused with the existing randomized methods to obtain suboptimal solutions. Some applications of such class of QCQPs include the design of robust receive beamforming, multiuser transmit beamforming (both unicast and multicast), and relay network beamforming [8] (see 1 By “solvable” we mean that the minimization (maximization) problem is feasible, bounded below (above) and the optimal valued is attained ([2], page 13). 1053-587X © 2014 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.

Transcript of IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 62, NO. …...A. Robust Receive Beamforming In a design...

Page 1: IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 62, NO. …...A. Robust Receive Beamforming In a design of robust receive beamforming (cf. [8] and ref-erences therein), also termed robust

IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 62, NO. 5, MARCH 1, 2014 1093

Randomized Algorithms for Optimal Solutionsof Double-Sided QCQP With Applications in

Signal ProcessingYongwei Huang, Member, IEEE, and Daniel P. Palomar, Fellow, IEEE

Abstract—Quadratically constrained quadratic programming(QCQP) with double-sided constraints has plenty of applicationsin signal processing as have been addressed in recent years.QCQP problems are hard to solve, in general, and they are typ-ically approached by solving a semidefinite programming (SDP)relaxation followed by a postprocessing procedure. Existing post-processing schemes include Gaussian randomization to generatean approximate solution, rank reduction procedure (the so-calledpurification), and some specific rank-one matrix decompositiontechniques to yield a globally optimal solution. In this paper, wepropose several randomized postprocessing methods to outputnot an approximate solution but a globally optimal solution forsome solvable instances of the double-sided QCQP (i.e., instanceswith a small number of constraints). We illustrate their applica-bility in robust receive beamforming, radar optimal code design,and broadcast beamforming for multiuser communications. Asa byproduct, we derive an alternative (shorter) proof for theSturm-Zhang rank-one matrix decomposition theorem.

Index Terms—Robust receive beamforming, optimal radarwaveform, multicast downlink beamforming, homogeneousquadratically constrained quadratic program (QCQP), semidefi-nite programming (SDP) relaxation.

I. INTRODUCTION

T HE problem formulation and effective solution of aquadratically constrained quadratic program (QCQP) has

recently obtained ubiquitous applicability in signal processingfor wireless communications, radar, microphone array speechprocessing, etc. An equivalent matrix form of a QCQP isa rank-one constrained semidefinite programming (SDP). Itis known that SDP is a major class of convex optimizationproblems and can be solved polynomially via an interior-pointmethod (e.g., see [1], [2]). However, SDPs with rank-oneconstraints (i.e., QCQP problems) are, in general, NP-hard (see

Manuscript received July 10, 2013; revisedNovember 27, 2013; acceptedDe-cember 06, 2013. Date of publication January 02, 2014; date of current versionFebruary 06, 2014. The associate editor coordinating the review of this manu-script and approving it for publication was Prof. Martin Haardt. This work wassupported by the Hong Kong RGC under Research Grant 617911.Y. Huang is with Department of Mathematics, Hong Kong Baptist Univer-

sity, Kowloon Tong, Kowloon, Hong Kong (e-mail: [email protected],[email protected]).D. P. Palomar is with Department of Electronic and Computer Engineering,

Hong Kong University of Science and Technology, Clear Water Bay, Kowloon,Hong Kong (e-mail: [email protected]).Color versions of one or more of the figures in this paper are available online

at http://ieeexplore.ieee.org.Digital Object Identifier 10.1109/TSP.2013.2297683

[3]–[6] and references therein), but they can still be approxi-mated by solving the SDP relaxation plus a postprocessing forfinding a rank-one solution in a randomized or deterministicmanner (e.g., see the comprehensive surveys [7], [8] and thebook chapter [9] from a perspective of signal processing).Interestingly, when the number of constraints in a nonconvexQCQP is not too large, the QCQP can be solved in polynomialtime (e.g., see [7], [9]–[20]), namely, its SDP relaxation is tight,and thus such class of QCQPs are convex in a hidden way.Herein, we further focus on the class of solvable1 QCQPs

and some interesting applications in signal processing, bothof which are equally important. A modern approach to solvea QCQP includes a postprocessing scheme to polynomiallyconstruct optimal or suboptimal solutions of the rank-oneSDP problem, following the resolution of the SDP relaxationproblem (which outputs a general-rank solution). For a solv-able QCQP, there are several postprocessing methods in theliterature to retrieve a rank-one optimal solution from the SDPrelaxation. Among them, a classical one is the rank-reduc-tion procedure (also termed “purification”) for generating alower-rank solution from a high-rank candidate (see [11], [3],[9], [18]), while another (more direct) approach to extract arank-one solution is due to the specific rank-one decompositiontheorems (see [13], [15], [17]). For a QCQP with two inhomo-geneous constraints, a rank-one solution procedure consistingof solving the quadratic feasibility problems was proposed in[14], [21]. More generally, for a separable QCQP with struc-tured constraints, an indirect rank-one solution approach viathe dual solution was derived in [22], [23], [19].In this paper, we consider a randomized postprocessing pro-

cedure to construct a rank-one solution of the SDP relaxationproblem, emphasizing the application to interesting problemsarising in signal processing. The proposed randomized algo-rithms are very different from the existing ones (i.e., the rank-onedecomposition technique, the rank-one reduction procedure):These existing ones are deterministic as opposed to our prob-abilistic approach. The proposed methods, which deliver theexact optimal solution, are not to be confused with the existingrandomized methods to obtain suboptimal solutions. Someapplications of such class of QCQPs include the design of robustreceive beamforming, multiuser transmit beamforming (bothunicast and multicast), and relay network beamforming [8] (see

1By “solvable” we mean that the minimization (maximization) problem isfeasible, bounded below (above) and the optimal valued is attained ([2], page13).

1053-587X © 2014 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.

Page 2: IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 62, NO. …...A. Robust Receive Beamforming In a design of robust receive beamforming (cf. [8] and ref-erences therein), also termed robust

1094 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 62, NO. 5, MARCH 1, 2014

references therein), robust adaptive radar detection [24], designof optimum coded waveform for radar [25], the Capon beam-forming problem for microphone array [26], and some otherdesign problems from signal processing and communicationslisted in [9]. Additionally, as a byproduct of the main result(i.e., the randomized algorithms for solving QCQP optimally),we provide an alternative proof for the Sturm-Zhang rank-onedecomposition theorem [13] using a probabilistic method.The remainder of this paper is organized as follows. Section II

is devoted to listing three concrete motivating applications insignal processing. In Section III, we develop the randomizedalgorithms for a global solution of a class of QCQPs and, inSection IV, we demonstrate how to apply the proposed algo-rithms to solve the optimization problems in the mentioned ap-plications. In Section V, we provide an alternative proof of theSturm-Zhang rank-one decomposition theorem in [13]. Numer-ical examples are presented in Section VI. Finally, conclusionsare drawn in Section VII.Notation: We adopt the notation of using boldface for vec-

tors (lower case), and matrices (upper case). The transposeoperator and the conjugate transpose operator are denoted bythe symbols and respectively. The notationstands for the trace of the square matrix argument; and de-note respectively the identity matrix and the matrix (or the rowvector or the column vector) with zero entries (their size is de-termined from the context). The letter represents the imag-inary unit (i.e., ), while the letter often serves asindex in this paper. For any complex number , we useand to denote respectively the real and the imaginary partsof and represent the modulus and the argument of, and ( or ) stands for the (component-wise) conju-gate of ( or ). We employ standing for the innerproduct between Hermitian or symmetric matricesand . The Euclidean norm (the Frobenius norm) of the vector(the matrix ) is denoted by . The symbol

represents the Hadamard element-wise product. The curled in-equality symbol (and its strict form ) is used to denote gen-eralized inequality: means that is an Hermitianpositive semidefinite matrix ( for positive definiteness).The space of Hermitian matrices (the space of real-valued symmetric matrices) is denoted by ,and the set of all positive semidefinite matrices inby . represents the statistical expectation. Thenotations and stand for the range spaceand the null space, respectively. denotestheminimal (maximal) eigenvalue. Finally, represents theoptimal value of problem . stands for the square rootmatrix if .

II. MOTIVATION AND PROBLEM FORMULATIONS

In this section, we introduce the considered generic formula-tion of QCQP, and list several applications arising from differentsubjects in signal processing.Consider the following class of QCQP:

(1)

where the variable could be either real-valued or complex-valued (i.e., could be or ), , are Her-mitian (symmetric if ) matrices, are real num-bers, and (the subscripts and denotethe lower and upper bounds, respectively). Herein, we considerQCQP with number of double-sided constraints not greater thanthree, i.e., , and will show that it is solvable by pre-senting randomized (polynomial) algorithms for globally op-timal solutions.Note that the form of constraint

is general in the sense that it includes the following types ofconstraints: (1) no constraint (taking both and to be“unrestricted”, i.e., the constraint vanishes, and becomemeaningless); (2) one-sided inequality constraint(taking to be “ ” and to be “unrestricted”); (3) equalityconstraint (taking both and to be “ ” and

); and (4) double-sided constraint(with ).An example for (1) is the inhomogeneous QCQPwith double-

sided constraints:

(2)

since its equivalent homogenized version with an extra variableis (cf. [12]):

(3)

In particular, we note that a real-valued QCQP with one double-sided constraint was studied in [10] (see also [12]).We now list some applications of (1) in signal processing.

A. Robust Receive Beamforming

In a design of robust receive beamforming (cf. [8] and ref-erences therein), also termed robust adaptive beamforming, thenarrowband signal received by a -antenna array is given by

where , and are statistically independent vec-tors corresponding to the signal of interest (SOI), interference,and noise, respectively, is the SOI waveform, and is itssteering vector (the actual array response or spatial signature ofthe SOI). The receive beamformer outputs the signal

where is the vector of beamformer complex weightcoefficients. The beamforming problem is to find an optimal

Page 3: IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 62, NO. …...A. Robust Receive Beamforming In a design of robust receive beamforming (cf. [8] and ref-erences therein), also termed robust

HUANG AND PALOMAR: ANDOMIZED ALGORITHMS FOR OPTIMAL SOLUTIONS OF DOUBLE-SIDED QCQP 1095

beamvector maximizing the beamformer output signal-to-in-terference-plus-noise ratio (SINR)

(4)

where is the SOI power and is the interferenceplus noise covariance. In practical cases, the true covari-ance is unavailable and, thus, the data sample estimate

is used instead, with being the numberof available snapshots. The SINR maximization problem isequivalent to the following convex problem:

and a solution is

(5)

This is the well-known sample matrix inversion (SMI) basedminimum variance (MV) beamformer, and the correspondingbeamformer output power is written as

(6)

In practice (e.g., multi-antenna wireless communicationsand passive source localization), the beamformer suffers fromdramatic performance degradation due to mismatch betweenthe actual steering vector and the presumed steering vector. To mitigate the degradation, robust receive beamformingtechniques have been proposed in the last decade (e.g., see[27]–[33], and references therein).A popular robust receive beamformer adopts the beamvector

(5) with therein replaced by an optimal estimate via dif-ferent methods (in addition to the robust adaptive beamformerbased on worst-case strategies, e.g., see [27], [32], and refer-ences therein). For example, a recent effective technique of re-ceive beamforming is addressed in [33]. Therein, the optimal es-timate of signal steering vector is obtained by maximizing thebeamformer output power (6) subject to a constraint of avoidingthe convergence of the estimate to the region where the inter-ference steering vectors and their linear combinations are lo-cated, as well as a norm constraint. The following formulationis a generalization by allowing the norm of the steering vectorto lie on an interval:

(7)

where is the steering vector associ-ated with that has the structure defined by the antenna arraygeometry, and is the complement of the prefix angular sectorwhere the SOI is located. Also, the parameters and are

and , respectively,and the positive parameters and control the perturbationbound. We highlight that the second double-sided constraint ac-counts for the steering vector gain perturbations caused, e.g., by

the sensor amplitude and phase error as well as by the sensor po-sition error (cf. ([30], pp. 2408 and 2414)).Note that the constraint in the first double-sided

constraint is necessary for the completeness of problem formu-lation, even in the particular case of . In fact, as-sume that is the case. Then the known lower boundfor is . If (it is true in Ex-ample 2 of [33]), then provides additional informa-tion (otherwise, it is redundant). Evidently, ifand happens to be equal to , then (7) reduces to thebeamforming problem (23)–(25) in [33]. As for more motiva-tions and interpretations of the first constraint in (7), we refer to([33], Section III).Another example of robust receive beamforming (based on

steering vector estimation) is the design of a doubly constrainedCapon beamformer considered in [30] (later extended in [21]).A more general Capon beamforming optimization problem in-cluding a double-sided constraint is formulated as:

(8)

where , and are given parameters. The for-mulation in (8) embraces the problems in [21] and [30], and gen-eralizes them by allowing the norm to lie on an interval. In (8),minimizing the objective is identical to maximizing the outputpower (6), while the first constraint governs the possible steeringvectors around the nominal (presumed) and the second de-scribes the norm constraint perturbed possibly by some coarsearray calibration procedure.It is clear that problems (7) and (8) are two particular in-

stances of (1) (also of (2)), and we will be able to solve themusing a proposed randomized algorithm via SDP relaxation (seeSection IV.A).In addition, there are other robust receive beamforming

problem formulations (cf. [31], [34]), where the resulting opti-mization problems belong to the class of QCQPs (1). Further,we highlight the QCQP applications to robust adaptive radardetection in the presence of steering vector mismatches (e.g.,see [24], and references therein).

B. Optimum Coded Waveform Design for Radar

Radar waveform optimization in the presence of colored dis-turbance has been addressed for two decades. A recently popularsignal design approach relies on the modulation of a pulse trainparameters (amplitude, phase, and frequency) in order to syn-thesize waveforms with some specified properties. This tech-nique is known as radar coding. In [25], the design of optimalcoded waveforms in the presence of colored Gaussian distur-bance is formulated as the maximization of the detection perfor-mance under a control both on the region of achievable valuesfor the Doppler estimation accuracy and on the degree of simi-larity with a pre-fixed radar code. This last constraint is equiv-alent to forcing a similarity between the ambiguity functions of

Page 4: IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 62, NO. …...A. Robust Receive Beamforming In a design of robust receive beamforming (cf. [8] and ref-erences therein), also termed robust

1096 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 62, NO. 5, MARCH 1, 2014

the devised waveform and of the pulse train encoded with thepre-fixed sequence.Consider a vector comprising the samples of the received

signal (after down-conversion and matched filtering) as in [25](or [35]):

(9)

where is the complex echo amplitude (accounting for thetransmit amplitude, phase, target reflectivity, and channels prop-agation effects), is the vectorcontaining the transmitted code elements (to be optimally de-signed), is the temporalsteering vector, denotes the normalized target Doppler fre-quency, and is the vectorcontaining the disturbance samples. We assume that is a zero-mean complex circular Gaussian vector with known positivedefinite covariance matrix .It is known, from [25] and references therein, that the detec-

tion probability (describing the detection performance) ofthe generalized likelihood ratio test, for a given value of the falsealarm probability , depends on the radar code, the distur-bance covariance matrix, and the temporal steering vector onlythrough the signal-to-noise ratio (SNR), defined as

(10)

which is a function of the actual Doppler frequency due to thedependence of over . Moreover is an increasing functionof SNR and as a consequence, the maximization of can beobtained maximizing the SNR (10).In a design of radar waveform, it is of importance to have a re-

liable measurement of the Doppler frequency [25]. The Doppleraccuracy is bounded below by Cramér-Rao Bound (CRB) andCRB-like techniques which provide lower bounds for the vari-ances of unbiased estimates. Constraining the CRB is equivalentto controlling the region of achievable Doppler estimation ac-curacies; particularly, forcing an upper bound to CRB results ina lower bound on the size of the region . According to thisguideline, we focus on the class of radar codes complying withthe CRB constraint [25]:

(11)

where and rules the lowerbound on the size of . Thus, adding a similarity constraintwith a known unit-norm code (cf. [30], [25]), as well as anorm constraint (termed also energy constraint), we formulatethe waveform (radar code) design problem into the followingQCQP:

(12a)

(12b)

(12c)

(12d)

whereand characterize the allowable perturbation of the code norm

and, controls the size of the similarity region (a practical as-sumption is that since all codes under consideration arenormalized). Note that the problem formulation (12) is moregeneral than that in [25], where the first constraint (i.e., the en-ergy constraint) is the equality constraint . Clearly, (12)is a particular case of (2) (or equivalently (1)).Since the feasible region of (12) is larger than that of the op-

timization problem in [25], hence the performance (in term ofSNR, or equivalently probability of detection) of the optimalcode obtained herein is better. In Section IV.B, we will showhow to obtain a global solution for the problem, via SDP relax-ation and a randomized algorithm. For an application of QCQPto radar space-time adaptive processing, we refer to [36], and forapplications in radar signal estimation and detection, we refer to[20] and [37].

C. Single-Group Multicast Transmit Beamforming WithSoft-Shaping Interference Constraints

Consider a downlink transmission scenario where the basestation (BS), equipped with antennas, sends a common signal

to single-antenna users (i.e., a multiple-input single-output (MISO) system). Let denote the beamformingweight vector applied to the transmit antenna elements. Thetransmitted signal is given by , where isassumed to be zero-mean and white with unit variance. Let

be the channel vector of user , and assume thatit is randomly fading with known second-order statistics

(cf. [22], [23]). The signal received at user is givenby

where is additive noise with power . The average SNRcan be expressed as

In the expression of SNR, we may set , if the in-stantaneous channel state information (CSI) is available at theBS, or if the BS employs a uniform linear antenna array underlight-of-sight propagation conditions (see e.g., [5], [38]). There-fore, the meaningful design of the beamvector that minimizesthe total transmitted power subject to constraints on the receivedSNR of each user, can be formulated as

(13)

where denotes the prescribed minimum received SNR foruser .In a modern communication system, one may need to control

the amount of interference generated along some particulardirections, so as to protect the cochannel and coexisting systems(e.g., see [18], [39]). The caused interference power to userof a coexisting systems is given bywhere and is the channel between the BS andexternal user . Given both the SNR constraints for the internal

Page 5: IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 62, NO. …...A. Robust Receive Beamforming In a design of robust receive beamforming (cf. [8] and ref-erences therein), also termed robust

HUANG AND PALOMAR: ANDOMIZED ALGORITHMS FOR OPTIMAL SOLUTIONS OF DOUBLE-SIDED QCQP 1097

users and upper bound constraints on the interference to theexternal users, the beamforming problem of interest can bewritten as

(14)

where is a tolerable interference threshold value for externaluser . The second set of constraints is termed soft-shapinginterference constraints [39]. In particular, if , they arecalled null-shaping interference constraints [39], which aremore strict; in this case, (14) reduces to the following QCQP:

(15)

The broadcasting (i.e., single multicast group) beam-forming problem (14) is discussed for the special scenarioof for all in [41] in the context of an un-derlay cognitive radio (CR) network. Evidently, (1) embraces(13)–(15). In Section IV.C, we will show how to efficientlysolve some scenarios of (15) (e.g., and any ) as wellas some instances of (14), provided that their SDP relaxationproblems are solvable.

D. Other Applications

Some other applications include the following:• the crosstalk resilient Capon beamformer design for micro-phone arrays in [26];

• the multicast transmit beamforming problem in [5], [38]and [40];

• the transmit beamforming problem for a CR network in[41]–[43] and [44];

• the optimal relay network beamforming problems in [45]and [46];

• the optimal fusion designs for distributed networks in [47]and [48];

• the portfolio risk management in financial engineering in[49].

III. GLOBALLY OPTIMAL SOLUTIONS OF QCQP VIARANDOMIZATION

We aim at obtaining randomized algorithms for solving ho-mogeneous QCQP in this section. To be more specific, a globalsolution of QCQP is generated by randomization techniquesfollowing the resolution of the SDP relaxation, which is dif-ferent from the existing ones (i.e., rank reduction-based tech-nique (e.g., [11] and [18]), the rank-one matrix decompositiontheorems (e.g., [13] and [15]), solving the quadratic feasibilityproblems proposed in [14], [21]).The random variables that we adopt are bounded (without

tails), which are different from commonly used Gaussian

random variables in the context of SDP relaxation.2 Specifi-cally, we consider either the binary distribution (i.e., Bernoulli)

(16)

or the uniform distribution on the unit circle3

(17)

We will use to denote a vector with independent and identi-cally distributed (i.i.d.) random components having distribution(16) or (17).To proceed, let us recall the conventional SDP relaxation of

(1):

...(18)

and its dual

(19)

where the dual operation is defined by

(20)

Note that the operator represents the inner product, namely. Assume that is a primal-

dual feasible pair, it then follows from the strong duality the-orem (cf. ([2], Theorem 1.4.2)) that it is a pair of optimal solu-tions (respectively for the primal and dual SDPs) if and only ifthe complementary conditions are satisfied:

(21)

(22)

(23)

Let us start with the case of homogeneous QCQP with onedouble-sided constraint.

2In optimization and signal processing literature, Gaussian random variablesare often considered to generate an approximate solution for an NP-hard opti-mization problem (e.g., an NP-hard QCQP problem) based on SDP relaxationtechniques. The key to the analysis of approximation bounds (to measure the ap-proximation quality) is based on the mathematical estimate of tail probabilitiesof the distribution of the quadratic form of a Gaussian random vector (e.g., seeLemmas 3.1 and 5.1 in [4]). However, the uniform or binary random variablesare bounded, which is a key to allow us to yield a globally optimal solution fora solvable QCQP problem.3We note that such random variables have been adopted to generate approxi-

mate solutions for an optimal transmit beamforming problem in [5]. Herein thedistribution will be used instead to yield an optimal solution.

Page 6: IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 62, NO. …...A. Robust Receive Beamforming In a design of robust receive beamforming (cf. [8] and ref-erences therein), also termed robust

1098 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 62, NO. 5, MARCH 1, 2014

A. Homogeneous QCQP With One Double-Sided Constraint

Consider the QCQP:

(24)

where and . For QCQP (24) withreal-valued parameters and variables, the discussion is similar.Suppose that the SDP relaxation (18) (with only one double-sided constraint) of (24) is solvable; to this end, it suffices toassume that the corresponding dual (19) is bounded above andstrictly feasible (from the strong duality theorem ([2], Theorem1.4.2)). Upon an optimal solution for the relaxed formulation(18), we are about to construct a randomized optimal solutionfor (24).Proposition 3.1: Suppose that is an optimal solution

for the relaxed problem (18) in the real- or complex-valuedcase with (one double-sided constraint). Consider theeigenvalue decomposition .4

Then, is an optimal solution for (24), where is anyvector with its components .

Proof: See Appendix A.Algorithm 1 summarizes the procedure (as stated in the

proof, see Appendix A) producing a globally optimal solutionfor Problem (24).

Algorithm 1 Randomization procedure for homogeneousQCQP (24)

Input: ;

Output: An optimal solution of problem (24);

1: solve the SDP (18) with one constraint only ,finding ;

2: implement the eigen-decomposition;

3: generate a random with i.i.d. components havingbinary distribution (16);

4: output .

If multiple optimal solutions are required, then one may haveto perform step 3 in Algorithm 1 multiple times. We note thatvector in step 3 could be chosen randomly or deterministi-cally as a vector with components (e.g., simply as theall-one vector). The computational complexity of Algorithm 1is dominated by solving the SDP (18) which is of a worst-casecomplexity with a prefixed solution accuracy(cf. [7]).We note that if the binary distribution (16) is changed to the

uniform distribution (17) over the unit circle in step 3 of Al-gorithm 1 (this only applies to the complex-valued version ofQCQP (24)), then it can be shown in the same way that therandom vector is also optimal.

4Here, denotes the unique Hermitian/symmetric square root matrixsuch that .

It is noteworthy that Problem (24) could be possibly solvedwith the existing algorithms, namely, solving the SDP relax-ation problem followed by the rank reduction technique (cf. [11]and [18]), the rank-onematrix decomposition theorem (cf. [13]),and solving the quadratic feasibility problem proposed in [14].The difference between Algorithm 1 and the three aforemen-tioned approaches is twofold: (1) Our proposed algorithm con-tains an intrinsically probabilistic step (i.e., step 3, even thoughin practice it can be performed deterministically) while the otherones are all deterministic; (2) when the SDP relaxation has ahigh-rank solution, our algorithm appears quick and clean (seesteps 2 and 3) to generate a rank-one solution of the SDP relax-ation problem (whereas the other ones are of a more iterativenature; for example, the rank reduction technique is iterative,the specific rank-one matrix decomposition theorem includesrotation steps). In any case, despite the differences of the dif-ferent approaches, all of them can give an optimal solution tothe problem.

B. Homogeneous QCQP With Two Double-Sided Constraints

Consider now the following homogeneous QCQP:

(25)

where and . The conventionalSDP relaxation of (25) and its dual are (18) and (19) with ,respectively.Proposition 3.2: Suppose that ( ) is a primal-

dual optimal pair for (18)–(19) in the real- or complex-valuedcase with . Then, there is a randomized solution (seeAlgorithm 2) such that it is globally optimal for (25).

Proof: See Appendix B.

Algorithm 2 Randomization procedure for homogeneousQCQP (25)

Input: ;

Output: An optimal solution of problem (25);

1: solve the SDP (18) finding ; let(suppose w.l.o.g.);

2: implement the eigen-decomposition;

3: draw a realization of the random vector with i.i.d.components having the binary distribution (16), suchthat is satisfiedif ;

4: let , and output;

It is noteworthy that we resort to the complementary condi-tions (21)–(23) to show the randomized solution is optimal butwe cannot ensure that the randomized solution is optimal withprobability one (i.e., in step 3 of Algorithm 2, one may have to

Page 7: IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 62, NO. …...A. Robust Receive Beamforming In a design of robust receive beamforming (cf. [8] and ref-erences therein), also termed robust

HUANG AND PALOMAR: ANDOMIZED ALGORITHMS FOR OPTIMAL SOLUTIONS OF DOUBLE-SIDED QCQP 1099

draw multiple realizations until the condition is satisfied), un-like Proposition 3.1 where any randomly or deterministicallyconstructed vector is optimal. In this sense, Proposition 3.1 isstronger, due to the reduced number of constraints.Note also that the elements of in step 3 of Algorithm 2 could

be drawn randomly from (17) (accordingly, is changed toin steps 3 and 4) if the optimization variables of (25) are

complex-valued, and the proof of Proposition 3.2 remains thesame (in addition to the change of into ). As before, thecomputational complexity of the algorithm consists mainly ofsolving the SDP relaxation.

C. Homogeneous QCQPWith Three Double-Sided Constraints

Consider the following QCQP:

(26)

where , and . Suppose thatboth the primal SDP (18) and the dual SDP (19) are solvablewith . Based on a solution pair of the primal and dualSDPs, we are about to retrieve an optimal solution of (26),in a randomized way. To proceed, let us first state the followinglemma.Lemma 3.3: Suppose that is an real-valued diagonal

matrix and belongs to . Then there is a vectorsuch that

(27)

Proof: See Appendix C.The proof is constructive, and we summarize the randomiza-

tion procedure into Algorithm 3.

Algorithm 3 Randomization procedure for generating acomplex vector satisfying (27)

Input: (real diagonal matrix), (with)

Output: A complex-valued vector such thatand ;

1: take two random vectors and , with i.i.d.components having the binary distribution (16), suchthat ;

2: if or then3: output or such that ;4: else5: set

, and

output .

6: end

We remark that from (57) in the proof in Appendix C, one canonly find a complex vector such that (27) is satisfied and the

result does not extend to the real-valued case. For some and, there is not a real complying with (27); for example, it is

verified that it is the case with

It is noteworthy that Algorithm 3 can be used to solvethe complex version of the QCQP with two double-sidedconstraints in (25)5 (i.e., with and ).Indeed, obtaining an optimal solution for the SDP relax-ation (18) of (25) and an eigen-decomposition

, we call Algorithm 3 (with the inputs and) to output . It then is easily veri-

fied that is feasible and optimal for problem(25).6

Now let us see how to obtain an optimal solution for theQCQP with three double-sided constraints in (26) using the ran-domization procedure of Algorithm 3.Proposition 3.4: Suppose that is a

primal-dual optimal pair for (18)–(19) for the complex-valuedcase with . Then, there is a randomized solution (seeAlgorithm 4) such that it is globally optimal for (26).

Proof: See Appendix D.

Algorithm 4 Randomization procedure for complex-valuedhomogeneous QCQP (26)

Input: ;

Output: A solution ;

1: solve the SDP (18) finding ; evaluate; let

(suppose that );2: while do3: decompose , where ;4: implement the eigen-decomposition

; let;

5: ,and set and ;

6: if then7: output ; terminate;8: else9: let and

;10: end11: end while12: return such that .

As can be seen, the computational load includes solving theSDP relaxation problem and some eigen-decompositions, andthus the total computational complexity of the algorithms isdominated by solving the SDP.We note that the real homogeneous QCQP with three double-

sided constraints or more cannot be solved to achieve the global

5In contrast, Algorithm 2 is applicable to both and .6The proof is similar to that of Proposition 3.2.

Page 8: IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 62, NO. …...A. Robust Receive Beamforming In a design of robust receive beamforming (cf. [8] and ref-erences therein), also termed robust

1100 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 62, NO. 5, MARCH 1, 2014

optimality in general (cf. [16]) and the same thing happens forthe complex homogeneous QCQP with four double-sided con-straints or more (cf. [17]); in other words, the SDP relaxation isnot tight for any of the two cases, and the duality gap betweenthe primal QCQP and its dual is positive. Nevertheless, for thecase of complex QCQP (1) with (four double-sided con-straints), some mild sufficient conditions could be added to en-sure the QCQP is convex (similar comments are valid for thereal homogeneous QCQP with three constraints). For example,if there is a nonzero such that

, and an optimal solution of the dual (19)of the SDP relaxation has the null space of dimension more thantwo (i.e., ), then the QCQP is solvable (cf. [17]). For gen-eral number of one-sided constraints, it is known that the QCQPis NP-hard, and some interesting randomized approximate so-lution schemes with provable approximation quality have beenwell studied in optimization literature (e.g., see [3], [4], and [9]).

D. Some Extensions

In this subsection, we handle some generalizations of theprevious solvable QCQPs. Suppose that

, are given with . Considerthen the following separable homogenous QCQP:

(28)

Specially, if , and , theabove QCQP reduces to (26); and if , then the separableQCQP is identical to (26) with block-diagonal matrix parame-ters . In a similar way, we can deal with (28)with one or two double-sided constraints.Let us see how Algorithm 4 is applied to solve (28). Suppose

that the SDP relaxation of (28)

(29)

and its dual

(30)

are solvable, and let be an op-timal primal-dual pair. Then they satisfy the complementaryconditions (similar to (21)–(23)): (i) ; (ii)

; (3).

We can invoke Algorithm 4 times to generate an optimalsolution for (28): (i) solve the primal and dual SDPs (29)–(30)getting an optimal solution ; (ii) let

with the input ,where for each , step 1 in Algorithm 4 should be adapted andchanged to: evaluate and let

(suppose that ). It is not hard to showthat the obtained tuple is optimal for (29)7, and thus

is optimal for (28).More generally, let us consider the following separable SDP:

...

(31)

where all are Hermitian, and for all . One mayconclude that a solution with

for the above SDP can be found in polynomial time, under somemild conditions (cf. ([18], Theorem 3.2)).

IV. APPLICATION OF THE PROPOSED RANDOMIZEDALGORITHMS TO SOLVE PROBLEMS (8), (12), AND (14)

In this section, we demonstrate how to employ the random-ized algorithms previously designed to the three signal pro-cessing applications formulated in Section II.

A. Solving the Robust Receive Beamforming Problems (7)and (8)

The robust receive beamforming problem (7) is a particularinstance of (1) with two double-sided constraints and, thus, ran-domized Algorithm 2 can be immediately employed to solve it.The generalized doubly constrained Capon beamforming

problem (8) has the equivalent form of homogenous QCQP:

(32)

7It is seen that the solution is feasible for the constraint ,due to and the obtained , and that

is a primal-dual pair satisfying the comple-mentary conditions for (29)–(30), i.e., an optimal pair.

Page 9: IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 62, NO. …...A. Robust Receive Beamforming In a design of robust receive beamforming (cf. [8] and ref-erences therein), also termed robust

HUANG AND PALOMAR: ANDOMIZED ALGORITHMS FOR OPTIMAL SOLUTIONS OF DOUBLE-SIDED QCQP 1101

where the matrix parameters are

In words, if solves (32), thensolves (8) (conversely, if solves (8), then is anoptimal solution for (32)). Also, the optimal values are equal:

. Since (32) is in a special form of (26),hence Algorithm 4 is applicable to (32).

B. Solving the Radar Code Maximization Problem (12)

Like (32), the optimal radar code problem (12) has the fol-lowing equivalent homogeneous QCQP reformulation with fourconstraints:

(33a)

(33b)

(33c)

(33d)

(33e)

(33f)

where matrices are defined as follows:

(34)

(35)

It is seen that the optimal values of (12) and (33) are equal,i.e.,

(36)

The conventional SDP relaxation for (33) is as follows:

(37)

which is also an SDP relaxation for (12), considering (36).Note that (33) does not belong to the class of (28). Nonethe-

less, we show that the SDP relaxation (37) is tight (i.e.,), and it turns out that the proof is based

on exploiting the structure that the constraint functions in (12b)and (12d) share the same Hessian . In other words, the QCQP(12) is hidden convex and can be solved polynomially. Theproof can be found in Appendix E. According to the proof, wesummarize how to solve (12): (i) solve (37) getting a solution

(as in (67)), (ii) apply Algorithm 4 to solve (71) in which

is set8, obtaining solution , and (iii) return(which is optimal for (12)).

C. Solving the Single-Group Multicast Downlink BeamformingProblem (14)

It is clear that the beamforming problem (14) is a QCQP withone-sided constraints. Thus, Algorithm 2 is applicable

if , and Algorithm 4 can be employed to solve itif (e.g., and ). Furthermore, forthe beamforming problem (15) with null-shaping interferenceconstraints, it is solvable for up to three and any numberof null-shaping constraints, provided that the SDP relaxationof it is solvable. As a matter of fact, (15) is tantamount to thefollowing QCQP:

(38)

where . When , Problem (38) belongsto the class of QCQP (28) (with ). Therefore the algorithmproposed in Section III.D for (28) can be utilized to solve (38)(or equivalently (15)), as long as its SDP relaxation problem (cf.(29)) is solvable.

V. AN ALTERNATIVE PROOF OF STURM-ZHANG RANK-ONEMATRIX DECOMPOSITION THEOREM

In [13], a specific rank-one decomposition for a positivesemidefinite matrix was proposed, and it turns out that the ma-trix decomposition technique is useful and fundamental as it canbe used to prove some convexity results of joint numerical rangeand -lemma (cf. [13], [15], and [17]). We start by quotingthe rank-one decomposition theorem, and then we present analternative (shorter) proof using probabilistic methods as donein the previous section. This result is a byproduct of this paper.Like the advantages of the rank-one decomposition theorems,one can exploit the probabilistic methods to show the convexityfor some joint numerical ranges, and -lemma. Now, let usstart with the case of real matrices.Lemma 5.1 ([13]): Suppose that is a real positive

semidefinite matrix of rank and is a symmetric ma-trix. Then, there is a rank-one decompositionsuch that

(39)

Proof: First we claim that there is a vectorsuch that and .

In fact, let and . It thus followsthat . Take any vector such that its compo-nents . Alternatively, draw a random vector

8When implementing Algorithm 4, we particularly solve the SDP relaxation(73) of (71) in step 1 of Algorithm 4, obtaining a solution ; however, we donot have to solve (73) in that step, because the block of (the solution of(37) just obtained) is optimal for (73), due to the last remark in Appendix E.

Page 10: IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 62, NO. …...A. Robust Receive Beamforming In a design of robust receive beamforming (cf. [8] and ref-erences therein), also termed robust

1102 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 62, NO. 5, MARCH 1, 2014

according to the distribution (16). And set . Itis verified that is the desired vector.Let , and it is seen that. We repeat the above procedure, getting vector so that

. Repeating the procedureiteratively, we obtain vectors such that they satisfy(39).Likewise, capitalizing on Lemma 3.3, we can provide another

proof of the rank-one decomposition theorem for Hermitian ma-trices in [15].Lemma 5.2 ([15]): Suppose that is a complex

Hermitian positive semidefinite matrix of rank , and aretwo given Hermitian matrices. Then, there is a rank-onedecomposition such that

Proof: We claim that there is a such that

(40)

In fact, let( and are ), and . It follows fromLemma 3.3 that there is a randomized vector such that

, and. It is easily verified that is the

intended vector satisfying (40).Like the second paragraph in the proof of Lemma 5.1, we can

obtain such that and. This completes the proof.

We remark that the rank-one decomposition Lemma 5.2 canbe utilized to show Lemma 3.3. However, the difference lies inthat the proof of Lemma 5.2 in [15] (cf. [13]) includes some de-terministic rotation procedures to generate the desired vectors,while the selection of a vector in the proof of Lemma 3.3 isbased on some randomization steps.

VI. NUMERICAL EXAMPLES

In this section, we present some numerical examples to il-lustrate the performance of the algorithms. The numerical ex-amples are from both robust receive beamforming and optimaldownlink transmit beamforming.

A. Simulation Examples: Robust Receive BeamformingProblem (7)

In the simulations, we assume a uniform linear array withomni-directional sensors spaced half a wavelength and

with spatially and temporally white Gaussian noise whose co-variance is given by . Two equal-power interferers with theinterference-to-noise ratio (INR) of 30 dB are assumed to im-pinge on the array from the angles and withrespect to the array broadside. The angular sector of interest ispreset to with . The actual SOI is assumedto impinge on the array from the direction (which couldbe viewed as a 4 mismatch in the signal look direction from the

Fig. 1. Average output array SINR versus SNR.

presumed ), and it is always present in the training data withtraining sample size . The norm perturbation parametersboth and are set to . All results are averaged over 200simulation runs. In each run, both the beamforming problem (7)and the beamforming problem (23)–(25) in [33] are solved fordifferent SNR dB. The two beamforming prob-lems are termed “Proposed Beamformer” and “KVH Beam-former” respectively in the following figures.Further, we assume that the SOI steering vector from the

angle is distorted by wave propagation effects in the waythat independent-increment phase distortions are accumulatedby the components of the SOI steering vector (starting fromzero), and assume that the phase increments are independentGaussian variables with zero mean and standard deviation 0.08,and they are randomly generated and remain frozen in each sim-ulation run.Simulation Example 1: We evaluate the performance in

terms of both beamformer output SINR (4) and output power(6). Fig. 1 shows the output array SINR versus the SNR, andFig. 2 displays the beamformer output power curves versusSNR. As we can see, the output SINR by (7) is only slightlybetter than that by the beamforming problem in [33], while theformer beamformer has higher output power than the latter one.It is expected, since the double-sided constraint describing thenorm perturbation in (7) allows the larger feasible region forsearching the optimal steering vector.

B. Simulation Examples: Optimal Multicast DownlinkBeamforming Problem (15)

In the subsection, we test several simulated scenarios forthe single-group multicast downlink beamforming problem(15) with null-shaping interference constraints described inSections II.C and IV.C.We consider a simulated scenario with a 16-antenna base sta-

tion transmitting a common data stream to three single-antennausers, i.e., and in Problem (14). The users arelocated at and relative to the

Page 11: IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 62, NO. …...A. Robust Receive Beamforming In a design of robust receive beamforming (cf. [8] and ref-erences therein), also termed robust

HUANG AND PALOMAR: ANDOMIZED ALGORITHMS FOR OPTIMAL SOLUTIONS OF DOUBLE-SIDED QCQP 1103

Fig. 2. Average beamformer output power versus SNR.

array broadside of the base station. The transmit antenna arrayis linear and has the elements spaced half a wavelength. Thechannel covariance matrix for users is generatedaccording to (see [22])

(41)

, where is the angular spread of local scat-ters surrounding user . The noise variance is set toand the SNR threshold value for each internal user .The channel between the base station and external user (lo-cated at relative to the base station) is given by

(42)

with and . The tolerable valueof the soft-shaping constraint in (14) is set to zero; in words,

the stricter version (15) (or (38)) with null interference con-straints are considered in the simulation.Simulation Example 2: In this example, we present simula-

tion results for the beamforming problem (38) where six nullinterference constraints (i.e., ) for six external users at

, together with the three in-ternal users, are involved. In order to illustrate the effect of thenull interference constraints, we evaluate the power radiationpattern of the base station, for , according to

(43)

where is an optimal beamvector and is defined in (42).We report that the SDP relaxation of (38) gives a high-rank so-lution in our simulation experiment, and thus Algorithm 4 isapplied to generate a rank-one solution. Fig. 3 displays the ra-diation pattern of the base station with the channel covariancematrix (high-rank) (41) employed (the minimal required trans-mission power is 14.92 dBm).

Fig. 3. Radiation pattern of the base station, for the problem using the general-rank channel covariance matrices for the internal users, with six null-shapinginterference constraints and transmit antennas. (The required trans-mission power is 14.92 dBm.)

Fig. 4. Minimal transmission power versus the number of null-shaping inter-ference constraints, with different numbers of transmit antennas, adopting thegeneral-rank channel covariance matrices for the internal users.

Simulation Example 3: This example shows howthe minimal transmission power in (15) is affected bythe number of null-shaping interference constraints andby the number of transmit antennas. Apart from thethree internal users, we consider ten external users lo-cated at

. By saying null interferenceconstraints, we mean the external users located at less thanor equal to the first th smallest element of .Fig. 4 illustrates the minimal transmission power versus thenumber of null interference constraints. As can be seen, higherand higher transmission power is required to comply with null

Page 12: IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 62, NO. …...A. Robust Receive Beamforming In a design of robust receive beamforming (cf. [8] and ref-erences therein), also termed robust

1104 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 62, NO. 5, MARCH 1, 2014

interference constraints for more and more external users, aswell as less and less transmit antennas. The latter observationis due to the fact that given , the beamforming problem (15)with larger (number of transmit antennas) possesses biggersearch space (thus the minimal value is smaller).

VII. CONCLUSION

In this paper, we have considered the QCQP withdouble-sided constraints. Although the problem is typicallyhard to solve in general, we have proposed efficient algorithmsfor some instances of the problem with a small number ofconstraints. The presented algorithms are mainly composed ofsimple randomization steps following the resolution of the SDPrelaxation of the problem. The optimization problems arisingin three signal processing applications have been formulatedin a general QCQP form and it has been demonstrated how tosolve them (achieving global optimality) by the randomizedalgorithms. As a byproduct, we have provided a shorter prooffor the Sturm-Zhang rank-one matrix decomposition theoremusing the probabilistic method. Numerical examples have beenconducted to show the effectiveness of the proposed algo-rithms for the QCQP in the context of both the robust receivebeamforming problem and the broadcast MISO downlinkbeamforming problem.

APPENDIX

A. Proof of Proposition 3.1

Proof: Since any with its components can bealways obtained by taking a random vector whose componentsare i.i.d. variables having the distribution (16), hence it sufficesfor us to show that is an optimal solution for (24),where that is a vector whose components are i.i.d. randomvariables following the binary distribution (16).Let . It follows that

(44)

(note that when it is real-valued) and

(45)

where . We further claim that

(46)

In fact, assume that there is a random vector whose compo-nents are i.i.d. random variables following the distribution (16),such that

It is seen that is feasible forProblem (18) (with one double-sided constraint), and thus isbetter than the optimal value, which is an evident contradiction.

Therefore, . Thistogether with (45) yields

(47)

Therefore we conclude that the vector is an optimalsolution of QCQP (24).We remark that the proof can alternatively be done in a de-

terministic way, namely, the optimal solution can beproved always within the null space of the optimal dual solution(i.e., the complementary condition (21)), where is a vector sat-isfying the proposition. (However, we do not have to considerthe optimal dual solution in the probabilistic proof.)

B. Proof of Proposition 3.2

Proof: Let . If , thenthe optimal value (note that in (18)) is equalto zero, and is optimal. Otherwise, , thenit is easily seen that , which contradicts to thepremise of SDP’s solvability. Thus we consider , withoutloss of generality, in what follows.Observe that , which amounts to

. Compute a eigen-decom-

position , and let bea vector whose components are i.i.d. random variables with thedistribution (16). Then, it is verified that with probability one,

(48)

where we employ the fact that has diagonal elements one.It is verified also that

where we use the fact that . It follows that thereis a realization of the random vector (with i.i.d. randomcomponents of the distribution (16)) such that

(49)

Here, we note that the probability isalways positive for the case of (discussion is similar tothe case of ), where and

. Thus the probability that after independent trialsthere is no satisfying (49) is , which equals 0.0066for and .Regarding (48), one may try to find a in a deterministic way

(as long as is not large and adopted in (49) is of i.i.d. com-ponents according to (16), instead of (17)), although a sufficient(but not excessive) number of randomizations can be generatedto find a desired .Let

(50)

Page 13: IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 62, NO. …...A. Robust Receive Beamforming In a design of robust receive beamforming (cf. [8] and ref-erences therein), also termed robust

HUANG AND PALOMAR: ANDOMIZED ALGORITHMS FOR OPTIMAL SOLUTIONS OF DOUBLE-SIDED QCQP 1105

and it is clear that . From (48) it follows that

(51)

Evidently, (50) and (51) yield

(52)

Define , and (52) is identical to

(53)

In other words, (where we note in )is feasible for (18), and complies with the complementaryconditions (22)–(23) together with the dual optimal solution

(according to the assumption). Besides, notethat

(54)

where the last inclusion relation is due to (21)9. This means, i.e., and fulfill the complemen-

tary condition (21). Therefore we conclude that is op-timal for the SDP (18); that is, is an optimal solution ofthe QCQP (25).

C. Proof of Lemma 3.3

Proof: Let and . Take i.i.d. randomvariables of the distribution (16) for . Thus

with probability one, and. We proceed the proof in two cases: (i)

(note that it is the case if is a diagonalmatrix); (ii) .Case (i). Since with probability one, hence any

realization of the random vector satisfies (27).Case (ii). Let and

. Assume that . Otherwise,if , it then follows that and

, which is case (i) we have just shown. Let ustake a random vector which is independent from andis with i.i.d. components having the distribution (16). Observethat

. Therefore there are two realizations andof the random vectors and respectively, such that10

(55)

The next step is to form another vector such thatusing and .

9To be more specific, for any element , it has the prop-erty , since , which is due to (i.e., (21)),

and . Thus it follows that .10We note that the probability of the event that no such and are generated

after independent trials is at most , which equals 0.0059 forand , for example. Thus such and requires relatively

few trials to generate, and the number of trials is independent from the sizeof .

For easy notation, we remove the bars over and in theremaining proof. Let , and set

(56)

(57)

It is seen that is a root of

(58)

In (58), we note that and(recall that is symmetric and is skew-symmetric), andthat the (58) does have a root, due to (55). It is further verifiedthat the so-generated fulfills , and

, where the last equality amounts to (58).

D. Proof of Proposition 3.4

Proof: Assume that , and. Let . Suppose that one of is

nonzero (if all are zero, then the optimal value andis optimal), say .

It follows that

(59)

where . Let

(60)

(61)

Then (59) is equivalent to , and . Applyingthe randomization procedure described in the proof of Lemma3.3 (cf. Algorithm 3), we can generate a random vectorsuch that

(62)

Letting , it follows from (60)–(62) that

(63)

Set . If , then it is verified that

(64)

satisfies , and 11.It follows from the complementary conditions (21)–(23) that

is optimal for the SDP (18). Then we end up with therandomized optimal solution for (26).

11Since , henceand and for any . That is, for

any . This implies that .

Page 14: IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 62, NO. …...A. Robust Receive Beamforming In a design of robust receive beamforming (cf. [8] and ref-erences therein), also termed robust

1106 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 62, NO. 5, MARCH 1, 2014

If , then we see that the matrix

(65)

is of rank , due to (see (62)). Let

where . It is easily verified that, and (since ). In

other words, the randomized matrix is feasible for (18)and satisfies the complementary conditions (21)–(23), and thusoptimal with rank reduced to .Let , and repeat the previous procedure while

is more than or equal to two. In fact, when , we repeat thesame procedure and obtain either a randomized optimal solutionfor (26) (like (64)), corresponding to , or a rank-reducedsolution (i.e., a rank-one solution) for the SDP (18) (like (65)),corresponding to .

E. The SDP Relaxation Tightness for (33)

Proof: We wish to show that the optimal value of SDPrelaxation problem (37) is equal to that of radar code problem(33), namely,

Since it is evident that

(66)

hence we need only to show the reverse inequality. To proceed,let

(67)

is an optimal solution for (37), and let

(68)

Let us formulate the new code design problem (specifying thecode norm):

(69)

Since , hence we have

(70)

The problem (69) can be transformed equivalently into the ho-mogeneous QCQP

(71a)

(71b)

(71c)

(71d)

(71e)

through certain phase rotation (cf. ([25], page 5621)), i.e.,

(72)

Further, if is optimal for (71), then is optimalfor (69). Now Problem (71) can be solved by Algorithm 4, andit can be claimed that the SDP relaxation problem for (71)

(73)

is tight, namely,

(74)

It follows from (66), (36), (70), (72), and (74) that

Thus in order to show that all the optimal values are equal (con-sequently ), it suffices to prove that

(75)

Indeed, since any optimal solution of (37) (as in (67)) is fea-sible for the problem itself, hence the block (of ) com-plies with (71b), (71c), and satisfies (33d). It follows that

. Observe that (dueto ), and it follows that

which implies that also fulfills (71d). Therefore, is fea-sible for (73). This means that any optimal solution for (37)gives a feasible solution for (73), and hence we conclude (75).We remark that since , hence the blockof an optimal solution (as in (67)) for (37) is optimal for

(73).

REFERENCES

[1] S. Boyd and L. Vandenberghe, Convex Optimzation. Cambridge,U.K.: Cambridge Univ. Press, 2004.

[2] A. Ben-Tal and A. Nemirovski, “Lectures on modern convex optimiza-tion” Georgia Inst. Technol., Atlanta, GA, USA, 2013 [Online]. Avail-able: http://www2.isye.gatech.edu/nemirovs/Lect_ModConvOpt.pdf

[3] A. Nemirovski, K. Roos, and T. Terlaky, “On maximization ofquadratic form over intersection of ellipsoids with common center,”Math. Program., ser. A, vol. 86, pp. 463–473, 1999.

Page 15: IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 62, NO. …...A. Robust Receive Beamforming In a design of robust receive beamforming (cf. [8] and ref-erences therein), also termed robust

HUANG AND PALOMAR: ANDOMIZED ALGORITHMS FOR OPTIMAL SOLUTIONS OF DOUBLE-SIDED QCQP 1107

[4] Z.-Q. Luo, N. D. Sidiropoulos, P. Tseng, and S. Zhang, “Approxima-tion bounds for quadratic optimization with homogeneous quadraticconstraints,” SIAM J. Optimiz., vol. 18, no. 1, pp. 1–28, 2007.

[5] N. Sidiropoulos, T. Davidson, and Z.-Q. Luo, “Transmit beamformingfor physical-layer multicasting,” IEEE Trans. Signal Process., vol. 54,no. 6, pp. 2239–2251, Jun. 2006.

[6] Y. Huang and S. Zhang, “Approximation algorithms for indefinitecomplex quadratic maximization problems,” Sci. China Series A:Math., vol. 53, no. 10, pp. 2697–2708, Oct. 2010.

[7] Z.-Q. Luo, W.-K. Ma, A. M.-C. So, Y. Ye, and S. Zhang, “Semidefiniterelaxation of quadratic optimization problems: From its practical de-ployments and scope of applicability to key theoretical results,” IEEESignal Process. Mag., vol. 27, no. 3, pp. 20–34, May 2010.

[8] A. B. Gershman, N. D. Sidiropoulos, S. Shahbazpanahi, M. Bengtsson,and B. Ottersten, “Convex optimization-based beamforming: From re-ceive to transmit and network designs,” IEEE Signal Process. Mag.,vol. 27, no. 3, pp. 62–75, May 2010.

[9] Z.-Q. Luo and T.-H. Chang, , D. P. Palomar and Y. Eldar, Eds., “SDPrelaxation of homogeneous quadratic optimization: Approximationbounds and applications,” in Convex Optimization in Signal Pro-cessing and Communications. Cambridge, U.K.: Cambridge Univ.Press, 2010, ch. 4.

[10] A. Ben-Tal and M. Teboulle, “Hidden convexity in some nonconvexquadratically constrained quadratic programming,” Math. Program.,vol. 72, pp. 51–63, 1996.

[11] G. Pataki, “On the rank of extreme matrices in semidefinite programsand the multiplicity of optimal eigenvalues,” Math. Operations Res.,vol. 23, no. 2, pp. 339–358, 1998.

[12] Y. Ye and S. Zhang, “New results on quadratic minimization,” SIAMJ. Optimiz., vol. 14, no. 1, pp. 245–267, 2003.

[13] J. Sturm and S. Zhang, “On cones of nonnegative quadratic functions,”Math. Operations Res., vol. 28, no. 2, pp. 246–267, 2003.

[14] A. Beck and Y. Eldar, “Strong duality in nonconvex quadratic opti-mization with two quadratic constraints,” SIAM J. Optimiz., vol. 17,no. 3, pp. 884–860, 2006.

[15] Y. Huang and S. Zhang, “Complexmatrix decomposition and quadraticprogramming,” Math. Operations Res., vol. 32, no. 3, pp. 758–768,2007.

[16] W. Ai and S. Zhang, “Strong duality for the CDT subproblem: A nec-essary and sufficient condition,” SIAM J. Optimiz., vol. 19, no. 4, pp.1735–1756, 2009.

[17] W. Ai, Y. Huang, and S. Zhang, “New results on Hermitian matrixrank-one decomposition,”Math. Program.: Series A, vol. 128, no. 1–2,pp. 253–283, June 2011.

[18] Y. Huang andD. P. Palomar, “Rank-constrained separable semidefiniteprogramming with applications to optimal beamforming,” IEEE Trans.Signal Process., vol. 58, no. 2, pp. 664–678, Feb. 2010.

[19] Y. Huang and D. P. Palomar, “A dual perspective on separablesemidefinite programming with applications to optimal downlinkbeamforming,” IEEE Trans. Signal Process., vol. 58, no. 8, pp.4254–4271, Aug. 2010.

[20] A. De Maio, Y. Huang, D. P. Palomar, S. Zhang, and A. Farina, “Frac-tional QCQP with applications in ML steering direction estimationfor radar detection,” IEEE Trans. Signal Process., vol. 59, no. 1, pp.172–185, Jan. 2011.

[21] A. Beck and Y. Eldar, “Doubly constrained robust Capon beamformerwith ellipsoidal uncertainty sets,” IEEE Trans. Signal Process., vol. 55,no. 2, pp. 753–758, Feb. 2007.

[22] M. Bengtsson and B. Ottersten, “Optimal transmit beamformingusing semidefinite optimization,” in Proc. 37th Annu. Allerton Conf.Commun., Contr., Comput., Sept. 1999, pp. 987–996.

[23] M. Bengtsson and B. Ottersten, , L. C. Godara, Ed., “Optimal and sub-optimal transmit beamforming,” in Handbook of Antennas in WirelessCommunications. Boca Raton, FL: CRC Press, Aug. 2001, ch. 18.

[24] O. Besson, “Adaptive detection with bounded steering vectorsmismatch angle,” IEEE Trans. Signal Process., vol. 55, no. 4, pp.1560–1564, Apr. 2007.

[25] A. De Maio, S. De Nicola, Y. Huang, S. Zhang, and A. Farina, “Codedesign to optimize radar detection performance under accuracy andsimilarity constraints,” IEEE Trans. Signal Process., vol. 56, no. 11,pp. 5618–5629, Nov. 2008.

[26] W.-K. Ma and P. C. Ching, “Crosstalk resilient interference cancel-lation in microphone arrays using Capon beamforming,” IEEE Trans.Speech Audio Process., vol. 12, no. 5, pp. 468–477, Sep. 2004.

[27] S. A. Vorobyov, A. B. Gershman, and Z.-Q. Luo, “Robust adaptivebeamforming using worst-case performance optimization: A solutionto the signal mismatch problem,” IEEE Trans. Signal Process., vol. 51,no. 2, pp. 313–324, Feb. 2003.

[28] R. G. Lorenz and S. P. Boyd, “Robust minimum variance beam-forming,” IEEE Trans. Signal Process., vol. 53, no. 5, pp. 1684–1696,May 2005.

[29] J. Li and P. Stoica, Robust Adaptive Beamforming. Hoboken, NJ,USA: Wiley, 2006.

[30] J. Li, P. Stoica, and Z.Wang, “Doubly constrained robust Capon beam-former,” IEEE Trans. Signal Process., vol. 52, no. 9, pp. 2407–2423,Sep. 2004.

[31] C.-Y. Chen and P. P. Vaidyanathan, “Quadratically constrained beam-forming robust against direction-of-arrival mismatch,” IEEE Trans.Signal Process., vol. 55, no. 8, pp. 4139–4150, Aug. 2007.

[32] S.-J. Kim, A. Magnani, A. Mutapcic, S. P. Boyd, and Z.-Q. Luo, “Ro-bust beamforming via worst-case SINR maximization,” IEEE Trans.Signal Process., vol. 56, no. 4, pp. 1359–1547, Apr. 2008.

[33] A. Khabbazibasmenj, S. A. Vorobyov, and A. Hassanien, “Robustadaptive beamforming based on steering vector estimation with aslittle as possible prior information,” IEEE Trans. Signal Process., vol.60, no. 6, pp. 2974–2987, Jun. 2012.

[34] A. Hassanien, S. A. Vorobyov, and K. M. Wong, “Robust adaptivebeamforming using sequential quadratic programming: An iterative so-lution to the mismatch problem,” IEEE Signal Process. Lett., vol. 15,pp. 733–736, 2008.

[35] Y. Huang, A. DeMaio, and S. Zhang, , D. P. Palomar and Y. Eldar, Eds., “Semidefinite programming, matrix decomposition, and radar codedesign,” in Convex Optimization in Signal Processing and Communi-cations. Cambridge, U.K.: Cambridge Univ. Press, 2010, ch. 6.

[36] A. De Maio, S. De Nicola, Y. Huang, D. P. Palomar, S. Zhang, and A.Farina, “Code design for radar STAP via optimization theory,” IEEETrans. Signal Process., vol. 58, no. 2, pp. 679–694, Feb. 2010.

[37] A. De Maio, S. De Nicola, Y. Huang, S. Zhang, and A. Farina, “Adap-tive detection and estimation in the presence of useful signal and inter-ference mismatches,” IEEE Trans. Signal Process., vol. 57, no. 2, pp.436–450, Feb. 2009.

[38] E. Karipidis, N. Sidiropoulos, and Z.-Q. Luo, “Far-field multicastbeamforming for uniform linear antenna arrays,” IEEE Trans. SignalProcess., vol. 55, no. 10, pp. 4916–4927, Oct. 2007.

[39] G. Scutari, D. P. Palomar, and S. Barbarossa, “CognitiveMIMO radio,”IEEE Signal Process. Mag., vol. 25, no. 6, pp. 46–59, Nov. 2008.

[40] E. Karipidis, N. D. Sidiropoulos, and Z.-Q. Luo, “Convex transmitbeamforming for downlink multicasting to multiple co-channelgroups,” in Proc. IEEE ICASSP, 2006, pp. 973–976.

[41] K. T. Phan, S. A. Vorobyov, N. D. Sidiropoulos, and C. Tellambura,“Spectrum sharing in wireless networks via QoS-aware secondarymul-ticast beamforming,” IEEE Trans. Signal Process., vol. 57, no. 6, pp.2323–2335, Jun. 2009.

[42] Y. J. Zhang and A. M.-C. So, “Optimal spectrum sharing in MIMOcognitive radio networks via semidefinite programming,” IEEE J. Sel.Areas Commun., vol. 29, no. 2, pp. 362–373, Feb. 2011.

[43] Y. Huang, Q. Li, W.-K. Ma, and S. Zhang, “Robust multicast beam-forming for spectrum sharing-based cognitive radios,” IEEE Trans.Signal Process., vol. 60, no. 1, pp. 527–533, Jan. 2012.

[44] G. Zheng, K.-K. Wong, and B. Ottersten, “Robust cognitive beam-forming with bounded channel uncertainties,” IEEE Trans. SignalProcess., vol. 57, no. 12, pp. 4871–4881, Dec. 2009.

[45] S. Fazeli-Dehkordy, S. Shahbazpanahi, and S. Gazor, “Multiplepeer-to-peer communications using a network of relays,” IEEE Trans.Signal Process., vol. 57, no. 8, pp. 3053–3062, Aug. 2009.

[46] R. Wang, M. Tao, and Y. Huang, “Linear precoding designs foramplify-and-forward multiuser two-way relay systems,” IEEE Trans.Wireless Commun., vol. 11, no. 12, pp. 4457–4469, Dec. 2012.

[47] Z. Quan, W.-K. Ma, S. Cui, and A. H. Sayed, “Optimal linear fusionfor distributed detection via semidefinite programming,” IEEE Trans.Signal Process., vol. 58, no. 4, pp. 2431–2436, Apr. 2010.

[48] D. Ramı́rez, J. Vı́a, and I. Santamarı́a, “Coherent fusion of informationfor optimal detection in sensor networks,” in Proc. 2009 IEEE/SP 15thWorkshop Statist. Signal Process., Cardiff, U.K., Aug.–Sept. 2009, pp.793–796.

[49] M. U. Torun, A. N. Akansu, and M. Avellaneda, “Portfolio risk inmultiple frequencies,” IEEE Signal Process. Mag., vol. 28, no. 5, pp.61–71, Sep. 2011.

Page 16: IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 62, NO. …...A. Robust Receive Beamforming In a design of robust receive beamforming (cf. [8] and ref-erences therein), also termed robust

1108 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 62, NO. 5, MARCH 1, 2014

Yongwei Huang (M’09) received the B.Sc. degreein information and computation science in 1998 andthe M.Sc. degree in operations research in 2000, bothfrom Chongqing University. In 2005, he received thePh.D. degree in operations research from the ChineseUniversity of Hong Kong.He is a Research Assistant Professor in the Depart-

ment of Mathematics, the Hong Kong Baptist Uni-versity, Hong Kong. Prior to the current position, hewas a Postdoctoral Fellow with the Department ofSystems Engineering and Engineering Management,

the Chinese University of Hong Kong, and a Visiting Researcher of the De-partment of Biomedical, Electronic, and Telecommunication Engineering, Uni-versity of Naples “Federico II”, Italy, and a Research Associate with the De-partment of Electronic and Computer Engineering, the Hong Kong Universityof Science and Technology. His research interests are related to optimizationtheory and algorithms, and their applications in signal processing for radar andwireless communications.

Daniel P. Palomar (S’99–M’03–SM’08–F’12) re-ceived the Electrical Engineering and Ph.D. degreesfrom the Technical University of Catalonia (UPC),Barcelona, Spain, in 1998 and 2003, respectively.He is an Associate Professor in the Department

of Electronic and Computer Engineering at theHong Kong University of Science and Technology(HKUST), Hong Kong, which he joined in 2006.Since 2013 he is a Fellow of the Institute for AdvanceStudy (IAS) at HKUST. He had previously heldseveral research appointments, namely, at King’s

College London (KCL), London, UK; Technical University of Catalonia(UPC), Barcelona; Stanford University, Stanford, CA; TelecommunicationsTechnological Center of Catalonia (CTTC), Barcelona; Royal Institute ofTechnology (KTH), Stockholm, Sweden; University of Rome “La Sapienza”,Rome, Italy; and Princeton University, Princeton, NJ. His current researchinterests include applications of convex optimization theory, game theory, andvariational inequality theory to financial systems and communication systems.Dr. Palomar is an IEEE Fellow, a recipient of a 2004/06 Fulbright Research

Fellowship, the 2004 Young Author Best Paper Award by the IEEE Signal Pro-cessing Society, the 2002/03 best Ph.D. prize in information technologies andcommunications by the Technical University of Catalonia (UPC), the 2002/03Rosina Ribalta first prize for the Best Doctoral Thesis in Information Technolo-gies and Communications by the Epson Foundation, and the 2004 prize for thebest Doctoral Thesis in Advanced Mobile Communications by the VodafoneFoundation and COIT.He serves as an Associate Editor of IEEE TRANSACTIONS ON INFORMATION

THEORY, and has been an Associate Editor of IEEE TRANSACTIONS ON SIGNALPROCESSING, a Guest Editor of the IEEE Signal Processing Magazine 2010Special Issue on “Convex Optimization for Signal Processing,” the IEEEJOURNAL ON SELECTED AREAS IN COMMUNICATIONS 2008 Special Issueon “Game Theory in Communication Systems,” and the IEEE JOURNAL ONSELECTED AREAS IN COMMUNICATIONS 2007 Special Issue on “Optimizationof MIMO Transceivers for Realistic Communication Networks.”