ISBN: 0160-7642

Text
                    Conference Board of the Mathematical Sciences
CBMS
Regional Conference Series in Mathematics
Number 92
Spectral Graph Theory
Fan R. K. Chung
I)
.
{}
O""O('IvDF(> \'f,....
Published for the
Conference Board of the Mathematical Sciences
by the
American Mathematical Society
Providence. Rhode Island
with support from the
National Science Foundation
 .L'SC'
o 
.. 0
z m
. .
... ...
0(,,'-'0,,1,0


CEMS Conference' on Heeen!' Advances in Spectral Graph Theory held at California State University at Fresno, June 6-10, 1994 Contents Research partially supported by the National Science Foundation 1991 Mathematics Subject Classification. Primary 05-XX. Preface xi Chapter 1. Eigenvalues and the Laplacian of a graph 1 Librnry of CongTess Cntnloging-in-PuhlicnUoll 1)11.t.o Chung, Fan R. K. Spectral graph theory / Fan R. K. Chung. p. cm.-(Regional conference series in mathematics, ISSN 0160-7642 ; no. 92) "CBMS Conference on R.ecent Advances in Spectral Graph Theory held at California St.ate Universit.y at Fresno, June 6-10, 1994"-T.p. verso. Includes bibliographical references. ISBN 0-8218-0315-8 (soft: alk. paper) I. Graph theory-Congresses. 2. Eigenvalues-Congresses. Advances in Spectral Graph Theory (1994 California State III. Series. ') v 7-l3  /"9 QAl.R33 no. 92 '- 1.0 [QAI66] / 11:'" 51I'.5-dc21 h ' " ; - ,,' ,; " /il 'I' "' \ ,,I l ! 'I w.... ': \ ' .,,' .... r ":",:-,';:' '.' Ca'-. "'..--. Copying and reprinting. Individual readers of this publication, and nonprofit libraries acting for them, are permitted to make fair use of t.he material, such as to copy a chapt.er for use in teaching or research. Permission is granted to quote brief passages from this publication i" reviews, provided the customary acknowledgment of the source is given. Republication, systematic copying, or multiple reproduction of any material in this publication (including abstracts) is permitted only under license from the American Mathematical Society. R.equests for such permission should be addressed to the Assistant to the Publisher, America.n Mathematical Society, P. O. Box 6218, Providence, Rhode Isla.nd 02910-6248. Requests ca.n also be made bye-mail t.o reprint-pennissionlj)ams. arg. 1.1. Introduction 1.2. The Laplacian and eigenvalues 2 1.3. Basic facts about the spectrum of a graph 6 1.4. Eigenvalues of weighted graphs 12 I. CBMS Conference on Recent University at Fresno) II. Title. 92 1.5. Eigenvalues and random walks 14 Chapter 2. Isoperimetric problems 23 96-45112 CIP 2.1. History 2.2. The Cheeger constant of a graph 2.3. The edge expansion of a graph 23 24 25 2.4. The vertex expansion of a graph 29 2.5. A characterization of the Cheeger constant 32 2.6. Isoperimetric inequalities for cartesian products 35 @ 1997 by the American Mathematical Society. All rights reserved. The American Mathematical Society retains all rights except. those gra.nterl to !.lIP Unit.ed St.ates Covel'lln",nt.. Printf'd ill the Ul1itf'd States or America. €?> 'I'll(' paper used in this book is acid-free and falls wit.hin the guidelines established to ensure permanence and durability. Chapter 3. Diameters and eigenvalues 3.1. The diameter of a graph 41 41 3.2. Eigenvalues and distances between two subsets 43 10987654321 01 00 99 98 97 3.3. Eigenvalues and distances among many subsets 3.4. Eigenvalue upper bounds for manifolds 46 48 Chapter 4. Paths, flows, and routing 55 
viii CONTENTS 4.1. Paths and sets of paths 4.2. Flows and Cheeger constants 4.3. Eigenvalues and routes with small congestion 4.4. Routing in graphs 4.5. Comparison theOfems 55 56 58 60 64 69 69 71 77 81 87 87 88 93 98 101 103  109 109 110 112 114 117 119 123 123 CONTENTS 8.2. The Neumann eigenvalues of a subgraph 8.3. Neumann eigenvalues and random walks 8.4. Dirichlet eigenvalues 8.5. A matrix-tree theorem and Dirichlet eigenvalues 8.6. Determinants and invariant field theory ix 124 126 128 129 131 Chapter 5. Eigenvalues and quasi-randomness 5.1. Quasi-randomness 5.2. The discrepancy property 5.3. The deviation of a graph 5.4. Quasi-random graphs Chapter 6. Expanders and explicit constructions 6.1. Probabilistic mcthods versus explicit constructions 6.2. The expanders 6.3. Examples of explicit constructions 6.4. Applications of expanders in communication networks 6.5. Constructions of graphs with small diameter and girth 6.6. Weightcd Laplacians and the Lovasz 1') function Chapter 9. Harnack inequalities 9.1. Eigenfunctions 9.2. Convex subgraphs of homogeneous graphs 9.3. A Harnack inequality fOf homogeneous graphs 9.4. Harnack inequalities for Dirichlet eigcnvalues 9.5. Harnack inequalities for Neumann eigenvalues 9.6. Eigenvalues and diameters 135 135 136 138 140 142 144 Chapter 7. Eigenvalues of symmetrical graphs 7.1. Symmetrical graphs 7.2. Cheeger constants of symmetrical graphs 7.3. Eigenvalues of symmetrical graphs 7.4. Distance transitive graphs 7.5. Eigenvalues and group representation theory 7.6. The vibrational spectrum of a graph Chapter 10. Heat kernels 10.1. The heat kernel of a graph and its induced subgraphs 10.2. Basic facts on heat kernels 10.3. An eigenvalue inequality 10.4. Heat kernel lower bounds 10.5. Matrices with given row and column sums 10.6. Random walks and the heat kernel 145 145 146 148 150 156 161 Chapter 8. Eigenvalues of subgraphs with boundary conditions 8.1. Neumann eigenvalues and Dirichlet eigenvalues Chapter 11. Sobolev inequalities 11.1. The isoperimetric dimension of a graph 11.2. An isoperimetric inequality 11.3. Sobolev inequalities 11.4. Eigenvalue bounds 11.5. Generalizations to weighted graphs and subgraphs 163 163 165 168 170 175 Chapter 12. Advanced techniques for random walks on graphs 177 
x CONTENTS 12.1. Several approaches for bounding convergence 12.2. Logarithmic Sobolev inequalities 12.3. A comparison theorem for the log-Sobolev constant 12.4. Logarithmic Harnack inequalities 12.5. The isoperimetric dimension and the Sobolev inequality Bibliography Index 177 180 185 187 191 Preface 195 204 This monograph is an intertwined tale of eigenvalues and their use in unlock- ing a thousand secrets about graphs. The stories will be told -- how the spectrum reveals fundamental properties of a graph, how spectral graph theory links the discrete universe to the continuous one through geometric, analyt.ic and algebraic techniques, and how, through eigenvalues, t.heory am! applications in communica- tions and computer science come together in symbiotic harmony. Since spectral graph theory has been evolving very rapidly, the above goals can only be partially fulfilled here. For example, more advanced material on the heat kernel will be treated in a later publication. This book is based on ten lectures given at the CBMS workshop on spectral graph theory in June 1994 at Fresno State University. Additional chapters were included on subgraphs with boundary conditions and on advanced techniques for random walks. I wish to thank S.T. Yau for introducing me to powerful ideas from spectral geometry. The last few chapters are mainly based on our collaborative work on geometry of graphs. Special thanks are due to Ron Graham, without whose encouragement this book would never have existed. In the course of writing, I have greatly benefitted from numerous suggestions and valuable comments of Noga Alon, Andy Woldar, Felix Lazebnik, David Gillman, Elizabeth Wilmer, Prasad Tetali and Herb Wilf. I would also like to acknowledge the support of National Science Foundation through Grant No. DMS 95-04834.  Like all authors, I would hope that these lecture notes are completely error- free. However, to be realistic, I plan to maintain an errata list on my home page http://www.math,upenn.edu/chung. Natur'.llly, I will be grateful for any contri- bution to this list. Fan Chung September, 1996 
CHAPTER 1 Eigenvalues and the Laplacian of a graph 1.1. Introduction Spectral graph theory has a long history. In the early days, matrix theory and linear algebra were used to analyze adjacency matrices of graphs. Algebraic methods are especially effective in treating graphs which are regular and symmetric. Sometimes, certain eigenvalues have been referred to as the "algebraic connectivity" of a graph [126]. There is a large literature on algebraic aspects of spectral graph theory, well documented in several surveys and books, such as Biggs [25], Cvetkovic, Doob and Sachs [90, 91], and Seidel [222]. In the past ten years, many developments in spectral graph theory h<J.ve often had a geometric flavor. For example, the explicit constructions of expander graphs, due to Lubotzky-PhiIlips-Sarnak [191] and Margulis [193], are based on eigenvalues and isoperimetric properties of graphs. The discrete analogue of the Cheeger in- equality has been heavily utilized in the study of random walks and rapidly mixing Markov chains [222]. New spectral techniques have emerged and they are powerful and well-suited for dealing with general graphs. In a way, spectral graph theory has entered a new era. Just as astronomers study stellar spectra to determine the make-up of distant stars, one of the main goals in graph theory is to deduce the principal properties and structure of a graph from its graph spectrum (or from a short list of easily computablp. invariants). The spectral approach for general graphs is a step in this direction. We will see that eigenvalues are closely related to almost all major invariants of a graph, linking one extremal property to another. There is no question that eigenvalues playa central role in our fundamental understanding of graphs. The study of graph eigenvalues realizes increasingly rich connections with many other areas of mathematics. A particularly important development is the interac- tion between spectral graph theory and differential geometry. There is an interest- ing analogy between spectral Riemannian geometry and spectral graph theory. The concepts and methods of spectral geometry bring useful tools and crucial insights to the study of graph eigenvalues, which in turn lead to new directions and results in spectral geometry. Algebraic spectral methods are also very useful, especially for extremal examples and constructions. In this book, we take a broad approach with emphasis on the geometric aspects of graph eigenvalues, while including the algebraic aspects as well. The reader is not required to have special background in geometry, since this book is almost entirely graph-theoretic. 
2 1. EIGENVALUES AND THE LAPLACIAN OF A GRAPH 1.2. THE LAPLACIAN AND EIGENVALUES From the start, spectral graph theory has had applications to chemistry [27]. Eigenvalues were associated with the stability of molecules. Also, graph spectra arise naturally in various problems of theoretical physics and quantum mechanics, for example, in minimizing energies of Hamiltonian systems. The recent progress on expander graphs and eigenvalues was initiated by problems in communication networks. The development of rapidly mixing Markov chains has intertwined with advances in randomized approximation algorithms. Applications of graph eigen- values occur in numprous areas and in different guises. However, the underlying mathematics of spectral graph theory through all its connections to the pure and applied, the continuous and discrete, can be viewed as a single unified subject. It is this aspect that we intend to cover in this book. . I: can be viewed as an operator on the space of functions 9 : V(G) -+ IR which satIsfies I:g(u) =  L ( g(U) _ g(V» ) .,fd;; v .,fd;; Vd;; uv When G is k-regular, it is easy to see that 1 I: = I - -A k ' where A .is the adjac.ency atri.x of G,( i. e., A(x, y) = 1 if x is adjacent to y, and o otherwIse,) and  IS n Identity matrix. All matrices here are n x n where n is the number of vertices In G. . 1.2. The Laplacian and eigenvalues For a general graph, we have I: T-I/2 LT-I/2 1- T- I / 2 AT-I/2. Before we start to define eigenvalues, some explanations are in order. The eigen- values we consider throughout this book are not exactly the same as those in Biggs [25] or Cvetkovic, Doob and Sachs [90]. Basically, the eigenvalues are defined here in a general and "normalized" form. Although this might look a little complicated at first, our eigenvalues relate well to other graph invariants for general graphs in a way that other definitions (such as the eigenvalues of adjacency matrices) often fail to do. The advantages of this definition are perhaps due to the fact that. it is consistent with the eigenvalues in spectral geometry and in stochastic processes. Many results which were only known for regular graphs can be generalized to all graphs. Consequently, this provides a coherent treatment for a general graph. For definitions and standard graph-theoretic terminology, the reader is referred to [31]. We note that I: can be written as I: = S S', whe:e S is the matrix whose rows are indexed by the vertices and whose columns :r Indexed by the edges of G. such that each column corresponding to an edge - {u, v} has an etry 1/.,fd;; In the row corresponding to u, an entry -1/ Vd;; in the. row crrespondlllg to. v, and has zero entries elsewhere. (As it turns out, the chOIce of sIgns can be arbItrary as long as one is positive and the other is negative) Also, S' denotes the transpose of S. . { dv L(u, v) = 1 if u = v, if u and v are adjacent, otherwise. .. For readers who are familiar with terminology in homology theory we remark that S can be viewed as a "boundary operator" mapping "I-chains',' defined on edges (denoted. by Cd of a graph to "O-chains" defined on vertices (denoted by Co). Then, S' IS the corresponding "coboundary operator" and we have S C I  Co S' In a graph G, let d v denote the degree of the vertex v. We first define the Laplacian for graphs without loops and multiple edges (the general weighted case with loops will be treated in Section 1.4). To begin, we consider the matrix L, defined as follows: £(u,v) { 1 1 - ..; dud v o if u = v and d v I- 0, if u and v are adjacent, otherwise. Since I: is symmetric, its eigenvalues are all real and non-ne g ative W use th . t . al h . . e can . e varIa IOn c aractenzations of those eigenvalues in terms of the Rayleigh quotIent of I: (see, e.g. [162]). Let 9 denote an arbitrary function which assigns to each vertex v of G a real value g(v). We can view 9 as a column vector. Then (g, £g) (g, g) (g, T-I/2 LT-I/2g) (g,g) (f, Lf) (TI/2 J, TI/2 f) L(J(u) - J(V))2 L J(v)2d v Let T denote the diagonal matrix with the (v, v)-th entry having value d v . The Laplacian of G is defined to be the matrix We can writ.e £ = T- I / 2 LT-I/2 with the convention T-I(v,v) = 0 for d v = 0, We say v is an isolated vertex if d v = O. A graph is said to be nontrivial if it contains at least one edge. (Ll) uv v 
I. EIGENVALUES AND THE LAPLACIAN OF A GRAPH 1.2. THE LAPLACIAN AND EIGENVALUES 5 where 9 = TI/2 I and L denotes the sum over all unordered pairs {u, v} for which ttrvV We note that (1.2) has several different formulations: u and v are adjacent. Here (f, g) = L I(x)g(x) denotes the standard inner product in JR.". The sum L(J(u) - l(v))2 is sometimes called the Dirichlet sum of G and (1.3) Al L(J(u) - l(v))2 inf sup uv NO t L(J(v) - t)2d v x uv the ratio on the left-hand side of (1.1) is often called the Rayleigh quotient. (We note that we can also use the inner pfoduct (f, g) = L I(x)g (x) fOf complex-valued functions. ) v (1.4) inf NO L(J(u) - I(v)? uv 2)/(v) - f?d v ' From equation (1.1), we see that all eigenvalues are non-negative. In fact, we can easily deduce from equation (1.1) that 0 is an eigenvalue of L. We denote the eigenvalues of L by 0 = Ao ::=; Al ::=; . . . ::=; A,,_I. The set of the Ai'S is usually called the spectrum of L (or the spectrum of the associated gfaph G.) Let 1 denote the constant function which assumes the value 1 on each vertex. Then TI/21 is an eigenfunction of L with eigenvalue O. Furthefmore, v where (1.2) AG = Al uv L(J(u) - I(V))2 L l(v)2d v L I(v)d v f = v vol G inf f l.Tl and vol G denotes the volume of the gfaph G, given by v vol G = Ld v . The corresponding eigenfunction is 9 = TI/2 I as in (1.1). It is sometimes convenient to consider the nontrivial function I achieving (1.2), in which case we call I a harmonic eigenfunction of L. N By substituting fOf f and using the fact that NL(ai - a)2 = L(ai _ aj)2 i=1 i<j The above formulation for AG corresponds in a natural way to the eigenvalues of the Laplace-Beltrami operator for Riemannian manifolds: N for a = Lad N, we have the following expression (which generalizes the one in i=l AM J IV 11 2 inf M J M lf12 [126]): (1.5 ) Al vol G L(J(u) - I(v)? inf uv f L(J(u) - l(v))2d u d v ' whefe 1 ranges over functions satisfying u,v J M 1 = O. whefe L denotes the sum over all unordered pairs of vertices u, v in G. We can u,v characte:ize the other eigenvalues of L in terms of the Rayleigh quotient. The lafgest eIgenvalue satisfies: We remark that the corresponding measure hefe for each edge is 1 although in the general case for weighted graphs the measure for an edge is associated with the edge weight (see Section 1.4.) The measure fOf each vertex is the degree of the veftex. A more genefal notion of vertex weights will be considefed in Section 2.5. (1.6) A,,_I L(J(u) - I(V))2 sup uv f L 12(v)d v v 
1. EIGENVALUES AND THE LAPLACIAN OF A GRAPH 1.3. BASIC FACTS ABOUT THE SPECTRUM OF A GRAPH For a general k, we have (i) : (1.7) Ak :2)f(u) - f(v»2 inf sup uv f gEPk-l :2)f(v) - g(v»2d v LAiS n with equality holding if and only if G has no isolated vertices. v (1.8) inf f l.TP k _ 1 uv L(J(u) - f(v»2 L f(v)2d v (ii): For n 2: 2, v AI< - n-1 with equality holding if and only if G is the complete graph on n vertices. Also, for a graph G without isolated vertices, we have An-I > . - n-1 (Hi): For a graph which is not a complete graph, we have AI S 1. (iv): If G is connected, then Al > O. If Ai = 0 and AHI -# 0 , then G has exactly i + 1 connected components. (v): For all i S n - 1, we have (1.9) where Pi is the subspace generated by the eigenfunctions 4>i corresponding to Ai, for i S k - 1. The differcnt formulations for eigenvalues given above are useful in different settings and they will be IIsed in later chapters. Here are some examples of special graphs and their eigenvalues. EXAMPLE 1.1. For the complete graph [(n on n vertices, the eigenvalues are o and n/(n - 1) (with multiplicity n - 1). EXAMPLE 1.2. For the complete bipartite graph [(Tn,n on m + n vertices, the eigenvalues are 0, 1 (with multiplicity m + n - 2), and 2. Ai S 2. EXAMPLE 1.3. For the star Sn on n vertices, the eigenvalues are 0,1 (with multiplicity n - 2), and 2. EXAMPLE 1.4. For the path Pn on n vertices, the eigenvalues are 1 - cos n"1 for k = 0,1"" ,n - 1. EXAMPLE 1.5. For the cycle C n on n vertices, the eigenvalues are 1 - cos 2k for k = 0,' . . ,n - 1. EXAMPLE 1.6. For the n-cube Qn on 2 n vertices, the eigenvalues are  (with multiplicity G) for k = 0,. .. , n. with An-I = 2 if and only if a connected component of G is bipartite and nontrivial. (vi): The spectrum of a graph is the union of the spectra of its connected com- ponents. PROOF. (i) follows from considering the trace of L. The inequalities in (ii) follow from (i) and Ao = O.  Suppose G contains two nonadjacent vertices a and b, and consider { db if v = a, fI(v) = -d a ifv=b, o if v -# a, b. (iii) then follows from (1.2). More examples can be found in Chapter 6 on explicit constructions. 1.3. Basic facts about the spectrum of a graph If G is connected, the eigenvalue 0 has multiplicity 1 since any harmonic eigen- function with eigenvalue 0 assumes the same value at each vertex. Thus, (iv) follows from the fact that the union of two disjoint graphs has as its spectrum the union of the spectra of the original graphs. (v) follows from equation (1.6) and the fact that (J(x) - f(y»2 S 2(J2(x) + f2(y». Roughly speaking, half of the main problems of spectral theory lie in deriving bounds on the distributions of eigenvalues. The other half concern the impact and consequences of the eigenvalue bounds as well as their applications. In this section, we start with a few basic facts about eigenvalues. Some simple upper bounds and lower bounds are stated. For example, we will see that the eigenvalues of any graph lie between 0 and 2. The problem of narrowing the range of the eigenvalues for special classes of graphs offers an open-ended challenge. Numerous questions can be asked either in terms of other graph invariants or under further assumptions imposed on the graphs. Some of these will be discussed in subsequent chapters. LEMMA 1.7. For a graph G on n vertices, we have Therefore Ai S L(J(x) - f(y»2 xy sup f L f2(x)d x S 2. x Equality holds for i = n - 1 when f(x) = -f(y) for every edge {x,y} in G. Therefore, since f -# 0, G has a bipartite connected component. On the other hand, 
1. EIGENVALUES AND TilE LAPLACIAN OF A GRAPH 1.3. BASIC FACTS ABOUT THE SPECTRUM OF A GRAPII 9 if G has a connected component which is bipartite, we can choose the function f so as to make An-I = 2. by using the Cauchy-Schwarz inequality. o (vi) follows from the definition. o LEMMA 1.10. Let f denote a harmonic ei g en f unction achievin g ' G (1 2 'j 'P h f Ain . j. .1, en, or any vertex x E V, we have For bipartite graphs, the following slightly stronger result holds: LEMMA 1.8. The following statements are equivalent: 1 d 2)f(x) - f(y» = AGf(x). x Y YX (i): G is bipartite. (ii): G has i + 1 connected components and An-j = 2 for 1 S j S i. (Hi): For each Ai, the value 2 - Ai is also an eigenvalue of G, PROOF. We use a variational argument. For a fixed Xo E V, we consider f, such that PROOF. It suffices to consider a connected graph. Suppose G is bipartite graph with vertex set consisting of two parts A and B. For any harmonic eigenfunction f with eigenvalue A, we consider the function g if x E A, if x E B. { f (xo) +  f,(y) = d xo € f(y) - I G - d vo Xo if y = xo, otherwise. { f(x) g(x) = _ f(x) We have It is easy to check that g is a harmonic eigenfunction with eigenvalue 2 - A. 0 L (f,(x) - f,(y»2 x,yEV xy For a connected graph, we can immediately improve the lower bound of Al in Lemma 1.7. For two vertices u and v, the distance between u and v is the number of edges in a shortest path joining u and v. The diameter of a graph is the maximum distance between any two vertices of G. Here we will give a simple eigenvalue lower bound in terms of the diameter of a graph. More discussion on the relationship between eigenvalues and diameter will be given in Chapter 3. LEMMA 1.9. For a connected graph G with diameter D, we have 1 Al 2: D vol G L f;(x)d x xEV L (f(x) - f(y»2 + L 2€(f(xo) - f(y» - L L 2€(J(y) - f(y'» X,YEV y d xo y' vol G - d xo xy y"'o Y -"x y -r- 0 y""'y' L f2(x)d x + 2€f(xo) - 2 L f(y)d y EV vol G d xo x  +O(€2) PROOF. Suppose f is a harmonic eigenfunction achieving Al in (1.2). Let Vo . denote a vertex with If(vo)1 = m;;x If(v)l. Since L f(v) = 0, there exists a vertex v !to satisfying f(uo)f(vo) < O. Let P denote a shortest path in G joining !to and vo, Then by (1.2) we have 2€ L (f(xo) - f(y» y L (f(x) - f(y»2 + yXo d xo + 2€ L (f(xo) - f(y» y Y""'Xo vol G - d xo x,YEV xy L r(x)d x + 2€f(xo) + 2€f(xo)d xo xEV vol G - d xo L (f(x) - f(y»2 Al xy L f2(x)d x +O(€2) x  L (f(x) - f(y»2 {x,y}EP vol G J2(vo) -b (f(vo) - f(UO»2 vol G J2(vo) 1 D vol G since L f(x)d x = 0, and L L(f(y) - f(y'» = O. The definition in (1.2) xEV y y' implies that  L (f,(x) - f,(y»2 x,YEV xy L f;(x)d x :rEV L (f(x) - f(y»2 x,YEV 2: xY L f2(x)d", xEV  
10 1. EIGENVALUES AND TilE LAPLACIAN OF A GRAPH 1.3. BASIC FACTS ABOUT THE SPECTRUM OF A GRAPH 11 If we consider what happens to the Rayleigh quotient for f, as € -t 0 from above, or from below, we can conclude that ..2.... L (f(xo) - fey)) = Aaf(xo). d xo y v.........xo and the Lemma is proved. o EXAMPLE 1.12. Consider the m-petal graph on n = 2m+ 1 vertices, Vo, VI,"', V2m with edges {VO,Vi} and {V2i-I,V2;}, for i 2: 1. This graph has eigenvalues 0,1/2 (with multiplicity m - 1), and 3/2 (with multiplicity m + 1). So we have max;;,;o 11 - Ail = 1/2. However, n-d H / m -1/2 1 (n - l)d H = V 2m -t V2 One can also prove the statement in Lemma 1.10 by recalling that f = T- 1 / 2 g, where £g = Aag. Then T- I Lf = T-I(TI/2 £TI/2)(T-I/2g) = T- I / 2 Aag = Aaf, and examining the entries gives the desired result. With a little linear algebra, we can improve the bounds on eigenvalues in terms of the degrees of the vertices. We consider the trace of (I - £)2. We have as m -t 00. (1.13) Still, for a general graph, we can use the fact that L(.!... - .!...)2 d x d y xy  1 1 2 L..- ( - - -) d x xEV d x d H SAn-I S 1 + A. Tr(I - £)2 L(l - Ai)2 Combining (1.10), (1.11) and (1.13), we obtain the following: LEMMA 1.13. For a graph G on n vertices, ); = maxi;"O 11 - Ail satisfies -2 n - k 1 + (n - l)A 2: d H (1 - (1 + A)( dH - 1)), where k denotes the average degree of G. (1.1 0) S 1+(n-1);2, where ); = max 11 - Ad. ;;';0 There are relatively easy ways to improve the upper bound for AI. From the characterization in the preceding section, we can choose any function f : V(G) -t IR, and its Rayleigh quotient will serve as an upper bound for AI. Here we describe an upper bound for Al (see [202]). LEMMA 1.14. Let G be a graph with diameter D 2: 4, and let k denote the maxi7hum degree of G. Then On the other hand, (1.11) Tr(I - £)2 Tr(T- I / 2 AT-I AT-I/2) 111 L y'(4 A(x, y) d y A(y, x) y'(4 x,y 1  1 1 2 L d - L..-(d - d) , x x X""-'Y x y where A is the adjacency matrix. From this, we immediately deduce LEMMA 1.11. For a k-regular graph G on n vertices, we have (1.12) ;"agcI1- Ail 2: V (:  lk Vk=l ( 2 ) 2 A l < 1 - 2- 1 - - +_. - k D D . One way to bound eigenvalues from above is to consider "contracting" the graph G into a weighted graph H (which will be defined in the next section). Then the eigenvalues of G can be upper-bounded by the eigenvalues of H or by various upper bounds on them, which might be easier to obtain. We remark that the proof of Lemma 1.14 proceeds by basically contracting the graph into a weighted path. We will prove Lemma 1.14 in the next section. This follows from the fact that max 11 - Ail 2 2: (tr(I - £)2 - 1). i;"O n - 1 We note that Lemma 1.14 gives a proof (see [5]) that for any fixed k and for any infinite family of regular graphs with degree k, Vk=l limsupAI S 1- 2---,::-. This bound is the best possible since it is sharp for the Ramanujan graphs (which will be discussed in Chapter 6). We note that the cleaner version of Al S 1 _ 2/k is not true for certain graphs (e.g., 4-cycles or complete bipartite graphs). This example also illustrates that the assumption in Lemma 1.14 concerning D 2: 4 is essential. Let dH denote the harmonic mean of the dv's, i.e., 1 1 1 d H = ;;: L d v ' v It is tempting to consider generalizing (1.12) with k replced by d H : This, however, is not true as shown by the following example due to Elizabeth Wilmer. 
12 1. EIGENVALUES AND THE LAPLACIAN OF A GRAPH 1.4. EIGENVALUES OF WEIGHTED GRAPHS 13 1.4. Eigenvalues of weighted graphs We can stilI use the same characterizations for the eigenvalues of the generalized versions of £. For example, Before defining weighted graphs, we will say a few words about two different approaches for giving definitions. We could have started from the very beginning with weighted graphs, froIll which simple graphs arise as a special case in which the weights are 0 or 1. However, the unique characteristics and special strength of graph theory is its ability to deal with the {O, 1 }-problems arising in many natural situations. The clean formulation of a simple graph has conceptual advantages. Furthermore, as we shall see, all definitions and subsequent theorems for simple graphs can usually be easily carried out for weighted graphs. A weighted undirected graph G (possibly with loops) has associated with it a weight function w : V x V -+ IR satisfying (1.14) AG := Al inf g1.7'1/21 (g, £g) (i:g) L f(x)Lf(x) xEV inf 2: !(!,dz=O L f2(x)d x xEV w(u,v) = w(v,u) inf ! 2: !(x)dz=O L(J(x) - f(y))2W(x,y) xy L f2(x)d x xEV and w(u, v) 2: O. We note that if {u,v} f. E(G) , t.hen W(II,V) = O. Unweighted graphs are just the special case where all the weights are 0 or 1. In the present context, the degree d v of a vertex v is defined to be: A contraction of a graph G is formed by identifying two distinct vertices, say u and v, into a single vertex v'. The weights of edges incident to v' are defined as follows: d v = LW(u,v), u W(x, v') w(v', v') W(x, u) + w(x, v), w(u, u) + w(v, v) + 2w(u, v). vol G = L d v . LEMMA 1.15, If H is formed by contractions from a graph G, then v AG S AIf We generalize the definitions of previous sections, so that { dv - w(v,v) L(u,v) = w(1L,v) if 1L = v, if u and v are adjacent, otherwise. The proof follows from the fact that an eigenfunction which achieves AIf for H can be lifted to a function defined on V(G) such that all vertices in G that contract to the same vertex in H share the same value. Now we return to Lemma 1.14. In particular, for a function f : V -+ IR, we have . Let T denote the diagonal matrix with the (v,v)-th entry having value d v . Laplacian of G is defined to be £ = T- 1 / 2 LT- I / 2 . The SKETCHED PROOF OF LEMMA 1.14: Let u and v denote two vertices that are at distance D 2: 2t + 2 in G. We contract G into a path H with 2t + 2 edges, with vertices Xo, XI,. . . Xt, Z, Yt, . ., ,Y2, YI, Yo such that vertices at distance i froIll u, 0 S is t, are contracted to Xi, and vertices at distance j from v, 0 S j S t, are contracted to Yj. The remaining vertices are contracted to z. To establish an upper bound for AI, it is enough to choose a suitable function f, defined as follows: Lf(x) = L(J(x) - f(y))w(x,y). y xy { w(v, v) 1 - --y- £(u, v) = 0 w(u, v) - Vdud v if u = v, and d v I- 0, f(x;) f(Yj) f(z) a(k _1)-i/2, b(k - 1)-j/2, 0, In other words, we have if u and v are adjacent, where the constants a and b are chosen so that otherwise. L f(x)d x = O. x 
14 1. EIGENVALUES AND TilE LAPLACIAN OF A GRAPII 1.5. EIGENVALUES AND RANDOM WALKS 15 It. can be checke'd that the Rayleigh quotient RatiRfies 2:)/(1.1) - I(V))2 W (U,V) uv 2Vk=l ( 1 ) 1 <1- 1-- +- L I(V)2d v - k t + 1 t + l' (ii) implieR A"--1 < 2, AR we will Ree later in (1.15), together (i) and (ii) deduce' ergodicity. v We remind the reader that an unweighted graph has w(u, v) equal to either 0 or 1. The uual random walk on an unweighted graph has transition probability l/d v of movmg from a vertex v to anyone of its neighbors. The transition matrix P then satisfies since the ratio is maximized when W(Xi' xHd = k(k - l)i-1 = W(Yi, YHd. This completes the proof of the lemma. 0 P(u,v) = { /du if 1.1 and v are adjacent, otherwise. 1.5. Eigenvalues and random walks In other words, In a graph G, a walk is just a sequence of vertices (vo, VI," . ,v s ) with {Vi-I, v;} E E(G) for all 1 ::; i ::; s. A random walk is determined by the transition probabilities P(u, v) = Prob(xi+1 = VIXi = 1.1), which are independent of i. Clearly, for each vertex 1.1, 1 IP(v) = L d 1(1.1) u u uv for any I : V(G) -t IR. v It. is easy to check that P = T- I A = T- I / 2 (l - .c.)T I / 2 , where A is the adjacency matrix. LP(u,v) = 1. For any initial distribution I : V -t IR with L I(v) = 1, the distribution after k v steps is just I pk (i.e., a matrix multiplication with I viewed as a row vector where P is the matrix of transition probabilities). The random walk is said to be ergodic if there is a unique stationary distribution 7r( v) satisfying lim IPS (v) = 7r(v). s-too In a random walk with an associated weighted connected graph G, the transi- tion matrix P satisfies It is easy to see that necessary conditions for the ergodicity of P are (i) Irre- ducibility, i,e., for any 1.1, v E V, there exists some s such that PS(u, v) > 0 (ii) aperiodicity, i,e., g.c.d. {s: PS(u,v) > O} = 1. As it turns out, these are also sufficient conditions. A major problem of interest is to determine the number of steps s required for p s to be close to its stationary distribution, given an arbitrary initial distribution. ITP = IT where 1 is the vector with all coordinates 1. Therefore the stationary distribution is exactly 7r = IT/vol G, We want to show that when k is large enough, for any initial distribution I : V -t IR, I pk converges to the stationary distribution. First we consider convergence in the L 2 (or Euclidean) norm. Suppose we write IT- I / 2 = L ai4>i, i 7r(u)P(u, v) = 7r(v)P(v, 1.1). where 4>i denotes the orthonormal eigenfunction associated with Ai. Recall that 4>0 = IT 1 / 2 / v'vol G and 11.11 denotes the L 2 -norm, so (fT- I /2,IT I / 2 ) 1 ao = IIITI/211 = v'vol G since (f, 1) = 1. We then have We say a random walk is reversible if An alternative description for a reversible random walk can be given by considering a weighted connected graph with edge weights satisfying w(u,v) = w(v,u) = 7r(v)P(v,u)/c where c can be any constant chosen for the purpose of simplifying the values. (For example, we can take c to be the average of 7r(v)P(v,u) over all (v,u) with P(v, u) -# 0, so that the values for w(v,u) are either 0 or 1 for a simple graph.) The random walk on a weighted graph has as its transition probabilities P( ) = w(u,v) u,v d u ' where d u = 2::z w(u, z) is the (weighted) degree of u. The two conditions for ergodicity are equivalent to the conditions that the graph be (i) connected and (ii) non-bipartite, From Lemma 1.7, we see that (i) is equivalent to AI > 0 and III p s - 7r1l ::; IIIP S - IT/vol GII III p s - ao4>oTI/211 IIIT- I / 2 (l - .c.)'T I / 2 - ao4>oTI/211 II L(1- Ai)Sai4> i T I / 2 11 i;l'o (1 _ A')S max x ..;rr: miny,jd; -SA' max x ..;rr: e miny Vd; (1.15) ::; 
16 1. EIGENVALUES AND TilE LAPLACIAN OF A GRAPII where 1.5, EIGENVALUES AND RANDOM WALKS 17 A' = { Al 2 - An-I if 1 - Al 2: An-I - 1 otherwise. We remark that for many applications in sampling, the convergence in L 2 distance seems to be too weak since it does not require convergence at each vertex. Thcre are several stronger notions of distance several of which we will mention. So, after s 2: 1/ A'log(max:r v'd'ioniny Jd;;) steps, the L 2 distance between f p S and its stationary distribution is at most t. A strong notion of convergence that is often used is measured by the relative pointwise distance (see [222]): After s steps, the relative pointwise distance (r.p.d.) of P to the stationary distribution 7r(x) is given by tl( ) IPS(y, x) - 7r(x)1 s = nx 7r(x) . Let 1/Jx denote the characteristic function of x defined by: Although A' occurs in the abovc upper bound for the distance between the stationary distribution and the s-step distribution, in fact, only Al is crucial in the following sense. Note that A' is eithcr Al or 2 - An-I' Suppose thc latter holds, i.e., An-I - 1 2: 1 - AI. We can consider a modified random walk, called the lazy walk, on the graph G ' formed by adding a loop of weight d v to each vertex v. The new graph has Laplacian eigenvalues k = Ak/2 S 1, which follows from equation (1.14). Therefore, 1 - I 2: 1 - n-I 2: 0, and the convergence bound in L 2 distance in (1.15) for the modificd random walk becomes Suppose maxxv'd; 2/A I log( . VJ;; )' t milly d y 1/Jx (y) = {  ify = x, otherwise. ./ T I/2 -  v'J x - L..-t Qi <Pi, 1/J y T- I / 2 = LfJi4>i' i In general, suppose a weighted graph with edge weights w(u, v) has eigenvalues Ai with An-I - 12: 1 - AI. We can then modify the weights by choosing, for some constant c, where 4>i'S denote the eigenfunction of the Laplacian .c of the weighted graph asso- ciated with the random walk, In particular, d x ao=- vvol G ' Let A* denote the transpose of A. We have l1/Jy pt 1/J; - 7r(x)1 max X.y 7r(x) max /1/Jy T-I/2 (I - .c)t Tl/21/J; - 7r(x)1 x,y 7r(x) .L 1(1 - A;)taifJ;j ii OO max x,y dx/vol G Lla;/'3 i l 5. t max i;l'O x,y dx/vol G 5. t max l11/Jx TI / 2 11111/J y T-I/211 x,y dx/vol G 5. t vol G minx,y Vdxdy -t(I-)') vol G e - minx d x (1.16) ' ( ) { W(v,V)+Cdv w u,v = w(u,v) if u = v otherwise. The resulting weighted graph has eigenvalues A'-- k- 1 + c - 2Ak An-l + Ak tl(t) where Al + An-l _ 1 <  . c= 2 -2 Then we have A I -A I 1 - A' - A' - 1 - n- I - n-I - An-I + Al . Since c S 1/2 and we have A 2: 2Ak/(2 + Ak) 2: 2Ak/3. In particular we set A = A = 2AI An-I + Al Therefore the modified random walk corresponding to the weight function w' has an improved bound for the convergence rate in L 2 distance: 1 max x v'd; -log . A t miny VJ;; 1 fJo = -. vvolG s s s s 
18 1. EIGENVALUES AND TilE LAPLACIAN OF A GRAPH 1.5. EIGENVALUES AND RANDOM WALKS 19 When 1 - Al I- .\, we can improve the above bound by using a lazy walk as described in (1.16). The proof is almost identical to the above calculation except for using the Laplacian of the modified weighted graph associated with the lazy walk. This can be summarized by the following theorem: of distance, sometimes called x-squared distance, denoted by tl'(s) and defined by: tl'(s) max ( L (P"(y,x) - 7r(X))2 ) 1/2 YEV(G) 7r(X) XEV(G) 2: yv(in L I r(y,x) - 7r(X) I xEV(G) 2Ll rv (s), uing he Cauchy-Schwarz inequality. Ll'(s) is also dominated by the relative point- wise distance (which we will mainly use in this book). where .\ = maxi#O 11 - Ail. So if we choose t such that 1 vol G t >  log , - 1 - A (' minx d x then, after t steps, we have tl(t) S ('. THEOREM 1.16. For a weighted graph G, we can choose a modified random walk P so that the relative pairwise distance tl(t) is bounded above by: tl(t) S e-!), v.ol G S exp-2t),I/(2+),J) ol G . mm x d x minx d x s ( ) 1/2 max L (P"(x, y) - 7r(y))2 xEV(G) 7r(Y) YEV(G) max (  (tl(S))2. 7r(Y)) XEV(G) L.t YEV(G) tl( s). tl' (s) where A = AI if 2 2: An-I + Al and A = 2AI/(A n -1 + Ad otherwise. s We remark that for any initial distribution f : V --+ IR with (1,1) f(x) 2: 0, we have, for any x, 1 and We note that If P"(x) - 7r(x)1 7r(x) s L f(y) I P"(y, x) - 7r(x) I 7r(x) Y L f(y)tl(s) tl'(S)2 2: L 7r(x) L (P"(x, y) - 7r(y))2 x Y 7r(Y) L 1jJxTI/2(p" - 10)T-I(P" - 10)T I / 2 1jJ; < x Y L 1jJx{{1 - £)2" - 1 0 )1/;;, < tl(s). x Another notion of distance for measuring convergence is the so-called total variation distance, which is just half of the LI distance: where 10 denotes the projection onto the eigenfunction 4>0, 4>i denotes the i-th othonormal eigenfunction of £ and 1jJx denotes the characteristic function of x. Slllce Illax max I L(P"(y,x) -7r(x)) I AcV(G) yEV(G) TEA 1 - max  I P"(y, x) - 7r(X) I . 2 YEV(G) L.t XEV(G) The total variation distance is bounded above by the relative pointwise distance, since tlrv(s) 1jJx = L 4>i(X)4>i, we have (1.17) tl / (S)2 2: L 1jJx((I - £)2" - 10)1jJ; x tlTlr (s) max max I L(P"(y,x) -7r(x)) I ACV(G) YEV(G) volA$ xEA max L 7r(x)tl(s) ACV(G) volA vOJG xEA L(L 4>i(X)4>i)((I - £)2" - 10)(L 4>i(X)4>;)* x i L L 4>l(x)(l - A;)28 x i#O s L L 4>(x)(l - A;)2" i#O x s 1 -Ll(s). 2 L(l - A;)28. i;o'O Equality i (1.17) hlds if, for example, G is vertex-transitive, i.e., there is an automorphism mapplllg u to v for any two vertices in G, (for more discussions, see Chapter 7 on symmetrical graphs). Therefore, we conclude Therefore, any convergence bound using relative pointwise distance implies the same convergcnce bound using total variation distance. There is yet another notion 
20 I. EIGENVALUES AND TilE LAPLACIAN OF A GRAPH 1.5. EIGENVALUES AND RANDOM WALKS 21 THEOREM 1.17. Suppose G is a vertex transitive graph. Then a random walk after s steps converges to the uniform distribution under total variation distance or x-squared distance in a number of steps bounded by te sum of (1 - Ai)2., where Ai ranges over the non-trivial eigenvalues of the Laplacwn: Therefore, IP8(X, Y) - 7r(y)1 7r(Y) < 12nvJx p81jJy - 11 12 n 1jJx p81jJ'5< - 11 2.:(1- 2151(n - 1) )8 n(n + 1) S#0 t ( n ) (l_ 2k(n -1) ' k=1 k n(n+1) ( 1.18) 1, 1 ,, ( \ ) 2' ) 1/2 Llrv(s) :<s: 2 Ll (s) = 2(L.. 1 - Ai . i#O The above theorem is often derived from the Plancherel formula. Here we have employed a direct proof. We remark that for some grphs which ae not etex- transitive a somewhat weaker version of (1.18) can stilI be used with additIOnal work (see'[81] and the remarks in Section 4.6). Here we will use Theorem 1.17 to consider random walks on an n-cube. This implies Ll(s) t ( n ) (l_ 2k(n -1) )8 k=1 k n(n + 1) EXAMPLE 1.18. .For the n-cube Qn, our (lazy) random walk (as defined in (1.16)) converges to the uniform distribution under the total variation distance, as estimated as follows: From Example (1.6), the eigenvalues of the Q" are 2k/n of multiplicity G) for k = 0,'" ,n. The adjusted eigenvalues for the weighted graph corresponding to the lazy walk are Ak = Ak(A,,_1 - Ad/(A,,-I + Ad = Adn - l)/(n + 1). By using Theorem 1.17 (also see [104]), we have n "kl _ 2'.(n-l) e ogn n+l k=1 :<s: e- C if nlogn S> -+cn. - 2 :<s: ( ( n ) (1 _ 2k(n - 1) )2")1/2 2 L.. k n(n+1) k=1 1 n 4k;(n-:) '2 (2: e k log n- n n+l )1/2 k=1 e- c So, the rate of convergence under relative pointwise distance is about twice that under the total variation distance for Qn. LlTV(s) :<s: Ll'(s) :<s: :<s: In general, LlTV(S), Ll'(s) and Ll(s) can be quite different [81]. Nevertheless, a convergence lower bound for any of these notions of distance (and the L 2 -norm) is A -1. This we will leave as an exercise. We remark that Aldous [4] has shown that if Ll TV S E, then IP8(y,X) - 7r(x)1 2 C,7r(x) for all vertices x, where c, depends only on Eo if s ?: tnlogn + ('11.. We can also compute the rate of convergence of the lazy walk under the rela- . tive pointwise distance. Suppose we denote vertices of Q" by subsets of an n-set {1, 2, . . ' ,n}. The orthonormal eigenfunctions are rps for S C {1, 2, . .. ,n} where Notes (_1)lsnx 1 rps(X) = 2n/2 For an induced subgraph of a graph, we can define the Laplacian with boundary conditions. We will leave the definitions for eigenvalues with Neumann boundary conditions and Dirichlet boundary conditions for Chapter 9. f X C {1 2 } For a vertex indexed b y the subset 5, the characteristic or any , ,"', n . function is dcnoted by The Laplacian for a directed graph is also very interesting. The Laplacian for a hypergraph has very rich structures. However, in this book we mainly focus on the Laplacian of a graph since the theory on these generalizations and extensions is still being developed. VJs(X) = {  if X =5, otherwise. In some cases, the factor log ':01 G d in the upper bound for Ll ( t ) can be further mlna: :II reduced. Recently, P. Diaconis and L. Saloff-Coste [100] introduced a discrete ver- sion of the logarithmic Sobolev inequalities which can reduce this factor further for certain graphs (for Ll'(t)). In Chapter 12, we will discuss some advanced techniques for further bounding the convergence rate under the relative pointwise distance. Clearly, (_1)lsnx 1 VJx = 2.: 2n/2 rps. s 
CHAPTER 2 Isoperimetric problems 2.1. History One of the earliest problems in geometry was the isoperimetric problem, which was considered by the ancient Greeks. The problem is to find, among all closed curves of a given lengt.h, the one which encloses the maximum area. The basic isoperimetric problem for graphs is essentially the same. Namely, remove as little of the graph as possible to separate out a subset of vertices of some desired "size". Here the size of a subset of vertices may mean the number of vertices, the number of edges, or some other appropriate measure defined on graphs. A typical case is to remove as few edges as possible to disconnect the graph into two parts of almost equal size. Such problems are usually called sepamtor problems and are particularly useful in a number of areas including recursive algorithms, network design, and parallel architectures for computers, for example [178]. In a graph, a subset of edges which disconnects the graph is called a cut. Cuts arise naturally in the study of connectivity of graphs where the sizes of the disconnected parts are not of concern. Isoperimetric problems examine optimal relations between the size of the cut and the sizes of the separated parts. Many different names are used for various versions of isoperimetric problems (such as the conductance of a graph, the isoperimetric number, etc.) The concepts are all quite similar, but the differences are due to the varying definitions of cuts and sizes. We distinguish two types of cuts. A vertex-cut is a subset of vertices whose removal disconnects the graph. Similarly, an edge-cut is a subset of edges whose removal separates the graph. The size of a subset of vertices depends on either the number of vertices or the number of edges. Therefore, there are several combina- tions. Roughly speaking, isoperimetric problems involving edge-cuts correspond in a natural way to Cheeger constants in spectral geometry. The formulation and the proof techniques are very similar. Cheeger const.ants were studied in t.he thesis of Cheeger [48], but they can be traced back to Polya and Szeg6 [211]. We will follow tradition and call the discret.e versions by the same names, such as the Cheeger constant and the Cheeger inequalities. 
24 2. ISOPEHIMETHIC PROBLEMS 2.3. THE EDGE EXPANSION OF A GRAPH 25 2.2. The Cheeger constant of a graph expansion" (instead of "edge expansion"). For a subset S  V, we define Before we discuss isoperimetric problems for graphs, let us first consider a measure on subsets of vertices. The typical measure just assigns weight 1 to each vertex, so the measure of a subset is its number of vertices. However, this implies that all vertices have the same measure. For some problems, this is appropriate only for regular graphs and does not work for general graphs. The measure we will use here takes into consideration the degree at a vertex. For a subset S of the vertices of G, we define vol S, the volume of S, to be the sum of the degrees of the vertices in S: (2.3) gG(S) = vol 6(5) min(vol S, vol S) and (2.4) gG = mingG(S), S For regular graphs, we have vol S = L d x , xES 5 _ 1<5(S)1 gG( ) - min(ISI, ISI) ' for S  V(G). Next, we define the edge boundary as of S to consist of ail edges with exactly one endpoint in S: We define for a graph G (not necessarily regular) 8S = {{u,v} E E(G) : u E S and v rt S} Let 5 denote the complement of S, i.e., 5 = V - S. Clearly, 8S = 85 = E(S,5) where E(A, B) denotes the set of edges with one endpoint in A and one endpoint in B. Similarly, we can define the vertex boundary <5S of S to be the set of all vertices v not in S but adjacent to some vertex in S, i.e., - ( S ) _ 1<5(S)1 gG - min(ISI, ISI) and 9G = min9G(S). S <5S = {v rt S: {1L,v} E E(G),1L E S}. We remark that .9 is the corresponding Cheeger constant when the measure for each vertex is taken to be 1. More general measures will be considered later in Section 2.5. We note that both gG and 9G are concerned with the vertex expansion of a graph and are useful for many problems. We are ready to pose the following questions: Problem 1: For a fixed number m, find a subset S with m S vol S S vol 5 such that the edge boundary 8S contains as few edges as possible. Pmblem 2: For a fixed number m, find a subset S with m S vol S S vol 5 such that the vertex boundary <5S contains as few vertices as possible. 2.3. The edge expansion of a graph hG(S) = IE(S,5)1 min(voIS, volS) The Cheeger constant hG of a graph G is defined to be In this section, we focus on the fundamental relations between eigenvalues and the Cheeger constants. We first derive a simple upper bound for the eigenvalue A in terms of the Cheeger constant of a connected graph. 1 LEMMA 2.1. Cheeger constants are meant to answer exactly the questions above. For a subset S c V, we define (2.1) 2h G 2: AI. (2.2) hG = min hG(S), S PROOF. We choose f based on an optimum edge cut C which achieves hand separates the graph G into two parts, A and B: G In some sense, the problem of determining the Cheeger constant is equivalent to solving Problem 1, since 18S1 2: hG vol (S). flv)  { 1 II vol A if v is in A, 1 vol B if v is in B. We remark that G is connected if and only if hG > O. We will only consider connected graphs. In a similar manner, we define the analogue of (2.1) for "vertex 
26 2. ISOPERIMETIJIC PROBLEMS 2.3. THE EDGE EXPANSION OF A GRAPH 27 By substituting 1 into (1.2), we have the following: We now have s ICI(l/vol A + l/vol B) 21CI min(vol A, vol B) 2ha. Al == L I(v) L (f(v) - I(u)) vEV+ {u,v}EE+ L 12(v)d v vEV+ Al s > L (g(u) - g(v))2 {U,V}EE+ L l(v)d v vEV o Now, we will proceed to give a relatively short proof of an inequality in the opposite direction, so that we will have altogether h 2 2ha  Al >  . L (g(u) - g(V))2 {u,V}EE+ L (g(u) + g(V))2 {u,V}EE+ THEOREM 2.2. For a connected graph G, L g2(v)d v L (g(u) + g(V))2 vEV {u,V}EE+ (2: Ig2(u) - g2(v)l)2 uv 2(2: g2(v)d v )2 This is the so-called Cheeger inequality which often provides an effective way for bounding the eigenvalues of the graph.  v h 2 Al > ...Q. 2  (L Ig2(Vi) - g2(vi+dIIC i I)2 i 2(Lg 2 (v)d v )2 v PROOF. We consider the harmonic eigenfunction 1 of L with eigenvalue AI. We order vertices of G according to I. That is, relabel the vertices so that f(Vi) S I(Vi+d, for 1 S is n - 1. Without loss of generality, we may assume  (L(g2(Vi) - g2(vi+d)a Ld j )2 j$i 2(2: l(v)d v )2 v 2:dvLdu I(v)<o l(u)O  a 2 For each i, 1 S i S lVI, we consider the cut  2 h 2 ...Q 2 C i == { {vj,vd E E(G) : 1 S j S i < k S n}. This completes the proof of Theorem 2.2. o We define a by . ICil a == mill . I$i$n min(L d j,2: d j) j$i j>i We will state an improved version of Theorem 2.2 which however has a slightly more complicated proof. It is clear that a  ha. We consider the set V+ of vertices v satisfying I( v)  0 and the set E+ of edges {u, v} in G with either u or v in V+. We define THEOREM 2.3. For any connected graph G, we always have g(x) = { (x) if 11 E V+ otherwise. ;. Al > 1 - V1 - h . 
28 2. ISOI'EIUMETIUC I'n.oBLI,MS 2.1. TIlE VERTEX EXPANSION OF A GRAPH 29 PROOF. From the proof of Theorem 2.2, we have and >'1 L f(v) L(I(V) - f(u)) vEV+ uv L f2(V)d v vEV+ a = min v min( ICvl L d u , L d u ) u f(u)$f(v) u f(u»f(v) L (g(u) - g(V))2 Then, L g2(v)d v vEV w. >'1 > 1 - . > {u,v}EE+ Also, we have One immediate consequence is an improvement on the range of A,. For any connected (simple) graph G, we have W L (g(u) - g(v))2). ( L (g(u) + g(v))2) {u,v}EE+ {u,V}EE+ (L g2(v)d v ) . ( L (g(u) + g(V))2) VEV {u,v}EE+ 2 ha > -. - vol G Using Cheeger's inequality, we have 2: (L Ig2(u) - g2(v)l)2 uv (2::l(v)d v )' (2 2::l(v)d v - W 2:: g2(v)d v ) v 1 2 2 2 A, > 2'( vol G ) 2: n 4 ' This lower bound is somewhat weaker than that in Lemma 1.9. v v 2: (L Ig 2 (v;) - g2(vi+dIIC i I)2 (2 - W)(2:: l(V))2d v 2.4. The vertex expansion of a graph v v The proofs of upper and lower bounds for the modified Cheeger constant ga associated with vertex expansion are more complicated than those for edge expan- sion. This is perhaps due to the fact that the definition of ha is in a way more natural and better scaled. Nevertheless, vertex expansion comes up often in many settings and it is certainly interesting in its own right. > (2::(g2(Vi) -l(vi+' ))a 2:: d j )2 j<O;i (2 - W)(2::g 2 (V))2d v 2: a 2 Since ga 2: h a , we have 2-W This implies that 2g a 2: A,. W 2 - 2W + a 2  O. A, > W 2: 1 -  > 1 - V 1 - h . For a general graph G, the eigenvalue A, can sometimes be much smaller than gb/2. One such example is given by joining two complete subgraphs by a matching. Suppose n is the total number of vertices. The eigenvalue A, is no more than 8/n2, but ga is large. Therefore we have o StilI, it is desirable to have a lower bound for A, in terms of ga. Here we give a proof which is adapted from the argument given by Alon [5]. We give a self-contained statement which has already been established in the above proof: COROLLARY 2.4. In a graph G with eigenfunction f associated with A" we definc, for each v, C v = { {u,u'} E E(G) : f(u)  f(v) < f(u')} THEOREM 2.5. FOT a connected graph G, g2 A, > 4d + dgb ' where d denotes the maximum degree of G. 
30 2. ISOPERIMETRIC PROBLEMS 2.4. TilE VERTEX EXPANSION OF A GRAPH 31 PROOF. We follow the definition in the proof of Theorem 2.2. We have Then, L L(J(V) - f(u))f(v) L F2(U,V)(f+(U) + f+(V))2 {U,V}EE :S 2 L F 2 (u,v)(JJ,(u) + fJ,(v)) {u,V}EE 2 L fJ,(v)( L F 2 (u, v) v u {u,V}EE + L F 2 (v, u)) { u,vv}EE Al vE v+ uv L d v f2(V) vEV+ L (f(v) - f(U))2 + L f(v)(J(v) - f(u)) uv u,vEV+ u.......v,vEV+ utlv+ L d v f2(V) vEV+ :S 2(1 + (1 + gb)) L fJ,(u)d u L(g(u) - g(v))2 :S 2d(2 + gb) L fJ,(u)d u . > uv u Lg 2 (v)d v Also, v Now we use the max-flow min-cut theorem [127] as follows. Consider the network with vertex set {s, t} U X U Y where s is the source, t is the sink, X = V+ and Y is a copy of V(G). The directed edges and their capacities are given as follows: L F(u,v)(J;(u) - Ji(v)) {u,V}EE LJi(u)( L F(u,v)- L F(v, u)) U {U,Vv}EE 2: gaLf;(v)d v . {u,vV}EE v . For every u in X, the directed edge (s, u) has capacity (1 + ga )d u . . For every u E X,V E Y, there is a directed edge (u,v) with capacity d v if {u, v} E E or u is labelled by the same vertex as v in G. . For every v E Y, the directed edge (v, t) has large capacity, say, vol G. Combining the above facts, we have Al 2: L (f+(u) - f+(v))2 {U,V}EE LfJ,(v)d v To check that this network has its min-cut of size (1 + ga ) vol V+, let C denote a cut separating sand t. Clearly C only contains edges from s and edges from X to Y. Let XI = {x EX: {s,x} rt C}. Then C separates XI from Y. Therefore the total capacity of the cut C is at least the sum of capacities of the edges {s, x}, s'E X - XI, and the edges (u,v), u E XI and v E XI UDX I . Since vol (XI UDXd 2: (1 + ga )vol X I, the total capacity of the cut is at least v L (f+(u) - f+(V))2 L F 2 (u,v)(f+(u) + f+(V))2 {u,V}EE {u,V}EE L fJ,(v)d v L F2(U, v)(f+(u) + f+(V))2 v {u,V}EE (1 + ga)vol(V+ - Xd + (1 + ga)vol XI = (1 + ga)vol V+. 2: L I F(u,v)UJ,(u) - /J.(v)) 1)2 {u,V}EE L fJ,(v)d v 2d(2 + gb) Lf;(v)d v v v Since there is a cut of size (1 + ga )vol V+, we have proved that the min-cut is of size equal to (1 + ga )vol V+. By the max-flow min-cut theorem, there exists a flow function F(u, v) for all directed edges in the network so that F(u, v) is bounded above by the capacity of (u, v) and for each fixed x E X and y E Y, we have 2: 1 4d + 2dgb ( ( L F(u,v)(fJ,(u) - fJ,(V)) ) 2 {u,V}EE Lf(v)dv v LF(x,v) (l+ga)d x , 2: gb 4d + 2dgt; , v LF(v,y) S d y . v as desired. o 
32 2. ISOPERIMETRIC PROBLEMS 2.5. A CHARACTERIZATION OF THE CHEEGER CONSTANT 33 2.5. A characterization of the Cheeger constant Then we have In this section, we consider a characterization of the Cheeger constant which has similar form to the Rayleigh quotient but with a different norm. L I/(x) - l(y)1 l: g(a)da 1° da g(a) L d x + 1 00 da -00 L d x g(X)<<7 ° g(X)<<7 g(a) ""' d '" d  x  x g(X»<7 g(X»<7 xy THEOREM 2.6. The Cheeger constant h G of a graph G satisfies (2.5) L If(x) - l(y)1 hG = inf sup xy f cER L I/(x) - cld x xEV h G ( lOoo da L d x + 1 00 da L dx ) g(X)</T g(X»/T hG L I/(x) - cld x . xEV In the opposite direction, suppose X is a subset of V satisfying h _ IE(X,X)I G - vol X . We consider a character function tj; defined by: > where I ranges over all function. I : V ---+ IR which are not identically zero. In language analogous to the continuous case, (2.5) can be thought of as . JI'l/I h G = mf sup J . f cER if - cl tj;(x) = { 1 if x E X otherwise. Then we have, L d x  L d x L Itj;(x) - tj;(y)1 sup xy c L Itj;(x) - Cld x xEV 2I E (X,X)1 sup c (1 - C)volX +'(1 + C)volX PROOF. We choose c such that x f(x)<c f(x'">?c 2IE(X, X)I 2volX h G . and L d x > L d x . Therefore, we have x f(x)5c x f(x»c L I/(x) - l(y)1 h G > inf sup xy - NO cER L I/(x)ld x xEV If g = f - c, then for a < 0, we have LdxLdx and Theorem 2.6 is proved. o X g(X)</T X g(X)/T x g(X)<<7 X g(X»/T W will prove a variation of Theorem 2.6 which is not sharp but seems to be easier to use. Later on it will be used to derive an isoperimetric relationship between graphs and their cartesian products. COROLLARY 2.7. For a graph G, we have and for a > 0, we have L d x 2 L d x . y(a) = IHx,y} E E(G): g(x)  a < g(y)}l. L II (x) - I(y)l hG 2 inf xy > ! h NO L I/(x)ld x - 2 G xEV We consider 
34 2. ISOPEfUMETRIC PROBLEMS 2.6. ISOPERIMETRiC INEQUALITIES FOR CARTESIAN PRODUCTS 35 w!le7'e f : V (G) -+ IR satisfies (2.6) 2: f(x)d x = O. xEV We note that h;';'min d v  h;';'  h;';'max d v . These modified Cheegef constants afe v v related to the eigenvalues of L, denoted by 0 = >..  >..  . . .  >"-1' and PROOF. From Theorem 2.6, we already have 2: If(x) - f(y)1 h > inf XY G - NO L If(x)ld x xEV for f satisfying (2.6). It remains to prove the second part ofthe inequality. Suppose we define c as in the proof of Theorem 2.6. If c  0, then we have 2: If(x) - cld x 2: L If(x) - cld x x xo >..' 1 L(J(u) - f(v))2 inf sup uv f t L(J(v) - t)2 v . f (J,LI) m (f,1) where f ranges over all functions f satisfying L f(v) = 0 which are not identically zefO. 2:  L If(x) - cld x . x The above definition differs from that of I:- in (1.3) by the multiplicative factors of d v for each tefm in the sum of the denominator. So, eigenvalues >"i of I:- satisfy o  >..;  >"i maxd v . v x L If(x) - cld x x:O;O By using methods similar to those in previous sections, we can show 2h::' 2: >... Howevef, the lower bound for >.. in tefms of h;';' is a little messy in its derivation. We need to use the fact: L(J(u) + f(V))2  2 Lf(v)2d v  2 Lf(v)2 m;xd v uv v v If c 2: 0, then we have L If(x) - cld x 2: 1 2: '22: If(x) - cld x . x L If(x) - f(y)1 inf XY NO L If(x)ld x xEV 1 > -hG' - 2 in order to derive the modified Cheeger inequality: >..,2 >..' > I I - 2max d v v Therefore we have This is less elegant than the statement in Theorem 2.2. The proof is complete. S se we dec ide to have our measure be the number of vertices in 5 (and not uppo . '1' . t' the volume of 5) for a subset 5 of vertices. We can then pose slml ar Isopefime fIC problems. Problem 3: For a fixed number m, what is the minimum edge-boundary for a subset 5 of m vertices? Problem 4: For a fixed numbef m, what is the minimum vertex-boundary for a subset 5 of m vertices? We can define a modified Cheeger constant, which is sometimes called the isoperimetric number, by '0 2.6. Isoperimetric inequalities for cartesian products Suppose G is a graph with a weight function W which assigns non-negative values to each vertex and each edge. A general Cheeger constant can be defined as follows: IE(5,8)1 h'(5) = min{15J, 151} L w(x,y) h(G ) . {X,Y}EE(S,S) ,w =mln . S min(L w(x), L w(y)) xES yrf.S We say the weight function W is consistent if LW(u,v) = w(v). u For example, the ordinary Cheeger constant is obtained by using the weight function wo(v) = d v for any vertex v and wo(u,v) = 1 for any edge {u,v}. Clearly, Wo is consistent. On the other hand, the modified Cheeger constant is just h;';' = h(G, WI) where the weight function WI satisfies WI (u, v) = 1 fOf any edge {u, v} and WI (v) = and h::' = inf h'(5). S 
36 2. ISOPERIMETRIC PROBLEMS 2.6. ISOPERIMETRIC INEQUALITIES FOR CARTESIAN PRODUCTS 37 1 for any vertex v. In this case, W1 is not necessarily consistent. We note that graphs with consistent weight functions correspond in a natural way to random walks and reversible Markov chains. Namely, for a graph with a consistent weight function w, we can define the random walk with transition probability of moving from a vertex u to each of its neighbors v to be w(u,v) P(u,v) = w(v) . Similar to Theorem 2.6, the general isoperimetric invariant h(G, w) has the following characterization: THEOREM 2.8. Fo!' a gmph G with weight function w, the isoperimetric in- variant h(G, w) of a graph G satisfies L If(x) - f(y)jw(x,y) h(G, w) = inf sup xy NO cER L If(x) - clw x xEV (2.7) In general, for graphs G i with consistent weight functions Wi, i = 1,' .. ,k, the weighted cartesian product G 1 0", 0 Gk has vertex set V(G) 0", 0 V(G k ) with  consistent weight .fntion W1 0 . . . 0 Wk defined as follows: For an edge {u, v} m E(G i ), the edge Jommg (V1,'" ,Vi":1,U,Vi+1,'" ,Vk) and (V1'''' ,Vi-1,V,Vi+1, ... ,Vk) has weight w1(vd"'Wi-1(Vi-dwi(U,V)Wi+1(Vi+d,... ,Wk(Vk). We re- mark that G1 0 G 2 0 G 3 is different from (G 1 0 G 2 ) 0 G 3 or G 1 0 (G 2 0 G 3 ). The weighted cartesian product of graphs corresponds naturally to the cartesian product of random walks on graphs. Suppose G 1 ,'" , G k are graphs with the vertex sets V(G i ). Each G i is associated with a random walk with transition probability Pi as defined as in Section 1.5. The cartesian product of the random walks can be defined as follows: At the vertex (V1" . . , Vk), first choose a random "direction" i, between 1 and k, each with probability l/k. Then move to the vertex (V1" . . ,Vi-1, Ui, Vi+!, . .. , Vk) according to Pi. In other words, P((V1"" ,Vi-1,Vi,Vi+1,'" ,Uk),(V1,'" ,Vi-1,Ui,Vi+I,'" ,Vk)) = P(Vi,Ui)' where f ranges over all f : V -t IR which are not identically zero. We point out that the above two notions of the cartesian products are closely related. In particular, In particular, we also have the following characterization for the modified Cheeger constant. THEOREM 2.9. d. COH  >'C0H  c- I >'COH where (2.8) L If(x) - f(y)1 , xy hc = inf sup NO cER L If(x) - cj xEV where f ranges over all f : V -t IR which are not identically zero. c = min (min deg G, min deg H) max (max dcg G, max deg H)' Here m.in deg and max deg denote the minimum degree and the maximum degree, respectively. The random walk on G10... OGk has transition probability pi of moving from a vertex (V1, . .. ,Vk) to the vertex (VI, . .. , Vi-I, Ui, Vi+I, . .. , Vk) given by: P'((VI"" ,Vi-I,Vi,Vi+1,'" ,Uk),(V1,'" ,Vi-1,Ui,Vi+1,'" ,Vk)) = WVi,Ui For two graphs G and H, the cartesian product GOH has vertex set V(d) x V (H) with (u, v) adjacent to (u', v') if and only if U = u' and v is djacent to v' in H, or v = v' and U is adjacent to u' in G. For example, the cartesian product of n copies of one single edge is an n-cube, which is sometimes called a hypercube. The isoperimetric problem for n-cubes is an old and well-known problem. Just as in the continuous case where the sets with minimum vertex boundary form spheres, in a hypercube the subsets of given size with minimum vertex-boundary are so- called "Hamming balls", which consist of all vertices within a certain distance [155, 186, 23, 156]. The isoperimetric problems for grids (which are cartesian products of paths) and tori (which are cartesian products of cycles) have been well-studied in many papers [33, 34, 246]. We also consider a cartesian product of weighted graphs with consistent weight functions. For two weighted graphs G and G', with weight functions w,w', respec- tively, the weighted cartesian product G 0 G' has vertex set V(G) x V(G') with weight function w 0 w' defined as follows: For an edge {u, v} in E( G), we define W 0 w'((u, Vi), (v, Vi)) = w(u, v)w'(v') and for an edge {u', v'} in E(G'), we define tv 0w' (( u, u'), (u, v')) = tv(u)w' (u', v'). We require w0w' to be consistent. Clearly, for a vertex x = (u, v) in G 0 G', the weight of x in G 0 G ' is exactly 2w(u)w'(v). L W Vj 1j9 For a graph G, the natural consistent weight function associated with G has edge weight 1 and vertex weight d x for any vertex x. Then we have THEOREM 2.10. The eigenvalue of a weighted cartesian product of G I , G 2 , . . . , Gk satisfies 1 >'CI0 C 20"'0C. k min(>'cI' >'C2>'" ,>.c.) where >'c denotes the first eigenvalue >'1 of the graph G. Here we will give a proof for the case k = 2. Namely, we will show that the eigenvalue of a weighted cartesian product of G and H satisfies 1 . (2.9) >'C0H = 2 mm(>'G, >'u). PROOF. Without loss of generality, we assume that >'G  >'H. 
38 2. ISOPERIMETRIC PROBLEMS It is easy to see that 1 hG1g,T{ :<:: 2. hG. Suppose I : V(G) -t IR is the harmonic eigenfunction achieving AG. We choose a function 10 : V(G) x V(H) -t IR by setting lo(u,v) = I(u). Clearly, AG0/f is less than the Rayleigh quotient using 10 whose value is exactly AG/2. In the opposite direction, we consider the harmonic eigenfunction 9 : V(G) x V (H) -t IR achieving AG0ff' We denote, for u E V (G), v E V (H), (2.10) L g(u, v)d v v g" vol H L g(u, v)d" " gv vol G Lg(u,v)d"d v u,v c = vol G vol H . Here, we repeatedly use the definition of eigenvalues and the Cauchy-Schwarz in- equality: L L (g(u,v) - g(u',v»2d v + L L(g(u,v) - g(u,v'»2d" AG01f V u......u' u v"'v' L(g(u, v) - c)22d"d v u,v AG L(g(u, v) - gv)2d"d v + (L d,,) L (gv - gv,)2 2: ",V " v....... v' 2)g(u,v) - g")22d u d,, + L(g" - c)22d u d" "," n,t! AG L(g(u, v) - g")2d"d,, + A1f(L d,,) L (g" - c)2d" 2: ",V " v......... v' L(g(u, v) - g")22d"d,, + L(g" - c)22d"d" ",V ",V AG 2: 2' This completes the proof of (2.9). o THEOREM 2.11. The Cheeger constant 0/ a weighted cartesian product o/G I , G 2 , . ., ,G k satisfies 1 . k nun(h(G 1 ), h(G 2 ),... ,h(G k » 2: h(G 1 18> G 2 18>'" 18> G k ) 1 . 2: 2k mm(h(G I ), h(G 2 ),... ,h(Gk»'  ..... . .".. . .:r 2.6. ISOPERIMETRIC INEQUALITIES FOR CARTESIAN PRODUCTS 39 Here we again will prove the case for the product of two graphs and leave the proof of the general case as an exercise. (2.11) 1 . 1 Z mm(hG, h/f) 2: h G0 /f 2: 4 min(h(G), h(H». PROOF. Without loss of generality, we assume that h G :<:: h H . First we note that h G hG""/f < -. <Y - 2 Suppose I : V(G) -t IR is a function achieving h(G) in (2.7). We choose a function 10: V(G) x V(H) -t IR by setting lo(u, v) = I(u). Clearl, h G0 /f is no more than the value for the quotient of (2.7) using 10 whose value IS exactly h G /2. It remains to show that h G0 /f 2: h G /4. To this end, we will repeatedly use Corollary 2.7, and we adopt the notation in the proof of (2.9). L L Ig(u, v) - g(u', v)ld v + L L Ig(u, v) - g(u, v')ld" h G (8JH 11 u........u' U v........v' L Ig(u, v) - cl 2d"d v ",V h G Llg(u,v) - gvld"d v + (Ld,,) L Igv - gv,1 2: "," " v........v' L Ig(u, v) - gvl 2d"d v + L Igv - cl 2d"d v ",V u,v 2: h G ""' h 1f ""' 2 L...,lg(u, v) - g"ldud v + 2(L..., d,,) L Ig" - cld" ti,t! U Vrvt/' L Ig(u, v) - gvl 2d"d" + L Ig" - cl 2d"d v ",V ",V h G > 4' This completes the proof of (2.11). o For the modified Cheeger constant h, a similar isoperimetric inequality can be obtained: COROLLARY 2.12. The modified Cheeger constant 01 the cartesian product 01 G I , G2,. . . ,Gk satisfies min(hI' h2' . . . ,h.) 2: hGIDG2D...DG. 1 . " , 2: Zmm(h GI ,h G2 ,... ,h G .). 
40 2. ISOPERIMETRIC PROBLEMS The proof is quite similar to that of (2.11) (also see [57]) and will be omitted. Notes The characterization of the Cheeger constant in Theorem 2.6 is bically the Rayleigh quotient using the LI-norm both in the numerator and denommator. In gene<al, we ean oo,,,'de' 'be 'ealle (bl:;:)e:':;:;'I:);" " p,q > 0 S",q mf I/q f (I/(V)lqdv) . f IIV/llp I? CHAPTER 3 Diameters and eigenvalues 3.1. The diameter of a graph x x In a graph G, the distance between two vertices u and v, denoted by d(u, v), is defined to be the length of a shortest path joining u and v in G. (It is possible to define the diameter by various more general measures). The diameter of G, denoted by D(G), is the maximum distance over all pairs of vertices in G. The diameter is one of the key invariants in a graph which is not only of theoretical interest but also has a wide range of applications. When graphs are used as models for communication networks, the diameter corresponds to the delays in passing messages through the network, and therefore plays an important role in performance analysis and cost optimization. where I ranges over functions satisfying I: I/(x) - clqd x 2: I: I/(x)lqd x for any c, or, equivalently, JIf - cl q 2: Jlfl q . The eigenvalue AI is associated with the case of p = q = 2, while the Cheger constant corresponds to the case of P = q = 1. Some of the general cases will be considered later in Chapter 11 on Sobolev inequalities. This chapter is mainly based on [52]. More general cases of the cartesian roducts are discussed in [57]. Another reference for weighted ?heeger c?nstants nd related isoperimetric inequalities is [83]. A polynomial time lgoflthm for finding an edge-separat.or with size within a constant factor of t.he optllIlum can be found in [61]. Although the diameter is a combinatorial invariant, it is closely related to eigenvalues. This connection is based on the following simple observation: Let M denote an n x n matrix with rows and columns indexed by the vertices of G. Suppose G satisfies the property that M(u, v) = 0 if u and v are not adjacent. Furthermore, suppose we can show that for some integer t, and some polynomial pt(x) of degree t, we have pt(M)(u,v) i- 0 for all u and v. Then we can conclude that the diameter D(G) satisfies: D(G) <:: t. Suppose we take M to be the sum of the adjacency matrix and the identity matrix and the polynomial Pt(x) to be just (1 + x)t. The following inequality for regular graphs which are not complete graphs can then be derived (which will be proved in Section 3.2 as a corollary to Theorem 3.1; also see [51]): r log(n - 1) 1 (3.1) D(G) <:: 10g(1/(1 _ A)) . Here, A basically only depends on AI. For example, we can take A = Al if 1 - AI 2: An-I - 1. In general, we can slightly improve (3.1) by using the same "spectrum shifting" trick as in Section 1.5 (see Section 3.2). Namely, we define A = 2AI/(An-1 + Ad 2: 2AI/(2 + Ad, and we conclude (3.2) D(G) <:: r log(n - 1) 1 . I An-I + AI og An-I - AI 41 
42 3. DIAMETERS AND EIGENVALUES 3.2. EIGENVALUES AND DISTANCES BETWEEN TWO SUBSETS 43 We note that for some graphs the above bound gives a pretty good upper bound for the diameter. For example, for k-regular Ramanujan graphs, we have 1 - Al = A n -1 - 1 = 1/(2v'k=l) so we get D ::; log(n - 1)/(210g(k -I)) which is within a factor of 2 of the best possible bound. 3.2. Eigenvalues and distances between two subsets D(G) < r cosh-1(n - 1) 1 . - cosh-I An_,+A, An_I-AI For two subsets X, Y of vertices in G, the distance between X and Y den t d by d(X, Y), is the minimum distance between a vertex in X and a vertex in Y,.:., d(X,Y) = min{d(x,y):xEX,YEY}. Let X denote the complement of X in V(G). THEOREM 3.1. Suppose G is not a complete graph. For X, Y C V(G), we have r lO volXvolY 1 (3.3) d(X, Y)  g volXvolY lo g An_' +A, An_t-At The bound in (3.1) can be further improved by choosing Pt to be the Chebyshev polynomial of degree t. We can then replace the logarithmic function by cosh- 1 (see [53] and Theorem 3.3) : The above inequalities can be generalized in several directions, Instead of con- sidering dist.ances between t.wo vert.ices, we can relat.e the eig{nvall1e >..) to dist.ances between two subsets of vertices (see Sect.ion 3.2). F\uthermore, for any k :0::: 1, we can relate the eigenvalue Ak to distances among k + 1 distinct subsets of vertices (see Section 3.3). PROOF. For X C V(G), we define It is worth mentioning that the above discrete methods for bounding eigenvalues can be used to derive new eigenvalue upper bounds for compact smooth Riemannian manifolds [54, 55]. This will be discussed in the last section of this chapter. tj;X(x) = { 1 ifxEX, o otherwise. If we can show that for some integer t and some polynomial Pt(z) of degree t, (T 1 / 2 tj;y, Pt(.C)(T1/2tj;X)) > 0 then there is a path of length at most t joining a vertex in X to a vertex in Y Therefore we have d(X, Y) ::; t. . Let ai denote the Fourier coefficients of T I / 2 ./, I . e o/X, . ., We will derive several versions of the diameter-eigenvalue inequalities. From these inequalities, we can deduce a number of isoperimetric inequalities which are closely related to expander graphs which will also be discussed in Chapter 6. M(n) = O(n 2 . 376 ) n-1 T1/2tj;X = L ai,pi, i=O where the ,pi'S are orthogonal eigenfunctions of £. ao = (T1/2tj;X' TI/21) (T1/21, TI/21) In particular, we have vol X - vol G ' In contrast to many other more complicated graph invariants, the diamter is easy to compute. The diameter is the least integer t such that the matrix M = I +A has the property that all entries of M t are nonzero. This can be determined by using O(log n) iterations of matrix multiplication. Using the current best known bound M(n) for matrix multiplication where Similarly, we write this diameter algorithm requires at most O(M(n)Iog n) steps. The problem of determining distances of all pairs of vertices for an undirected graph can also be done in O(M(n) log n) time. Seidel [223] gave a simple recursive algorithm by reducing this problem for a g raph G t o a graph G' in which u  v if d(u, v)  2. (For directed graphs, an O( J M(n)n 3 ) algorithm can be found in [10].) Suppose we choose Pt(z) AI i- An-I, and n-1 T1/2tj;y = L bil/J;, i=O (1 - A, +2L_J t . Since G is not a complete graph, Another related problem is to find shortest paths between all pairs of vertices, which can be easily done in O(n 3 ) steps (in fact O(nm) is enough for a graph on n vertices and m edges). Apparently, we cannot compute all shortest paths explicitly in o(n 3 ) time since some graphs can have cn 2 pairs of vertices having shortest paths of length at least c'n each. However, we can compute a data structure that allows all shortest paths be constructed in time proportional to their lengths. For example, a matrix has its (u, v)-entry t.o be a neighbor of u in a shortest path connecting 1L and v. Seidel gave a randomized algorithm [223] to compute such a matrix in expected time O(M(n) logn), Ipt(>";)1 ::; (1 - W for all i = 1, . .. n - 1 where A - 2 \ /( \ + \ ) " - ;'\1 An-l /\1. (TI/2tj;y,pt(£)T1/2tj;x) aob o + LPt(Ai)aibi i>O Therefore, we have > aob o - (1 - W E a; L b; i>O i>O vol X vol Y t v' vol X vol X vol Y vol Y -(l-A) vol G vol G 
H . DIAMETERS AND EIGENVALUES 3.2. EIGENVALUES AND DISTANCES BETWEEN TWO SUBSETS 4fi La; i>O ( vol X)2 IIT1/2tj>xIl 2 - volG vol X vol X vol G THEOREM 3.3. Suppose G is not a complete graph. For X, Y C V(G), we have [ COSh- 1 volXvolY 1 d(X, Y) < volX volY . - cosh-1 ),n-l+),1 An_I-AI Note that (T 1 / 2 tj>y, Pt(£)T 1 / 2 tj>X) > O. This completes the proof of Theorem 3.3. o As an immediate application of Theorem 3.3, we can derive a number of isoperi- metric inequalities. For a subset X C V, we define the s-boundary of X by 6. X = {y: y If X and d(x,y) ::; s, for some x EX}. Clearly, 6 1 (x) is exactly the vertex boundary 6(x). Suppose we choose Y = V - 6. X in (3.3). From the proof of Theorem 3.1, we have = ( 1/2 ( I _ £ ) tT I / 2 ) vol Xvol Y _ ( 1 _ \ ) t V vol Xvol Yvol Xvol Y o T tj>y, tj> x > vol G A vol G . This implies If we choose log vol X vol Y vol X vol Y log 1)' t we have As an immediate consequence of Theorem 3.3, we have COROLLARY 3.2. Suppose G is a regular graph which is not complete. r log(n - 1) 1 D(G)  10 ),n-1Hl . g ),n-l-),' (3.4) (1 - .\)2t vo l X vol Y  vol X vol Y. Then For the case of t = 1, we have the following. LEMMA 3.4. For all X  V(G), we have vol 6X 1 - (1 _ .\)2 -> - vol X - (1 -.\)2 + volX/volX where.\ = 2.\1/(.\"-1 + .\d. To improve the inequality in Theorem 3.3 in some cases, we consider Chebyshev polynomials: To(z) T 1 (z) T t +1(z) 1, PROOF. Lemma 3.4 clearly holds for complete graphs. Suppose G is not com- plete, and take Y = X - 6X and t = 1. From the proof of Theorem 3.1, we have z, 2zTt(z) - T t - 1 (z), for integer t > 1. Tt(z) = cosh(t cosh- 1 (z». In place of Pt(£), we will use St(£), where T. ( ),' + ),n_,-2X ) t ),n-l-),' St(x) = T. ( ),n-'+),I ) . t An_I-AI > (Tl/2tj>y ,pt(£)TI/2tj>X) vol X vol Y _ (1-.\) Vvol X vol X vol Y vol Y . vol G vol G o Equivalently, we have Thus 1 max St(.\d  T.( ),n-'+),' ) ' xE[)",),n-.] t ),n-'-),' (1 - .\)2vol X vol Y > vol X vol Y. Since Y = X U 6X, this implies (1 - .\)2(vol G - vol X)(vol X + vol 6X) > vol X (vol G - vol X - vol 6X) After cancellation, we obtain vol 6X 1 - (1 _ .\)2 - > - . vol X - (1 - .\)2 + vol X/vol X Then we have Suppose we take o t cosh -1 vol X vol Y vol X vol Y h -1 ),n-'+),1 cos ),n-'-),1 COROLLARY 3.5. For X  V(G) with vol X  vol X, where G is not a complete graph, we have Then we have vol6X \ ->A vol X - (T 1 / 2 1h', S,(C)T1/21/JX) > O. where .\ = 2.\1/(.\n-l + .\d. 
46 3. DIAMETERS AND EIGENVALUES 3.3. EIGENVALUES AND DISTANCES AMONG MANY SUBSETS 47 PROOF. This follows from the fact that vol oX 1 - (1 _ >.)2 vol X 2: 1 + (1 - A)2 >>. i  d + 1, all vectors Xi lie in the same half-space with respect to P, which implies that each of them can be represented in the form by using A  1. o Xi = X: + aie where ai > 0 and e is a unit vector orthogonal to P, and directed to the same half-space as all the Xi. Then we have For general t, by a similar argument, we have LEMMA 3.6. For X <;;; V(G) and any integp-r t > 0, vol OtX 1 - (1 _ A)2t -> I vol X - (1 - >.)21 + volX /vo X where A = 2AJ/(>'n-1 + Ad. 3 7 D or an inte g er t > 0 and X <;;; V (G) with vol X  vol X, we have LEMMA . . rl vol OtX 1 - (1 _ >.)2t -> vol X-I + (1 - >.)2t 0> (Xi, Xj) = (X: - aie, xj - aje) = (X:, xj) + aiaj which implies (x:, xj) < O. On the other hand, by the induction hypothesis, out of d + 1 vectors x:, i = 1,2, ...d + 1 in the (d - I)-dimensional space P, there are two vectors with non-negative scalar product. This is a contradiction and the lemma is proved. 0 THEOREM 3.10. Suppose G is not a complete graph. For Xi C V(G),i 0,1,. . . ,k, we have Suppose we consider, for X <;;; V(G): N: X = X U Os X. As a consequence of Lemma 3.6, we have LEMMA 3.8. For X <;;; V(G) with vol X  vol X and any integer t > 0, vol Nt X 1 > - . vol X - (1 _ ' ) 2t volX + volX A volG volG [ log mind(Xi,X j )  max '#J '#J ifl - Ak 2: An-I - 1. volX; volX j 1 volX i volXj log 1-\. where A = 2>'J/(>'n-I + Ad. PROOF. Let X and Y denote two distinct subsets among the Xi'S. We consider k-I (TI/2tj;y, (I - £)tT I / 2 tj;X) > aob o + :2)1 - >'i)taib i - 2:(1 - Adlaib;j. i=I i?k We remark that the special case of Lemma 3.8 for a regular rph and. t = 1 was first proved by Tanner [233] (also see [9]). This is the bIC lIlequahty fr establishing the vertex expansion properties of a graph. We WIll return to thiS inequality in Chapter 6. For each Xi, i = 0,1,." , k, we consider the vector consisting of the Fourier co- efficients of the eigenfunctions 1t'1,' ., , It'k-I in the eigenfunction expansion of Xi. Suppose we define a scalar product for two such vectors (aI,' .. , ak-d and (b I ,'" ,b k - I ) by k-I 2:(1 - A;)'aibi. i=I 3.3. Eigenvalues and distances among many subsets From Lemma 3.9, we know that we can choose two of the subsets, say, X and Y with their associated vectors satisfying k-I 2:(1 - Ai)taib i 2: O. i=l To generalize Theorem 3.1 to distances among k subsets of the vertices, we need the following geometric lemma [54]. LEMMA 3.9. Let XI, X2, ...Xd+2 denote d + 2 arbitrary vectors in d-dimensio ) nal Euclidean space. Then there are two of them, say, Vi, Vj (i i= j ) such that (Vi, Vj 2: O. Therefore, we have (TI/2tj;y, (I - £)tT I / 2 tj;X) > vol X volY ( ' ) t v volX volX volY volY - 1 - Ak vol G vol G PROOF. We will prove this by induction. First, it is clearly true when d = 1. Assume that it is true for (d - I)-dimensional Euclidean space for some d > 1. Suppose that each pair of the given vectors ha; a negative calr product. Let P be a hyperplane orthogonal to Xd+2 and let xi be the projectIOn of Xi 011 P for i = 1,2, ...d + 1. We claim that. (x:, xj) < 0 provided i f j. Since (Xi, Xd+2) < 0, for and Theorem 3.10 is proved. o We note that the condition 1 - Ak 2: An-I - 1 can be eliminated by modifying >'k as in proof of Theorem 3.1: 
48 3. DIAMETERS AND EIGENVALUES 3.4. EIGENVALUE UPPER BOUNDS FOR MANIFOLDS 49 THEOREM 3.11. For Xi C V(G), i = 0, 1,'" ,k, we have [ log :::;: ::;  1 mind(Xi,X j )  max ), _.+),. ih ,'¥'J log ),:_._),. Let M be a complete Riemannian manifold with finite volume and let £ be the self-adjoint operator -, where  is the Laplace operator associated with the Riemannian etric on M (which will be defined later in (3.9), also see [251]). Or, we could consider a compact Riemannian manifold M with boundary and let £ be a self-adjoint operator - subject to the Neumann oc Dirichlet boundary conditions (defined. in (3.10)). We can still have the following analogous vecsion of (3.5) for the s-nelghborhood of the suppoct of a function. if .\k i- .\n-I . Another useful generalization of Theocem 3.10 is the following: THEOREM 3.12. For Xi c V(G), i = 0,1," . ,k, we have [ I volXi volX ; 1 og VOIXi vol X; mind X. X' < min max . i#j ( " ]) - O$j<k i#j log ),n-;-'),'-J. An-,-l Ak-J There exists a non-trivial family of bounded continuous functions P a (.\) defined on the spectrum Spec£, where s ranges over [0,+00), so that for any function f E L2(M, f.t): (3.6) suppPa(£)f C suPPaf. where j satisfies '\k-j f= '\n-j-I. PROOF. For each j, 1  j  k - 1, we can use a very similac proof to that in Theorem 3.10, such that thece ace two of the subsets X and Y with theic corre- sponding vectors satisfying For example, we can choose P a (.\) = cos(v:\s) which clearly satisfies the re- quirement in (3.6). Let us define 2:)1 - .\i)taibi 2 ° iES where S = {i : 1  i  k - j or n - j + 1  i  n - 1}. The proof then follows. 0 pes) = sup I Pa(>') 1 ),ESpecC and assume that p( s) is locally integrable. We considec 3.4. Eigenvalue upper bounds for manifolds <1>(.\) = l>O q,(s)Pa(.\)ds where q,( s) be a measurable function on (0, +00) such that 1 00 1 q,(s) I p(s)ds < 00. In particular, <1>(.\) is a bounded function on Spec£, and we can apply the operator <1>(£) to any function in L2(M, f.t). There are many similarities between the Laplace operator on compact Riemann- ian manifolds and the Laplacian for finite graphs. While the Laplace operattJr for a manifold is genecated by the Riemannian metric, for a graph it omes from t.he ad- jacency relation. Sometimes it is possible to treat both the contmuouS and discrete cases by a universal appcoach. The general setting is as follows: 1. an underlying space M with a finite measure f.t; . 2. a well-defined Laplace operator £ on functions on M so that £ IS a self- adjoint operator in L2(M,f.t) with a discrete spectrum; 3. if M has a boundary then the boundary condition should be chosen so that it does not disrupt self-adjointness of £; . 4. a distance function dist(x, y) on M so that I Vdist I 1 for an approprIate notion of gradient. For a finite connected graph (also denoted by M in this section), the metric f.t can be defined to be the degcee of each vertex. Togethec with the Laplacian £, all the above properties are satisfied. In addition, we can consider an r-neighbochood of the support sUPPrf of a function 1 in L2(M, f.t) for r E IR: SUPPr 1 = {x EM: dist(x,supp f) :::; r} whece dist denotes the distance function in M. For a polynomial of degree s, denoted by Pa, then we have We will prove the following general lemma which will be useful later. LEMMA 3.13. If f E L2(M, f.t) then 1I<I>(£)/II£2(M\suPPrfJ  IIflb 1 00 I rjJ(s) I p(s)ds where IIflb := IIfll£2(M,/l)' PROOF. Let us denote (3.5) sUPP Pa(e)1 C sUPPa/. w(x) = <I>(c)/(x) = 1 00 rf>(s)Pa(C)f(x)ds. If the point x is not in sUPPrl then Pa(£)f(x) = ° whenevec s :::; r. Thecefore, for those points w(x) = JOO rjJ(s)Pa(£)f(x)ds 
50 3. DIAMETERS AND EIGENVALUES 3.4. EIGENVALUE UPPER BOUNDS FOR MANIFOLDS 51 II w llL2(M\SuPPrf) < 11['" </>(S)P.(.c)f(X) ds I1 2  L'" 1I</>(s)P,,(.c)/(x)1I2 ds  LX> I </>(s) I p(s)lI/lbds. where gij are the contravariant components of the metric tensor, 9 gij = IIgijll-l, and u is a smooth function on M. If the manifold M has a boundary 8M, we introduce a boundary condition 8u (3.10) au + (J 8v = 0 where a(x), (J(x) are non-negative smooth functions 011 M such that a(x) +(J(x) > 0 for all x E 8M. det IIgijll, and The proof is complete. o As an immediate consequence, we have 2 ( M ) and the distance between supp 1 and COROLLARY 3.14. If f,g E L ,J-l supp 9 is D, then ( 3.7) I { 1if>(C)9dIL I  IIflb IIgll2 (:X> I </>(s) I p(s)ds JM . /J For example, both Dirichlet and Neumann boundary conditions satisfy these assumptions. The inte ral on the left-hand side of (3.7) is reduced to oe over the support '. . g . .. ed by the inte g ral over the exteflor of sUPPDf. The f whIch III turn IS maJOflZ ., C h S h es of the proof follows by a straightforward apphcatIOn of the auc y- c warz inequality. For the choice of p. (A) = cos( vf\s), suppose we select 1 .2 </>(s) = -e-". ,jirt The operator .c = -Ll is self-adjoint and has a discrete spectrum in L2(M, J-l), where J-l denotes the Riemannian measure. Let the eigenvalues be denoted by 0= AO < Al  A2  .... Let dist(x, y) be a distance function on M x M which is Lipschitz and satisfies IVdist(x, y)1  1 for all x,y EM. For example, dist(x,y) may be taken to be the geodesic distance, but we don't necessarily assume this is the case. We want to show the following (also see [54]): THEOREM 3.17. For two arbitrary measurable disjoint sets X and Y on M, we have 1 00 >.t if>(A) = 0 </>(s)P.(A)ds = e- . 3 15 If f E L2 ( M 11. ) and the distance between the supports of COROLLARY .. ,g ,,... 1 and 9 is equal to D then (3.8) 11M le-tLgdJ-l1  IIflb IIglb L= < 1 ( (11M)2 ) 2 (3.11) Al - dist(X, Y)2 1 + log J-lX J-lY Moreover, if we have k + 1 disjoint subsets Xo, XI,'" ,X k such that the distance between any pair of them is greater than or equal to D > 0, then we have for any k 2: 1, Then we have (3.12) 1 (pM)2 Ak  D 2 (1 + sup log X X )2. i#j IL i J-l i 1 .2 -e-" ds. ,jirt PROOF. Let us denote by </>i the eigenfunction corresponding to the i -th eigen- value Ai and normalized in L2(M,J-l) so that {</>;} is an orthonormal frame in L2(M, J-l). For example, if either the manifold has no boundary or the Dirichlet or Neumann boundary condition is satisfied, there is one eigenvalue 0 with the associated eigenfunction being the constant function: 1 </>0= vpM ' The proof is based upon two fundamental facts about the heat kernel p(x, y, t), which by definition is the unique fundamental solution to the heat equation 8 8t u(x, t) - Llu(x, t) = 0 with the boundary condition (3.10) if the boundary 8M is non-empty. The first fact is the eigenfunction expansion Let us mention a similar but weaker inequality: COROLLARY 3.16. 11M le-tLgd P \  11/112 IIgll2 e - : . This inequality was proved in [93] [251] and is quite useful. be a smooth connected compact Riemannian manifold an Ll be a Let M . ted with the Riemannian metric, i.e., in coord mates Xl, Laplace operator assocla X2,'" ,X n , (3.9) 1 n 8 ( ij 8u ) Llu = In L 8x' -IYg 8x' yg i,j=I' J 00 (3.13) p(x, y, t) = L e-),;t</>i(X)</>i(Y) i=O 
52 3. DIAMETERS AND EIGENVALUES 3.4. EIGENVALUE UPPER BOUNDS FOR MANIFOLDS 53 and the second is the following estimate (by using Corollary 3.16): (3.14) Jx i p(x, y, t)f(x)g(y)J-t(dx)J-t(dy) 5e(1x f2 i g2) ! ex - : ) for any functions I, 9 E £2 (M, J-t) and for any two disjoint Borel sets X, Y C M where D = dist(X, Y). We first consider the case k = 2. We start by integrating the eigenvalue expan- sion (3.13) as follows: (3.15) J(I, g) Ix i p(x, y, t)/(x)g(y)J-t(dx)J-t(dy) =  e-)..;I Ix Ni Jy grPi. We dcnote by /; t.he Fouricr coefficients of the function ftj;x wit.h respect to the frame {rPi} and by gi thosc of !J Vly. Then and IINxib = (Ix rP5)! = Vk. Similar identities hold for g. We then obt.ain 1 ( 4 ) 2 .\ < - 10 I- D2 g!xrP5!yr/>5 Now we consider the general case k > 2. For a function f(x), we denote by J/ the i-th Fourier coefficient of the function fIx; i.e. J/ = J Ni. x; J(I,g) 00 e-)..ol fogo + 2.: e-)..;I /;gi i=1 2: e-)..ol logo - e-)..\IIINxlb IIgtj;yll2 Similar to the case of k = 2, we have Jim (I, J) = J J p(x, y, t)f(x)f(y)J-t(dx)J-t(dy). x, X m Again, we have the following upper bound for Jim (I, J): (3.17) Jlm(l,J) 5c IINx, 112 IINxmlbexp (- : t). where we have used \ \e-)";1/;9i\ 5c e-)..,I (/;g:):; 5c e-)..\IIINxlbllgtj;ylb. By comparing (3.16) and (3.14), we have (3.16) . D 2 ) ' exp(-.\dIlNxlb IIgtj;vII2 2: logo -IINxIl 2 I1gtj;ylb ex p (-4't . W . 11 1 se t so that the second term on the right-hand side (3.16) is equal to e WI C 100 G . fl' ce one half of the first one (here we take advantage of the aussJan exponen la SlIl it can be made arbitrarily closc to 0 by taking t small enough): D 2 t = 41 211NxII2 IIg'i>Y1I2 ' og logo We can rewrite the lower bound (3.16) in another way: (3.18) k-I Jlm(l,J) 2: e-)..,Iffn+ 2.:e-)..;lfffim-e-)..kIIlNx,1I2I1NxmIl2 i=l Now we can eliminate the middle term on the right-hand side of (3.18) by choosing appropriate land m. To this end, let us consider k+1 vctors fm = (1[", I!f', ...11:-1)' m = 0,1,2, ...k in IR k - 1 and let us endow this (k-I)-dimensional space with a scalar product given by For this t we have 1 exp(-.\dIlNxlbllgtj;ylb 2: zJ090 k-l (v, w) = 2.: VjWie-)..;I. i=1 By using Corollary 3.9, out of any k + 1 vectors in (k - I)-dimensional Euclidean space there are always two vectors with non-negative scalar product. So, we can find different l, m so that (/, f m ) 2: 0 and therefore we can eliminate the second term on the right-hand side (3.18). Comparing (3.17) and (3.18), wc have (3.19) e-).. kI IlNx,1I2 IINx m ll2  ffl: -IINx,lb IINxmll2ex - : ). Similar to the case k = 2, we can choose t so that the right-hand side is at least  ffo' We select which implies 1 1 211Nxlb IIgvJylb >'1 < - og . - t logo After substituting this value of t, we have 2 4 ( I 211Nxlb IIgtj;ylb ) .\1 < D 2 og I - Jogo Finally, we choose 1 = 9 = rPo and take into account that 10 = Ix No = Ix rP, D2 t = min III I . 101m 4lo g 2 "'x,12I1NxmIl2 I J /O' 
5-1 3. IJIAMETEHS AND EIGENVALUES From (3.19), we have A <  10 211Nx,Ib 1I!I/ixm 112 . k - t g f!O' By substituting t from above and taking! = rPo, (3.12) follows. o CHAPTER 4 Although differential geometry and spectral graph theory share a great deal in common, there is no question that significant differences exist. Obviously, a graph is not "differentiable" and many geometrical techniques involving high-order derivatives could be very difficult, if not impossible, to utilize for graphs. There are substantial obstacles for deriving the discrete analogues of many of the known results in the continuous case. Nevertheless, there are many successful examples of developing the discrete parallels, and this process sometimes leads to improvement and strengthening of the original results from the continuous case. Furthermore, the discrete version often offers a different viewpoint which can provide additional insight to the fundamental nature of geometry. In particular, it is useful in focusing on essentials which are related to the global structure instead of the local conditions. Paths, flows, and routing 4.1. Paths and sets of paths There are basically two approaches in the interplay of spectral graph theory and spectral geometry. One approach, as we have seen in this section, is to share the concepts and methods while the proofs for the continuous and discrete, respectively, remain self-contained and independent. The second approach is to approximate the discrete cases by continuous ones. This method is usually coupled with appropriate assumptions and cstimates. One example of t.his approach will be given in Chaptcr 10. One of the main themes in graph theory concerns paths joining pairs of vertices For example, the Hamiltonian path problem is to decide if a g ra p h has a . I ' . th 1," simp e a con almg every vertex of the graph. Some diameter and distance problems mvolve findmg sho.rtest paths. There are many basic problems depending on sets of paths tat are 'ther vertex-disjoint or edge-disjoint. These path problems arise naturally m a vanety of guises, such as the study of communicating processes on networks, dta flow on parallel computers, and the analysis of routing algorithms on VLSI chips. Some p.ath roblems appear to be quite difficult computationally. For example, the Hamlltoman path P roblem is well know n to be NP 0 I t Th bl " . . -c mp e e. e .pro em of findmg dlsJomt paths between given pairs of vertices even in very specI1 graphs [140] .is also NP-complete. Nevertheless, wc will see t.hat eigenvalue techmques are amazmgly effective in providing good solutions for a range of path problems. For almost every known result in spectral geometry, a corresponding set of questions can be asked: Can the results be translated to graph theory? Is the discrete analogue true for graphs? Do the proof techniques still work for the discrete case? If not, how should the methods be modified? If the discrete analogue does not hold for general graphs, can it hold for some special classes of graphs? What are the characterizations of these graphs? Notes Before we proceed, we first define several types of disjoint paths that we call flow, route set, and routing. Consider a graph G with vertex set V and edge set E. Suppose X and Yare two equinumerous subsets of vertices of G. In general X and Y can be muItisets and it is not necessary to require X n Y = 0. ' .For [XI = WI = m, a flow F from X to Y consists of m paths in G joining the vertIces m X to th veric.es in Y. We call X the input of the flow F and Y the output of F. Paths m F Jom vertices of X to vertices in Y in a one-to-one fashion but we do not care about "who is talking to whom." We do care that the path be chosen so. t.ht no edge is orsed. Fr example, the paths might be required to be edge-dlsJomt or vertex-dlsJomt or with small "congestion" in the sense that every edge (or vertex) of G is used in relativel y few P ath s of F W . 11 d fi " ." . . e WI e ne congestIOn preCisely later. . A route set is a flow with input-output assignments. Namely, for a spccified :,slgnment A = {(i' Yi) : Xi E X, Yi E Y}, a route set consists of paths Pi joining ' h to ,i for each l. In other words, an assignmcnt specifies "who is talking to wom. Discrete invariants are somewhat differcnt from the continuous ones. For ex- ample, the number of vertices n is an important notion for a graph. Although it can be roughly identified as a quantity which goes to infinity in the continuous ana- log, it is of interest to distinguish n, n log n, n 2 ,. .. and 2 n , for example. Therefore more careful analysis is often required. For Riemannian manifolds, the dimension of the manifold is usually given and can be regarded as a constant. This is however not true in general for graphs. The interaction between spectral graph theory and differential geometry opens up a whole range of interesting problems. This chapter is based on the original diameter-eigenvalue bounds given in [51] and a subsequent paper [53]. The generalizations to pairs of subsets for regular graphs were given by Kahale in [168]. The generalizations to k subsets and to Riemannian manifolds can be found in [54, 55]. Roughly speaking, a routing R is a dynamic version of a route set. It can be defin.ed as a .peb?le game. Initially, there is a pebble Pi placed at each input. vertex Xi With destmatlOn Yi for each of the assi g nments ( X' Y . ) I ' ll A At I t . . , " , ., eac J ,line {!lilt a pebble can be moved to some adjacent vertex. Thc routing n is t.hen a rOllt. 
56 4. PATHS, FLOWS, AND ROUTING 4.2. FLOWS AND CHEEGER CONSTANTS 57 set together with a strategy for moving pebbles to their destinations. Additional requirements can be imposed. For example, at each time unit, the edges used for moving pebbles should be (vertex- or edge-) disjoint or all edges must have small congestion. I ad each edge of G is contained in at most m paths in P. Then the eigenvalue >"1 satisfies >"1> - kml Flow and routes are very useful in establishing lower bounds for Cheeger con- stants as well as providing lower bounds for eigenvalues (see 4.2. and 4.5.). Con- versely, for graphs with good eigenvalue lower bounds, short routes and effective routing schemes exist with small congestion which will be described in 4.3. and 4.4. . P f ROO:. Using the definition (1.5) of the eigenvalues, we consider the harmonic elgen unctIOn f : V(G) --t IR achieving >"1. >"1 n L (I(x) - f(y))2 {x,Y}EE(e) k L(J(x) - f(y))2 4.2. Flows and Cheeger constants x,y Flows are closely related to cuts as evidenced by the max flow-min cut theorem which was used in the previous section. In fact., there is a direct connection between the Cheeger constants and flow problems on graphs. Although these observations are quite easy, we will state them here since they are useful for bounding eigenvalues. We follow the definition for Cheeger constants he and h'c as given in Section 2.2. LEMMA 4.1. For a graph G on n vertices, suppose there is a set of (;) paths joining all pairs of vertices such that each edge of G is contained in at most m paths. Then We note that for x, y E V(G) and the path P(x, y) joining x and Y in G we have . , (I(x) - f(y))2 ::; IP(x, y)l .L f2(e)::; I .L f2(e), eEP(x,y) eEP(x,y) where f2(e = (I(x) - f(y))2 for e = {x,y}, and IP(x,y)1 denotes the number of edges of Gill P(x, y). Hence , IE(S, 8)1 n he = sp min(IS\, IS\) :0::: 2m m .L f2(e) :0::: eEE(e) E L f2(e) x,y eEP(x,y) 1 I L(J(x) - f(y))2. x,y :0::: PROOF. The proof follows from the simple fact that for any set S  V with ISI  18\, we have Therefore we have IE(S, 8)1 . m :0::: :0::: ISI.I$I n ISI. -. 2 o o >"1 > This completes the proof of Theorem 4.3 n kml ' By using Cheeger's inequality in Chapter 2 and the above lower bound for the Cheeger constant derived from a flow, we can establish eigenvalue lower bounds for a regular graph. In fact, we can derive a better lower bound for >"1 directly from a flow in a general graph. We first prove a simple version for a regular graph. THEOREM 4.3. For a k-regular graph G on n vertices, suppose there is a set P of G) paths joining all pair's of vertices such that each path in P has length at most For a general graph, the above theorems can be generalized as follows: . THEOREM 4.4. For an undirected graph G, replace each edge {u, v} by two directed edges (u, v) nd (v,.u). Suppose there is a set P of 4e 2 paths such that for ch (ordered) pair of directed edges there is a directed path joining them. In addition, assume that each directed edge of G is contained in at most m directed paths In P. Then the Cheeger constant he satisfies he = min . IE(S, 8)1 > vol G mm(vol S, vol S) - 2m . As an immediate consequence, we have the following: COROLLARY 4.2. For a k-regular graph G on n vertices, suppose there is a set P of (;) paths joining all pairs of vertices such that each edge of G is contained in at most m paths in P. Then the Cheeger constant he satisfies he = inf IE(S, 8)1 >  s kmin(ISI, IS\) - 2mk PROOF. For any S  V(G), we have mIE(S, 8)1 :0::: vol S vol 8 > vol S vol G - 2 . o 
58 4. PATHS, FLOWS, AND ROUTING 4.3. EIGENVALUES AND ROUTES WITH SMALL CONGESTION 59 THEOREM 4.5. For' an undirected graph G, replace each edge {u, v} by two directed edges (u,v) and (v,u). Suppose there is a set P of 4e 2 directed paths such that for each (ordered) pair of directed edges there is a directed path joining them, each of length at most I. In addition, assume that each directed edge of G is contained in at most m directed paths in P. Then the eigenvalue ),1 satisfies With d v walks starting at v, the sum of the probabilities that there exists a walk W(x) that visits q = {u,v} is /-1 I(q)  L Ldxt/Jxpit/J:/du i=O x \ vol G "'1>-' - ml /-1 L(1T) pi t/J:/ d " i=O where 1 denotes the all l's vector, T is the diagonal matrix with entries T(v v) = d and ' v, The proof of Theorem 4.5 is very similar to that of Theorem 4.3 and will be omitted. We remark that Theorems 4.3, 4.5 can be generalized in a number of ways. For example, instead of having one path joining two vertices, we can ask for a fixed number of paths or weighted paths with fixed total capacities (in the spirit of the max flow-min cut theorem). Another direction is to derive the comparison theorems which will be discussed in Section 4.5. (IT)Pj = IT. Therefore /-1 I(q)  L ITt/J:/d" i=O I. 4.3. Eigenvalues and routes with small congestion Therefore, for each fixed v, the expectation of the random variable I(e) is no o:e than I. We observe that this random variable is a sum of IE(G)I independent mdlcator random variables (see, e.g. [12] Theorem A.12 page 237), and that for each fixed edge q, the probability that I(q) exceeds, say 101, is at most e 9 / 1 ( 10 10 ) « n 3 ' Since there are at most n 2 edges, it follow that the probability that there is an edge with I(q) > 101 is much smaller than . This completes the proof of Theorem 4.6. 0 In a graph G, a random walk of length I starting at a vertex v of G is a randomly chosen sequence v = Vo, V1 , . . . VI, where each vi+ 1 is chosen, uniformly at random and independently, among the neighbors of Vi, for i = 0,. ., ,1- 1. We say that the walk visits Vi at time i. In a graph G with ),1 > 0, a random walk starting from any vertex converges rou g hly in  steps to the stationary distribution (if G is bipartite, we ulie a lazy ),\ random walk; see Section 1.5.) We will use this property to derive the following fact. THEOREM 4.6. Let G be a graph on n vertices and suppose I 2: log n/ ),1. Sup- pose for any V E V(G) there are d v walks of length I starting at v. For any edge q, let l(q) denote the total number of walks containing q. Then, almost surely (i.e., with probability tending to 1 as n tends to infinity), there is no edge q so that :r he above estimate can in fact be proved directly. Suppose there is a set of m mdependent events such that the probability of the i-th event is Pi. Furthermore, suppose that L Pi ,. Then the probability that at least s events occur is bounded by I(q) > 101. L fIpi < SC{1,...m} iES ISI=. 1", . 'I (L..., Pi) S.  ee ).. s PROOF. Let P denote the transition matrix defined by P(u, v) = { 1/ 0 d" if u and v are adjacent otherwise. The proof of Theorem 4.6 follows by choosing, = I and s = 10,. THEOREM 4.7. Let G denote a graph on n vertices. Let A = {(Xi,Y;) : Xi E X, Yi E Y} denote any assIgnment such that each vertex v is in X with multiplicity d v and in 2 Y with multiplicity d v . Then there are paths Pi joining Xi to Yi of length at most XI log n such that each edge of G is contained in at most 20 lo g n P aths )" . The probability that a random walk W(u) starting at u visits a vertex X at time i is precisely t/J"pi(t/Jx)* where t/Jy is the unit vector having 1 in coordinate Y and 0 in every other coordinate. For a directed edge (u, v), the probability that a random walk V(x) visits 1L at time i and v at time i + 1 is t/Jxpit/J:/d". PROOF. Let Pi denote a random walk of length 21 between x. and Y . wher e I  U . t t  ),\' smg an argument of Valiant in his work on parallel routing [243] (also see [40]), we may assume that each walk consists of two random walks of length 
60 1 PATHS, FLOWS, AND ROUTING 4.4. ROUTING IN GRAPHS 61 I , one starting from Xi and the other from Yi. The reason for this is that by our eigenvalue condition, the distribution of the random walk of length I is close to its stationary distribut.ion and hence one may view the walk Pi as being chosen by first choosing its middle point (according to the stationary distribution) and then choosing its two halves. The proof of Theorem 4.7 then follows from Theorem 4.6. 0 An obvious lower bound on rt(G) is the following: rt(G) ::::: D(G) where D(G) denotes the diameter of G. The above proofs for Theorem 4.6 and 4,7 were adapted from the following simpler version for regular graphs in [7]: THEOREM 4.8. Let G denote a k-regular graph on n vertices. Let 7r denote a pef'mutation of the vertices of G Then there are paths Px joining X to 7r(x) of length at most t log n such that each edge of G is contained in at most k21 log n paths. For Pn a path on n vertices, our routing problem reduces to a well studied problem in parallel sort.ing networks, the so-called odd-even transposition sort (see [174] for a compreheslve survey). In this case, it can be shown that rt(Pn) = n. In fac, any permutatIOn 7r on Pn can be sorted in n steps by labelling consecutive edges III Pn as eI, e2,' .. , en-I and only making interchanges with even edges e2k on even steps and odd edges e2k+I on odd steps. et Kn denote the complete graph on n vertices. In this case, because Kn is so hIghly connected, the routing number of Kn is as small as one could hope for (see [7]): 4.4. Routing in graphs rt(Kn) = 2 . For the complete bipartite graph Kn,n with n ::::: 3, the following result is due to Wayne Goddard[143]. In this section, we consider a simple (though fundamental) problem of the following type: Suppose we are given a connected graph G with vertex set V and edge set E. Initially, each vertex v of G is occupied by a unique marker or "pebble" Pv. To each pebble Pv is associated a destination vertex 7r(v) E V, so that distinct pebbles have distinct destinations. Pebbles can be moved to different vertices of G according to the following basic procedure: At each step a disjoint collection of edges of G is selected and the pebbles at each edge's two endpoints are interchanged. Our goal is to move or "route" the pebbles to their respective destinations in a minimum number of steps. · rt(Kn,n) = 4 . For any tree Tn on n vertices, it was proved in [7] that rt(Tn) < 3n. However, the correct value of the constant may be half as large as suggested by the following: ' Conjecture. For any tree Tn on n vertices, rt(G) = max rt(G,7r) 7r rt(Tn)  l 3(n 2- 1 ) J. Furthermore, equality holds only when Tn is a star Sn on n vertices. The following result on routing on the hypercube can be traced back to the earl work of switching networks (see Benes [20]) and has appeared frequently in the lIterature on parallel computing: rt(Qn)  2n-1. We will imagine the steps occurring at discrete times, and we let Pv(t) E V denote the location of the pebble with initial position v at time t = 0,1,2,... . Thus, for any t, t.he set {Pv(t) : v E V} is just a permut.ation of V. We will denote our target permutation that takes v to 7r( v), v E V, by 7r. Define rt( G, 7r) to be the minimum possible number of steps to achieve 7r. Finally, define rt(G), the routing number of G, by where 7r ranges over all destination permutations on G. (Sometimes we will also call 7r a routing assignment.) . In more algebraic t.erms, the problem is simply to determine for G the largest number of terms T = (UIVI)(U2V2)'" (urv r ) ever required to represent any per- mut.ation in t.he symmetric group on n = IVI symbols, where each permutation T consists of a product of disjoint transpositions (UkVk) with all pairs {Uk, Vk} required to be edges of G. . The eact value of r.t(Qn) is still unknown. It is easy to see that rt(Qn) ::::: n sIllce the dIameter of Qn IS n. For small cases, it can be checked that rt(Qn) ::::: n+ 1 for n = 2,3. Problem: Is it true that for the n-cube Qn, rt(Qn) = n + O(n)? To see that rt(G) always exists, let us restrict our attention to some spanning subtree T of G. It is clear that if p has destination which is a leaf of T, then we can first route p to its destination u, and then complete the routing on T \ {u} by induction. Perhaps, rt(Qn) = n + o(n) for all sufficiently large n. For the m by n grid graph Pm X P n , m  n, rt(Pm X Pn)  2m + n . 
62 1. PATIIS, FLOWS, AND !lOUTING 1.1. ROUTING IN GRAPHS 63 1n general, for the cartesian product of two graphs, we have [7, 178] rt(G x G')  2rt(G) + rt(G') . Note that since G x G' and G' x G are isomorphic graphs, this can be written in the symmetric form rt(G x G')  min{2rt(G) + ri(G'), 2rt(G') + rt(G).} Problem: Is it true that for eve1'y graph G, rt(G x G) 2: rt(G)? as a?oe, perform 21 steps, where the steps numbered i and 21 + 1 - i corrcspond o fhppmg the pebbles along edges numbered i and 21 + 1 - i in each of the paths m the set for all 1  i  I. One can check that by the end of these 21 steps the ends of each path exchange pebbles, and all the other pebbles stay in their oriinal places. (Note hat som.e pebbles that are not at the ends of any of the paths may move several tImes durmg these steps, but the symmetric way these are performed guarantees that such pebbles will return to their original places at the completion of the 21 steps.) By repeating the above procedure for all the path-classes the result follows. ' 0 From the above results and partial results, we can see that the problem of de- tcrmining the routing number is quite difficult even for very special graphs. It is indeed surprising in a way that by using eigenvalues we can get very good approx- imations for the routing number problem. The following arguments are basically adapted from [7]. In the remaining part of this section, we assume G is a regular graph. TH EOREM 4.9. Let G be a regular graph on n vertices and suppose I 2: log n / ),1 . For each v E V, independently, let W(v) denote a random walk of length I starting at v. Let lev) denote the total number of other walks W(u) such that there exists a vertex x and two indices 0  i,j  I, Ii - jl < 5, so that W(v) visits x at time i and W(u) visits x at time j. Then, almost SU1'ely (i.e., with probability tending to 1 as n tends to infinity), there is no vertex v so that lev) > 1001. We mention here several problems closely related to the routing number of a graph. One such problem is the following: Sup.pose G = (V, E) is a connected graph on n vertices. For a permutation 11' we .consldr a :oute set P, which is just some set of paths Pi joining each vertex v; to Its destmatlOn vertex 1I'(Vi), for i = 1" .. ,n. For each edge e of G, we consider the number rc(e, G, 11', P) of paths Pi in P which contain e. The route cove1'ing number rc(G) of G is defined to be rc( G) = max min max rc ( e G 11' P ) . 1T P eEE ", The proof is very similar to that of Theorem 4.6 and is omitted. THEOREM 4.10. Let G denote a regular graph on 11 vertices and let a be a permutation of order two on V (i.e., a product of pairwise disjoint transpositions). Put I = l logn. Then there is a set of n walks W(v), v E V, each of length 21, where both W(v) and W(a(v)) connect v and a(v) and traverse the same set of edges (in different directions) satisfying the following: If lev) denotes the total number of other walks W(u) such that there exists a vertex x and two indices o  i,j  I, Ii -jl < 5, so that W(v) visits x at time i and W(u) visits x at time j or at time 21- j, then lev)  4001 for all v, THEOREM 4.11. Let a denote a permutation on the vertex set of G. Then 1 2 rt(G, a) = D( - log n). >'1 In other. words, for each permutation we want to choose the route set so that th.e .mxmlUm number of occurrcnces of any edgc in the paths of the route sct is mmlmlzed. . For example, for the n-cube Qn, the method [7] used to establish the route set gives rc(Qn)  4. In the othr direction, by choosing 11' to be the permutation of vertices in Qn so that the distance between v and 11'( v) is n for every vertex v it can be easil y seen that ' rc (Q ) > 2:v d(v, 1I'(v)) = n - IE(Qn)1 2. Conjecture: PROOF. Let G denote a regular graph on n vertices. It suffices to consider a permutation a of order two on V since any permutation is a product of at most two such permutations (as proved in the proof of rt(Kn) = 2; also see [7]). We set I = ¥,- logn. We want to show that rt(G,a) = 0(1 2 ). Let W(v) be a system of walks of length 21 satisfying the assumptions of the previous theorem. Let H be the graph whose vertices are the walks W(v) in which W(u) and W(v) are adjacent if there exists a vertex x and two indices 0  i,j  I, Ii - jl < 5 so that W(v) visits x at time i and W (u) visits x at time j or at time 21 - j. Then the maximum degree of H is 0(1) and hence it is O(I)-colorable. It follows that one can split all our paths W(v) into 0(1) classes of paths such that the paths in each class are not adjaccnt in J{. Considcr now the following routing algorithm. For cach set of paths rc(Qn) = 2. . Also of interest is a "symmetric" version of the route covering problem, espc- Clally for Qn : . A airing for Qn is a partition of the vertex set of Qn into subsets of size 2. Is It possible to find edge-disjoint paths joining vertices of each pair for any pairing of Qn ? The answer is negative when n is even. However, for odd n this problem remains open. 
64 4. PATHS, FLOWS, AND ROUTING 4.5. COMPARISON THEOREMS 65 4.5. Comparison theorems Therefore we have We can often bound the eigenvalues of one graph by t.he eigenvalues of another provided pairs of adjacent vertices in the first graph can be joined by "short" pat.hs in the second graph. Although the proofs for these comparison teo.rems ar qU1e easy, the applications are abundant. Interesting examples along thIS lIne are glve In Diaconis and Stroock [98] and numerous other papers [99, 100, 125] or comparIng various different card shuffling schemes. We remark that the companso thore in this section can be viewed as generalized versions of the so-called POIncare inequalities [98]. THEOREM 4.12. Let G and G' be two connected regular graphs, with eigenval- ues),1 and),; and degrees k and k', respectively. Suppose that the vertx set of G is the same as the vertex set of G'. We assume that for each edge {x, y} m G, there is a path P(x, y) in G' joining x and y of length at most l. Furthermore, suppose that evel'y edge in G' is contained in at most m paths P( x, y). Then we have ),' I ::::: k k'lm E (f(x)  f(y))2 {X,Y}EE(G) L f2(X)k k ::::: k'lm ),l. This completes the proof of Theorem 4.12. o , k),1 ),1 ::::: k'lm ' It is not surprising that the above proof is quite similar to some of those in Section 4.2. There are several generalizations of Theorem 4.12: THEOREM 4.13. Let G and G' be two connected graphs, with eigenvalues ),1 and ),;, respectively. Suppose that the vertex set of G is the same as the vertex set of G'. Assume that for each edge {x, y} in G, thel'e is a path P( x, y) in G' of length at most I, and for each vertex v, the degree d v of v in G is at least ad, where d is the degree of v in G'. Furthermore, suppose every edge in G' is contained in at most m paths P(x, y). Then We have ),' a),1 I::::: [;;. PROOF. Using the definition of the eigenvalues, we consider the harmonic eigen- function f achieving ),1 in G'. ),' I L (J(x) - f(y))2 {x,y}EE(G') k' L f2(X) k E (f(x) - f(y))2 {x,Y}EE(G') k' E (f(x) - f(y))2 {x,y}EE(G) Instead of proving Theorem 4.13, we will prove the following generalization: THEOREM 4.14. Let G and G' be two connected graphs, with eigenvalues ),1 and ),i, respectively. Suppose that the vertex set of G can be embedded into the vertex set of G' under the mapping c.p : V(G) -+ V(G'). Suppose c.p satisfies the following conditions for fixed positive values a, I, m: L (f(x) - f(y))2 {x,Y}EE(G) k L f2(x) (a): Each edge {x, y} in E( G) is associated with a path, denoted by Px,y, join- ing c.p(x) to c.p(y) in G' of length at most I. (b): Let d v , d denote the degrees of v in G and in G', respectively. For any v in V(G'), we have We note that for {x,y} E E(G) and path P(x,y) joining x and y in G', we have L d x ::::: ad. XE<p-l(v) (c): Each edge in G' is contained in at most m paths Px,y. (f(x) - f(y))2 ::; IP(x, y)1 E eEP(x,y) f2 (e) ::; I E eEP(x,y) f2 (e) Then we have , , a), I AI::::: 1m ' where f2(e) = (J(x) - f(y))2 for e = {x,y}, and IP(x,y)1 denotes the number of edges of G' in P(x, y). Hence m E f2(e) eEE(G') ::::: E E f2 (e) {x,y}EE(G) eEP(x,y) :::::  L (f(x) - f(y))2. {x,y}EE(G) PROOF. The proof is very similar to that of Theorem 4.12. For a harmonic eigenfunction g of G', we define f : V (G) -+ IR as follows: For a vertex x in V (G), f(x) = g(c.p(x)) - c where the constant c is chosen to satisfy L f(x)d x = O. x 
2: (g(cp(x)) - c))2d x xEV(G) L (g(v) - C)2 L d x vEV(G') <p-l(V)=X 2: a L g(v)2d. vEV(G') Now, for {x,y} E E(G) with cp(x).= u,cp(y) = v, let Px,y denote the path corre- sponding to {x, y} joining u and v III G'. We have (g(u) - g(v))2  IPx,yl L lee)  1 L lee), eEP,tI eEP:.1I wlJ('re g2(c) = (y(a)  y(II))2 for c = {II.,IJ}. lIellce we have m L g2(e) 2: L mi(e) eEE(G') eEE(G') 2: L L g2(e) {x,y}EE(G) eEP(x,y) 2: L L (g(u) - g(v))2 {x,y}EE(G) tt=<p(x) v=<p(y) 66 We note that (4.1) 1. PATHS, FLOWS, AND ROUTING 4.5. COMPARISON THEOREMS 67 by using L f2(X)d x xEV(G) 2: f2(x)d x 2: (g(v) - c)2d. XE<p-l(v) Since L f(x)d x = 0, x we have 2: (I(x) - f(y))2 {x,Y}EE(G) L f2(x)d x XEV(G) 2: AI. Hence , a A, 2: _ I >.., 1/1 and the proof of Theorem 4.14 is complete. o We remark that Theorems 4.3 and 4.5 in Section 4.2 are just special cases of Theorem 4.14 in which G is taken to be a complete graph and G' is chosen arbitrarily. 2: L (g(u) - g(V))2 {tt,v}EE(G') sp L (g(v) - t)2d VEV(G') L (g(u) - g(V))2 {tt,v}EE(G') L (g(v) - c)2d vEV(G') L (Y(lI) - Y(11))2 {tt,v}EE(G') 2: (I(x) - f(y))2 {x,Y}EE(G) We also remark that the generalized version in Theorem 4.14 can often give stronger results for certain problems. For example, we consider the following simple and natural random walk problem on generating sets of groups which arises in computational group theory. EXAMPLE 4.15. Let H denote a graph on n vertices each of which is labelled by an element of a group r. At each unit of time, one of the vertices, say v with label g, can be changed to gf where f or f-1 is a label of a neighbor u of v. Suppose we start with the case that the set of all vertex labels generates the group r. The problem of interest is to determine how rapidly this processes mixes, Le., how many steps it requires to be close to a "random" generating set. 2:  L (I(x) - f(y))2. {x,y}EE(G) Combining inequalities (4.1),(4.2), we have (4.2) A By using Theorem 4.14, we can obtain an upper bound of the form cDn2, where c depends only on the size of r, and D denotes the diameter of If (see [80]). Similar bounds have also been obtained by Diaconis and Saloff-Coste in [102] using more complex comparison techniques. However, all of these bounds are rather far from what is believed to be the truth, namely, that order n log n steps (under total variation distance). In [81], it is proved that in fact this bound is achieved for the case that H = Z2. Interestingly, for relatively pointwise distance, O(n 2 ) is proved to be the correct bound [81]. L f2(x)d x xEV(G) 2: (g(v) - c)2d vEV(G') L (I(x) - f(y))2 {x,Y}EE(G) 2: f2(X)d x xEV(G) Notes 2: 1 ml L (I(x) - f(y))2 {x,Y}EE(G) L f2(X)d x xEV(G) a Path arguments has been used early on to compute isoperimetric constants of a graph. For example, in the early work of Bhatt and Leighton [33] on VLSI design and parallel computation, path arguments were extensively utilized. Jerrum 
68 4. PATHS, FLOWS, AND ROUTING ! S . I . [166] 11sc<!\J at h arp'\II\1('nts to hOl1nd the Checger constant. in order to an( l11C aIr , .- n , . . bound the eigenvalues in their seminal wok of estimatin permanents. DlaC011lS and Stroock [98] used path argument.s to directly bound eigenvalues. Sections 4.3 and 4.4 on paths and routing are mainly based on [7].. Some variations of the comparison theorems in Sections 4.2 and 4.5 can be found 111 [80]. CHAPTER 5 Eigenvalues and quasi-randomness 5.1. Quasi-randomness The isoperimetric properties and eigenvalue inequalities in previous sections are quite effective in dealing with many aspects of graphs with ),1 bounded away from 0, i.e., ),1 :2: C > 0 for some absolute constant c. Basically, such graphs have "small" diameters and "large" vertex and edge expansions. Furthermore, there are "many" paths with "small" congestion joining given pairs of vertices as well as various dynamic routing schemes for sending messages (or pebbles) along the paths simultaneously. The main questions concern how "small" or "large" these quantities can be. Many answers lie in estimating t.hese quantities in terms of eigenvalues. When all ),i are close to 1, the graphs satisfy additional nice properties which wi\I be discussed in this chapter. For example, a random graph has eigenvalues 11 - ),d = O( In ) for i i- O. (Here we can use any model of a random graph [30)). In other words, almost all graphs satisfy 11 - ),i I = O( In ) for all i f O. For sparse graphs with average degree k, the corresponding condition is 11- Ail = O(  ). There is a long history in extremal graph theory for investigating how one graph property relates to another. In recent years, there has been a great deal of development in the study of random graphs, which analyzes the behavior of almost all graphs. These two areas which might seelll t.o be quit.e different, have a great deal of overlap in the following sense: Most graph properties which are satisfied by a random graph are related in a strong way. There is a series of papers [67] [70] [71] [72] [73] [74] [75] [76] [224] introducing a large equivalence class of graph properties, in the sense that any graph which satisfies anyone of the properties must satisfy all of them. Graphs that satisfy these properties are said to be quasi- random. One of the main quasi-random properties concerns the concentration of all nontrivial eigenvalues. So, such an eigenvalue distribution dictates much of the behavior of the graph. As an example, here we i\Iustrate the following list of quasi-random properties for a graph G with edge density 1/2 [76]: PI : max 11 - ),il = 0(1) and G is almost regular (i.e., all except o(n) vertices i#O have degree n/2 + o(n)). P 2 : For each subset S  V(G), the number e(S) of edges of G with both end- 
70 5. EIGENVALUES AND QUASI, RANDOMNESS 5.2. TIlE DISCREPANCY PROPERTY 71 5.2. The discrepancy property point in 5 satisfies e(5) = (ftJ +0(1))n 2 . . Let G denote a graph having a vertex set V with n vertices and an edge set E with e edges. The edge density p is defined to be 2e/n 2 . For subsets X Y c V recall the ottion E(X, Y) as the set of ordered pairs corresponding t edges i one endpomt III X and the other in Y, i.e., E(X,Y) = {(u,v): u E X,v E Y and {u,v} E E}. Here, X and Yare not necessarily disjoint. We denote e(5) = 1512 + 0(n 2 ). P3 : For f'ach subset 5  V(G) wit.h 151 = L i J, P 4 : For u in V(G), let N(u) denote the neighborhood {v: u  v} of u. Na(C u ) = (1 + o(l))(\Ot, e(X, Y) =1 E(X, Y) 1 . For a subset 5 of V, the discrepancy of 5, denoted by disc(G, 5), is defined to be disc(G,5) = le(5,5) - pl5121 The a-discrepancy of G is the maximum discrepancy of 5  V over all 5 with I 5 1= an, where 0 < a ::; 1, i. e., disc(G; a) = max disc(G,5). ISI=lonJ In particular, the discrepancy of a graph G, denot.ed by disc G is just disc G = maxdisc(G;a). o In a certain. sense, the discrepancy is the "quantitative" version of the R.amsey property which asserts that when a is ver y small (  c lo n ) tl e d . , n ,I a- Iscrepancy can be as l.arge as p1512. In general, the problem of determining the a-discrepancy is a ver! difficult problem and is known to be NP-complete. It is therefore of interest to denve upper bounds for the discrepancy using other methods, e.g., by eigenvalue arguments.  n L IN(u) n N(v) - 4 1 = 0(n 2 ). U,v P5(S) : For s :0::: 4 and for all graphs M(s) on s vertices, the number Nc(M(s)) of "labelled" induced subgraphs of G isomorphic to M (s) satisfies Nc(M(s)) = (1 + 0(1))n 5 2-(;). Pa(t): For t.he 2t-cycle C 2t , t :0::: 2, the number Na(C u ) of occurrences of C u as a (labelled) subgraph of G is 2 and e(G):O::: (1+0(1))  . We remark that t.he description of our graph propert.ies typically contain the 0(-) not.ation. The statement P(o(l)) =} P'(o(l)) means that for any ( > 0, there exist.s 8 such that P( 8) =} P' ((). Two propcrties P and P' are equivalent. if P =} 1" and P' =} p, In [76], it was shown that all Pi, i = 1.. .6, are equivalent.. For a subset 5 of the vertex set V of G, we consider the characteristic vector 1f;s, defined by ./, ( ) _ { 1 if u E 5, 'f'S U, - o ot.herwisc. We note that The list of quasi-random properties is still increasing (see [224]) and each new addition further st.rengthens the strong consequences of the equivalence. Although some properties are easy to compute (such as PI, P 4 , P a ), some are (at present) compllt.ationally intractable (e.g. P2, P 3 , P 5 ). We can construct graphs satisfying all the properties by verifying only one property. Thus, this provides a validation scheme for approximating one difficult property by using another equivalent prop- ert.y which is easier to comput.e. It is also desirable t.o havc a quantitat.ive estimate for the error in t.he 0(-) term, which is often the focus of many extremal graph problems. (tf;s, Atf;s) = L L Auv = e(5, 5) uES vES where A is the adjacency matrix of G. Also, the edge density satisfies ( 1 , A 1) p= (1, J1) and The main goal of t.his chapt.er is t.o give a general unified t.reat.ment. of quasi- random graphs. Throughout, t.he eigenvalue propert.y will be cent.ral and the goal will be t.o bound the o( 1) est.imates in each of t.he propert.ies in terms of .5. = max 11 - Ai I, if possible. We will examine several major properties with emphasis ;7'0 on their relations to the eigenvalues. 151 = (1f;s, 1) where J denot.es t.he all 1 's matrix. If 1 is an eigenvetor of A (as is the case for regular graphs), we can then suc- cessflly bound the discrepancy by the bounds on the eigenvalues of the adjacf'ncy matnx. However, for general graphs, 1 is usually not an eigenvector for A. These 
72 5. EIGENVALUES AND QUASI-RANDOMNESS 5.2. TilE DISCREPANCY PROPERTY 73 obstacles can be overcome by considering the eigenvalues of the Laplacian as in the following: THEOREM 5.1. Suppose X, Yare two subsets of the vertex set V of a graph G. Then 2.:>2 = vol G _ (vol X)2 = · vol G il This completes the proof of this theorem. vol X vol X I ' vol G ::; vo X. o vol X vol Y 1 ::; h/ vol X vol Y le(X, Y) - vol G where ,X = maxi,lO 11 - Ai I. In fact, we have shown a slightly stronger result: THEOREM 5.2. Suppose X, Yare two subsets of the vertex set V of a graph G. Then PROOF. Following the above notation, we have e(X, Y) = 1/;x Tl/2(I - £.)T 1 / 2 1/;y. (5.1) le(X, Y) _ vol X V;l Y I vol where ,X = maxi,lO 11 - Ail. ::; ,X vvol X vol Yvol X vol Y vol G Suppose T l/2 ./. - '" b.A.. ff/Y - L-, t'f't, Here we state a few consequences of Theorem 5.1: COROLLARY 5.3. Suppose X is a subset of vertices in a graph G. Then I ( X X ) _ (vol X)2 , < \' vol X vol X < '\ I X e, vol G -.... vol G - .... vo . COROLLARY 5.4. Suppose X is a subset of vertices in a k-regular graph G. Then T l/2 ./. - '" a'A.. 'f/X - L..., t'f't, where 1>i'S are eigenvectors of £. and, in particular, 1>0 = Tl/2 l/ vvol G . Since 1>i, i 2: 1, is orthogonal to 1>0, we have JT 1 / 2 1>i = 0 le(X, X) - k l XI 2 1 ::; k,XIXI. n Therefore, we have disc(X, Y) le(X, Y) - aobol l1/;x A '!fly - aobol Tl/2 JT 1 / 2 l1/;x Tl/2 (I _ £. - ) T 1 / 2 1/;yl vol G We note that Theorem 5.2 is closely related to the edge-expansion properties that we discussed in Chapter 2. If we can find an upper bound for the number of edges both ends of which lie inside a set X, then we can find a lower bound for the number of edges leaving X. Using Theorem 5.2 and Corollary 5.3, we have the following isoperimetric inequality. COROLLARY 5.5. Suppose X is a subset of vertices in a graph G. Then the edge boundary ax satisfies for all i > 1. Also, vol X vol Y = 1/;x Tl/2 (T 1 / 2 JT 1 / 2 ) T 1 / 2 1/;y. lax I > (1 _ ,X) vol X . vol X - vol G PROOF. We consider I L a i b i(l- Ai)1 il vol X = e(X,X) + laxi. By substituting using Corollary 5.3, we have laxi > (1 _ ,X) vol X . vol X - vol G ::; ,X La; L b ; il il ::; - v vol X vol X vol Y vol Y A vol G o La; = vol X i From the statement of (5.1), it is tempting to make a number of conjectures. Some of these questions can be partially answered, but most of them are unresolved. since 1/2 _ vol X 00 = (1)0, T 1/;x) - vvol G Question 1: Suppose a graph G satisfies, fo r some fixed a, le(X Y) _ vol X vol Y I < a vvol X vol Y vol X vol Y , vol G - vol G 
74 5. EIGENVALUES AND QUAS\,RANDOMNESS 5.2. THE DISCREPANCY PROPERTY 75 Is it then true that>. ::; 100a? ., ) I d b 10100 if this IS easier. (Of course, 100 can be rep acc y , Suppose we use Corollary 5,5 so that wc get he :::: inequality from Chapter 2, we have h 2 A l > ...Q > - 2 - where k is the average degree. For such graphs G, the above theorem implies disc(G; 0'):= sup le(X, X) - plXI 2 1 ::; cVkan IX!=an for all X, Y  V(G). for some absolute constant c, I-a 2"" Using Chee'gcr's (1 - 0')2 8 In the book of Erdos-Spencer [120], a lower bound for the discrepancy of any graph G with edge density 1/2 was given by disc G 2: cn 3/2 We therefore have shown that (1 - 0')2 1 - Al ::; 1 - 8 d \ < 100 However, it is evidence This is still quite distant from the desired boun  _ . a. in support of an affirmative answer to the above questIOn. 1 G t' fi es fOI' some fixed a, Question 2: SU]J]JOse a grap I sa IS , . I X I v V vol X vol Y vol X vol Y vo vo 1 I < (5.2) le(X, Y) - vol G - a vol G for all X, Y  V(G). Is it true that disc G ::; 100a? d f II X Y C V ( G ) does the following equality hold: In other wor s, or a ,_ , Vvol X vol Y vol X vol Y le(X, Y) - plXllYl1 ::; 1000' vol G for some absolute constant c. So, the eigenvalue upper bound for the discrepancy is within a constant factor of the best possible value for many graphs. The discrepancy of a random graph can be easily estimated. Here is a sketch of a proof that disc(G; a)  cn 3/2 for a random graph G on n vertices where c is a constant depcnding only on the edge density. Here we assume that the edge density p is a fixed positive quantity when n approaches infinity. Let G denote a random graph with edge density p. We define a function f which assigns the value (1 - p) to every edge of G and the value -p to every non- edge of G. It is easy to see that 1 Lu,vES f(u, v) 1= disc(G, S). Using the Chernoff bound (see [12], pp. 237), the probability that the random graph has discrepancy more than (J satisfies Frob(disc(G;a) > (J) ::; exp(-{J2/(2pa 2 n 2 )). I vol G I ' S til e ed g e clensity of G? w Icre P = -;T , '.' , . t' Wc now construct a graph TI is question can bc anwered 111 the nega IVC,. In fact, the graph satisfyg the above assumption but having a large dIscrepancy. is not even "almost regular." h I A I -!! IBI = !! and AnB = 0. Let H be a graph with vertex set AUB were -?' d J '1, 1 / 2 The h A'II b a random graph with e ge ens I y . The induced subgrap o WI ranom ra h with edge density 1/4. The bipartite induced subgraph on B will be  d g P d 't 1 / 3 It is left as an exercise to h b t A and B will have e ge ensl y . 01 ) subgra P h H e we t n fi S ( 5 2 ) but the discrepancy is large (about cn 2 where c 2: O. . check t at sa IS e ., . h is "almost regular" and it satisfies (5.2), It is of course true that If a grap I ". a necessa r y condition for quasi- . II" Al ost regu ar IS then its discrepancy IS sma '. m f tI. h ter we will examine how the discrep- randomness. 1n the fourth sectIon 0 l1S C p , ancy relates to other quasi-random propertIes, . oximation for the discrepancy of many families Theorem 5.2 gives a good appr d hs (see Chapter 6) and the random of graphs. For example, many expan er .gra p graphs (as described in Remark 1) have eigenvalues - 1 A Vk Therefore the total probability of having some set of size an for which the diserep- ancy is {J is at most ( n ) exp( _{J2 /(2pa 2 n 2 )). an When the above quantity is smaller than 1, there must exist a graph with discrep- ancy no more than {J. Indeed, we can choose {J to be can 3/2 for some appropriate constant c so this is true. The exact expression of c in terms of a and p are not hard to derive. (Hint, try c = a J pH(a) where H(x) is the "entropy" function.) How will the discrepancy disc(G; a) behave when a is small, say, for example, an is smaller than Vii for a graph with edge density 1/2? This, in fact, embodies a wide collection of classical combinatorial problems for the wholc range of subset sizes an, say, from 0 to n, and/or for any edge density. For most of sueh problems, our knowledge is quite limited and the known tools are few. Perhaps the only powerful method is to use eigenvalues to upper bound the discrepancy for regular graphs when a > >. as demonstrated in Corollary 5.4. For general a, such as a < >., the discrepancy disc(n; a) = sup disc(G; a) IV(G)i=n is not well understood. 
76 5. EIGENVALUES AND QUASI-RANDOMNESS 5.3. TilE DEVIATION OF A GRAPH 77 It would be tempting to define discrepancy as I e(X, X) - plXI 2 1 Sp IXI 2 . h we know that any graph on n vertices However, from classical Ramsey I, eor t X of clogn vertices which is either a contains an induced subraph on a su seTh Je(X X) _ plXI21 could be as large complete subgraph or n Independent b s l et. s casbe viwed as a qualitative general- I x 1 2 In a way, dIscrepancy pro em ., b h  . th r The discrepancy is concerned with Induced su grap s t:;:i:sR::::a;e' theory focuses on. the cont.ainment of special subgraphs (which can be small subgraphs with large discrepanCies). db' probabilistic methods. Most bounds like the ones above are prove y USIng. . . th th e . . th' erformance In companson WI , ExP d licit const h ,ruct T io ll r e lsr::u;:erf;e: to :vral exceller:t papers and surveys by ran om grap s. f " ( a ) _ Jumbled" [234 235 236] on this subject under the name 0 P, . T:O;or th lowr range of a, tIe discrepancy prolems are basic Ramsey ;roblems which we will discuss briefly In the next subsectIOn. EXAMPLE 5.6. Let q be a prime power. The graph G will have vertex set V = {F  {I,,,, ,m}: 1 F 1= q2 -1} and edge set E = {(F,F'): 1 FnF' I -1( mod q)}. A result in [130] implies that G contains no clique or independent set of size (q: 1)' By choosing m = q3, we obtain a graph on n = (q2r 1) vertices containing no clique or independent set of size ec(log n log log n)I/2. 5 2 1 TI Ramsey property. A fundamental result of Ramsey [215] gar- . .. Ie ) h I, n ra h on n > R(k, e) vertrces antees the existence of a number R(k,  so I, a a. y d g p d t scl of size e. The ., I t graph of size k or an In epen en contaInS erther a comp e e . . I <l'ffi It The first non-trivial lower problem of determining R(k, f) IS noto.nous y I lCU, , bound for R(k, k), due to Erdos [111] In 1947, states 1 k/2 (5.3) R(k, k) > (1 + 0(1)) eV2 k . 2 . . I rtices which contain no cliques or inde- In other words, there exrst grap IS .on n ffi v: tl large The P roof for ( 5.3) is simple f' 2 I n when n rs su clen y , per d lde l nt set t s 0 d SI s e b a:d on the observation that the probability of having a clique an e egan ,an I, ( k ) . k . t t ( n ) 21- 2 . We see that if this quantity or independent set of size IS a, mos k' is less than one, there must exist a graph without any clique or independent set of size k. This basic result plays an essential role in laying the fouations for. both m- sey theory and probabilistic methods, two of the rajo: thnvIngnre::: ;mr:d t . Irl th e 40 Y ears since its proof, the bound In (J.3) has 0 y p ,oncs. ,. [ 229 ] by a factor of 2, again by probabilistic arguments ' Attempts have been made over the years to construct good graphs (ib' t:itl h small cliques and independent sets) without much success [74, 144] f ' .L \g 2 IO! 5] . 'th r and independence sets 0 srze cn . gave a recursive constructIOn. wr c Iqes h . t r/3 A breakthrough finally [ 1 ] nstructron reducIng t e size 0 cn . Nagy 20 gave a co 'th th result of Frankl [128], who gave the first Ramsey occurred several years ago WI e f . 11 than n1/k for any k. . 'th Ii ues and independent sets 0 srze sma er constructron WI .c q d c(logn)3/4(loglogn)I/4 in [64]. Here we will outline Th' as further Improve to e . r d rs W t t . of Frankl and Wilson [130] for Ramsey graphs with c rques an a cons ruc ,Ion 1/2 . t c(log n log log n) independent sets of size at mos e The proof involved in the above construction is based on a beautiful result of Ray-Chaudhuri and Wilson [217] on intersection theorems. This type of inter- section graph and the related intersection theorems provide excellent examples for many extremal problems including the discrepancy problems. A graph which has often been suggested as a natural candidate for a Ramsey graph is the Paley graph (see more discussion in Section 6). Very little is known about its maximum size of cliques and independent sets. For the lower bound, a result of S. Graham and C. Ringrose [145] shows that infinitely many Paley graphs on p vertices contain a clique of size clogp log log logp. (This contrasts with the trivial upper bound of cvp.) Earlier results of Montgomery [199] show that assuming the Generalized Riemann Hypothesis, we would have a lower bound clogploglogp infinitely often. If we take the Ramsey property as a measure of "randomness," the above results show that the Paley graphs deviate from random graphs. There is no question that the problem in constructive methods for which a solution is most widely sought is the following, posed long ago (as early as the 40's) by Erdos: Problem,' Construct graphs on n vertices containing no clique and no independent set of size clog n. Instead of focusing on the OCcurrence of cliques and independence sets, similar problems can be considered on the occurrence or the frequency of other specified subgraphs [35, 146, 219, 249]. It is not difficult to show that almost all graphs contain every graph with at most 2 log n vertices as an induced snbgraph. The best current constructions containing every graph with up to c vertices as induced subgraphs can be found in [73, 129]. 5.3. The deviation of a graph We have discussed various aspects of the discrepancy of a graph. In spite of the important role discrepancy plays in various extremal problems', one major challenge is that discrepancy is difficult to compute since its definition involves taking the extremum over all choices of subsets with potentially exponentially many cases. Here we will consider another invariant, the so-called deviation of a graph. Although its definition seems to be more complicated, it can be easily computed in polynomial time. Furthermore, deviation is very closely related to discrepancy and it can be used to prove upper and lower bounds for discrepancy. 
78 5. EI(;ENVALLJES AND qlJASI-IIANIJ()MNI';SS PROOF, 5.:!. TilE IJEVIATION OF A GilAI'll 79 For a graph G with edge densit.y p, we define a weighted indicat.or function X : V x V -t JR. as follows: " 1 1 6 (- --) VEV(G) Pv P x(x,y) = { 1 - P -P if x  y otherwise, For a 4-cycle C, we denot.e x(C) = II X(x, y) {x,y}EC and we define the deviation of G by For PA = L Pv/IAI, we have v dev G 1 44 L X(C) P n C 1 44 L X(x, y)X(y, z)X(z, w)x(w, x) pn x,y,z,w ,,1 1 6(- --) vEA Pv P Therefore, where x, y, z, w range independently over all vertices of G. For the special case of p = 1/2, t.he deviat.ion is exactly 1/16n 4 times t.he number of "even" 4-cycles minus t.he number of "odd" 4-cycles. (A 4-cycle {x,y,z,w} is said t.o be "even" if X(x,y)x(y,z)X(z,w)x(w,x) is positive.) Before we derive relations between deviation and eigenvalues, we want to give a quantitative measure of regularity and irregularit.y in a graph. (Recall that "almost regular" means that all but o(n) vertices have degree wit.hin (1 +0(1)) of the average degree of the graph). We define the irregularity of a graph G, denoted by irr G as follows: . P " 1 1 zrr G := - 6 (- - -) n vEV(G) pv P Therefore we have L 2.(1- PV )2 vEV(G) Pv P 2: L 2.(1- PV )2 vEA Pv P L ( 2. _  + PV ) vEA Pv P p2 vol A - IAlpn ,,1 1 2 +6(---)' P n vEA Pv P ,,1 1 6 (- - -) 2: 0, vEA Pv PA L(2. - J.. + J.. _) vEA Pv PA PA P 2: L(J..-) vEA PA P IAI. (J.. -) PA P IAI( lAin _ ) vol A P (IAlpn - vol A) P vol A IAI- L (2. _) > (vol A -IAlpn)2 vEV(G) Pv P - p 2 n vol A where IV(G)I = n, pv = dv/n, and P = L d v /n 2 . The lemma is proved. The smaller the value of irr G is, the more closely the graph G approximates a regular graph. When irr G = 0, G is regular, as shown by the following useful lemma. The discussions and t.echniques in this section can be greatly simplified if we only consider regular graphs. However, in t.he same spirit of preceding sections, we consider a general graph for completeness. o The above lemma implies the following useful facts: COROLLARY 5.8. LEMMA 5.7, For any A  V(G), we have I vol A -IAlpn I:-S: Virr G vol G for all A  V(G). LEMMA 5.9. L (_ 1 _ _ 1 ) > (vol . A -IAlpn)2 for any A  V(G). (Iv (I - (l 2 n vol A vEV(G) ,,1 1 n sup 16(- - -)I:-S: -(irr G + Virr G ) AC;:;V(G) vEA Pv P P 
80 5. EIGENVALUES AND QUASI-RANDOMNESS 5.4. QUASI-RANDOM GRAPHS 81 PROOF. From the proof of Lemma 5.7, we have 1 1  1 1 IAlpn - vol A L(---)  L..J (---)+ 2 vEA pv P vEV(G) pv P P n n J pn 2 vol A irr G  -irT G + 2 p P n !!.irr G + !!. virr G . p p whose eigenvalues are exactly 0 and 1 - >"i for i = 1,... ,n - 1. Considering the trace of M 4 , we obtain L(1 - >"i)4 = tr(M 4 ). i;iO On the other hand, it is easy to check that (5.4) M(x, y) = X(x, y) , pn Therefore, Lemma 5.9 is proved. o Hence, The deviation dev G can be expressed in the following form. tr(M 4 )  X(x,z)X(y,z)X(x,w)X(y,w) L..J p4n4 x,y,z,w dev G THEOREM 5.10. dev G =  L(IN x n Nyl - p 2 n)2 p n x,y wher'e N x = N(x) = {y; y  x} and d x = INxl. o THEOREM 5.12. For any graph G, we have dev G  L(1 - >"i)4 + 20 Virr G . i;iO PROOF. p 4 n 4 dev G p 4 n 4 dev G = L(IN x n Nyl -In)2 The proof is essentially the same as the proof above, but somewhat messier. We will skip the proof here. So, we see that small 5. and the condition of being almost regular together imply that the deviation of G is small. From Theorem 5.10, small deviation in turn implies that for almost all x,y, N x n Ny is close to the expected size p2n. Since the count of (labelled) 4-cycles as subgraphs is exactly Lx,y IN x nN y l 2 , small dev G implies that this count is close to the expected number of such subgraphs in a random graph with the same edge density. While the deviation is very effective in dealing with graphs with large edge density, we point out here that for sparse graphs (for example, graphs with no 4-cycles), the deviation is not as useful. Still, for dense graphs, the deviation is quite powerful. For example, all of the quasi- random properties in the list in Section 5.1 are implied by the deviation property since, in fact, dev G = 0(1) can also be added to the list of (equivalent) quasi- random properties. The interrelations of various quasi-random properties will be discussed in the next section. L X(x, z)X(y, z)X(x, w)X(z, w) x,y,z,w L(L X(x, z)x(y, Z»2 x,y z LIiN x n Nyl(l - p)2 - (IN x n Nyl + IN x n N y J)p(l - p) = x,y +IN x n N y lp2] For fixed x, y, we have - - - 2 IN x n N y l(l - p)2 - IN x n N y lp(l - p) - IN x n N y lp(l - p) + IN x n Nylp (IN x n Nyl- p 2 n)2 - (INxl- pn)p - (lNyl- pn)p. Therefore we have x,y and Theorem 5.10 is proved. o 5.4. Quasi-random graphs The above Theorem is useful for relating the neighborhood property (e.g., P 4 ) to the deviation property. THEOREM 5.11. For a regular graph G, we have dev G = L(1- >"i)4 i;iO To simplify the discussion, we assume that all graphs G in this section are almost regular, Le., (Pr) PROOF. We consider the matrix M :.= I - L - TI/2 J(T I / 2 }* vol G P 1 1 irr G = - L (- - -) = 0(1) n vEV(G) Pv P where pv = dv/n, p = L d v /n2 and IV(G)I = n. Our goal here is to derive equivalence relations between various graph invariants and the eigenvalue property: 
82 5. EIGENVALUES AND QUASI-RANDOMNESS 5.4. QUASI-RANDOM GRAPHS 83 (Pe) or ,\ = max 11 - Ad = 0(1) ito sup le(X,X) - plXI 2 I. xC:;;V(G) These two quantities are bounded from each other to within a constant factor since where Ai's are eigenvalues of the Laplacian of G. Some directions of these relations have already been proved in th previous sections, Here we first consider bounding the discrepancy of a graph by A by using Theorem 5.1. THEOREM 5.13. For a graph G, the discrepancy of G satisfies disc G :<:; (,\ + 2 Virr G )vol G where ,\ = maXitO 11 - Ai I. e(X U Y, Xu Y) = e(X, X) + e(Y, Y) + 2e(X, Y). So we will use whichever version that is convenient for the proof, always allowing for a constant factor. Proof of Theorem 5.13: From Theorem 5.2, we have (vol X)2 _ le(X, X) - I < Avol X. vol G - To prove Theorem 5.13, we need to say a little more about quantities associatd with being almost regular. As we recall, the irregularity irr G of G was defined III connection with the proofs involving deviation. A simplcr definition could be the variance Therefore, disc G sup le(X, X) - plXI 2 1 xC:;;V(G) var G = -+ 2)p" - p)2, P n " Ostensibly, the variance var G goes to zero if and only if irr G does. It would simplify our discussion if these two quantities were "equivalent" in the sense that "var G < CI irr G" and "irr G :<:; C2 var G" for some constants c, and C2. However only the-first of these two relations is true (5", a star on n vertices serves as a example.) In addition, the statement of Theorem 5.12 will not hold if we rplace irr G by var G. This dictates then our choice of taking the upper bound as lrr G. LEMMA 5.14. For positive reals a".. ' ,a" with average a, we have " " 1 1  2)ai - a)2 :<:; f!: 2) - - -). a 2 n 2 i=! n i=1 ai a :<:; ( vol X ) 2 ( vol X ) 2 sup le(X,X)- 1+1 - IXI 2 1 XC:;;V(G) vol G vol G p - (vol X)2 Avol X + 1 - p1X1 2 1. vol G :<:; From Lemma 5.7 we have (vol X)2 1 1 2 -pX pn 2 + pnlXI) (vol X - pnlXI) 2 (vol X pn :<:; 2(vol X - pnlXI) :<:; 2 Vvar G .pn 2 :<:; 2 Virr G . pn 2 . The proof of Theorem 5.13 is complete. o The proof is straightforward, Consequently, we have var G :<:; irr G. In fact, for any subset X of V(G), we have (5.5) var G 2: -+ L (p" - p)2 P n "EX 2: p2n X 1 ((p" _p))2 1 (vol X _ pnlXI)2 p 2 n 3 I X I Before we proceed to prove Theorem 5.13, we remark that there are two possible ways that we could define discrepancy: sup le(X, Y) - pIX!IYII xYC:;;V(G) We remark that we can replace irr G by var G in the statement of Theorem 5.13 by using (5.5). Theorem 5.13 indicates that the eigenvalue property Pe and the almost regular property imply the discrepancy property: (P disc ) disc G = o(vol G). In other words, Pe + Pr =? P disc . We will denote the deviation property as follows: (P de " ) dev G = 0(1). From Theorem 5.12, we have Idev G - L(1- Ai)11 :<:; 20 Virr G . ito 
84 5. EIGENVALUES AND QUASI-RANDOMNESS As a consequence of the above inequalities and the fact that ,\4 :S L(l - Ai)4, ito h P + I'  P To com p lete the equivalence of the three propert.ies we ave dev r ---r e' Pc + P r , Pdisc + Pr, P dev + Pr, we will prove THEOREM 5.15. For a graph G, we have disc G:S pn 2 (dev G)I/4, 5.4. QUASI-RANDOM GRAPHS 85 Similarly, L Id - pdxl =1 e(N x , X) - pdxlXII:S disc G zt1,X Therefore L(d - d x p)2 ::; 2n disc G y d G < disc G + 2 var G ::; disc G + 2 irr G. ev - p 4 n 2 p 4 n 2 and p 4 n 4 dev G L X(x, Y)X(y, z)X(z, w)X(w, x) W x L(IN x n Nyl - p 2 n)2 y < L 2(IN x n Nyl - p 2 n)2 + 2n(pd x - p 2 n)2 y ::; 4n disc G + 2p 2 n 3 (px _ p)2. PROOF. First we consider, for X, Y C V, X,y,Z,IV L(L X(x, y)X(y, Z))2 X,z Y Hence > L (LX(x,y)X(y,Z))2 x,zEX y p 4 n 4 dev G ::; L W x ::; 4n 2 disc G + 2p 2 n 2 var G. x > ; 2 ( L L X(x, y)X(y, Z))2 1 I x,zEX Y 11 1 2 (L( L x(x, y)n 2 y xEX 11 1 2 (L(L x(x,y))2)2 yEY xEX IXI 21 1YI 2 (L L x(x, y))4 yEY xEX IXI 21 1 Y l 2 (e(X, Y) - plXIIYI)4 o 2: > We have so far proved the equivalence of the discrepancy, deviation, and eigen- value properties for almost regular graphs. In fact, all of the properties PI, ['2, P 3 , P 4 have been covered for graphs with edge density 1/2. As for the property ['5(S), for any graph M(s) on s vertices, s 2: 4, the number N(j(M(s)) of occurrences of labelled induced subgraphs of G isomorphic to M(s) satisfies N(j(M(s)) = (1 + o(l))n s TGJ. The proof of the equivalence of P 5 (s), for s 2: 4, with the other quasi-random properties is somewhat complicated and can be found in [76]. A quantitative version was proved in [74]. The difference of Nc(M(s)) and its expected value can be bounded by a function of the deviation of G. Namely, for a graph G with edge density 1/2, we have > This implies disc G:S pn 2 (dev G)I/4, INc(M(s)) - nSTGJI ::; nS(dev G)I/4. For the second inequality, we consider the deviation of G using Theorem 5.10: p 4 n 4 dev G = L(IN x n Nyl - p 2 n)2. x,y This property is quite strong in the sense that quasi-randomness implies that if 4 a graph G with edge density 1/2 contains (1 + 0(1)) 76 C4 's as labelled subgraphs, then G contains the expected number of Petersen graphs (as well as any graphs of a fixed size), On the othcr hand, there are examples of graphs containing the corrcct number of all subgraphs on 3 vertices but which nonetheless fail to be quasi-random. For a fixed x, we consider W x = L(IN x n Nyl- p 2 n)2. y We note that IN x n Ny! is exactly the number d = le(, Nx)1 o edg,es from y to the set N x . We consider the set X consisting of the vertices Y wIth d y :S pd x . We have L Id - pdxl =1 e(Nx,X) - pdxlXII:S disc G. yEX Notes: Quasi-randomness resides at the intersection of extremal graph theory and ran- dom graph theory. The original paper [76] (also see [72, 224]) on quasi-random graphs provides a general framework for examining the relationships of combina- torial structures as well. There are several papers on quasi-random hypergraphs [67, 70, 74, 77] and their connection with cohomology [78] and communication complexity [88]. Work has also been done on qua.i-random sequences, subsets 
86 5. EIGENVALUES AND QUASI-RANDOMNESS [75] and tournaments [71]. Many questions on the quantitative analysis of the 0(') terms remain open. CHAPTER 6 Expanders and explicit constructions 6.1. Probabilistic methods versus explicit constructions Many problems in combinatorics, theoretical computer science and communi- cation theory can be solved by the following probabilistic approach: To prove the existence of some desired object, first an appropriate (probability) measure is de- fined on the class of objects; second, the subclass of desired objects in question are shown to have positive measure. This implies that the desired objects must exist. This technique, while extremely powerful, suffers from a serious drawback, Namely, it gives no information about how one might actually go about explicitly constructing the desired objects. Thus, while we might even be able to conclude that almost all of our objects have the desired property (that is, all except for a set of measure zero), we may be unable to exhibit a single one. A simple example of this phenomenon from number theory is that of a normal number. A real number x is said to be normal if for each integer b 2: 2, each of the digits 0, 1, . . . ,b - 1 occurs asymptotically equally often in the base b expansion of x. It is known that almost all (in Lebesgue measure) real numbers are normal, but no one has yet succeeded in proving that any particular number (such as 7r, e or h) is normal. One of the earliest examples of the above probabilistic method is Erdos' clas- sical result [111] from 1947 on the existence of graphs on n vertices which have maximum cliques and independent sets of size 210gn (see Chapter 5, Section 2). Since then, probabilistic methods have been successfully used in a wide range of areas. However, in spite of the success of probabilistic methods, there is a clear need for explicit constructions, especially for applications in algorithmic design and in building efficient communication networks. In the past ten years, substantial progress has been made on explicit construc- tions of so-called expander graphs. Although the developments in constructing expander graphs were first motivated by applications in communication networks, it has become one of the most powerful tools in complexity theory, parallel ar- chitectures, distributed computing, derandomized algorithm, and the list goes on [30, 120, 205]. Still, we have not yet rigorously defined "explicit constructions" versus "random graphs." So, some explanations are in order. When we mention random graphs, some probability distributions are involved. For example, a typical model for graphs on n vertices is to assign equal probability to each of the 2(;) possible graphs on n (labelled) vertices. We say a random graph G on n vertices satisfies property P if all except for 0(1) of the graphs satisfy P where the 0(1) term goes to zero as 
88 6. EXPANDERS AND EXPLICIT CONSTRUCTIONS 6.2. THE EXPANDERS 89 n approaches infinity. On the other hand, by an explicit construction, we mean a deterministic description from which we can construct a graph on n vertices with the number of steps polynomial in n, for infinitely many n. In other words, an explicit construction is a polynomial time algorithm for defining a graph. In fact, all of the explicit constructions we describe have very short descriptions. This, of course, is just one possible interpretation of "explicit construction". What is an expander graph? Roughly speaking, in an expander graph, any "small" subset of vertices has a relatively "large" neighborhood. We will leave the detailed description of the quantitative definitions of "small" and "large" until the next section. Conceivably, an expander graph can allow us to build networks with guaranteed access for making connections or routing messages. theory, network theory, theoretical computer science and various mathematical ar- eas such as number theory, representation theory, and harmonic analysis. Perhaps, because of the large number of different applications in disparate settings, the def- initions of expansion-like properties vary from one situation to another, often with a variety of names such as expander, magnifier, enlarger, generalizer, concentrator, and superconcentrator, just to name a few. To make matters worse, most of these definitions involve a large number of parameters. One typical example, namely the definition of a concentrator, is as follows: An (n, e, k, a, ,B)-concentrator is a bipar- tite graph with n inputs, en outputs and k n edges, such that every input subset A with I A 12 a n has at least ,B n neighbors. It is conceivable that such tedious definitions actually hindered early progress in this area. 1, Validating a random constr'uction. One of the shortfalls of the probabilistic method is that it only guarantees the existence of an expander. A random graph, which is usually generated by using a random source (e.g, flipping a coin, etc.), has high probability being an expander. Since eigenvalues can be computed easily (in polynomial time), we can validate the randomly generated graph by computing its eigenvalues and the associated expander constants. While the probabilistic method does not guarantee the gen- eration of expanders, it assures us that with high probability (say, within a few tries) we can obtain graphs whose performance in expansion is backed up by the eigenvalue bounds. The expansion property basically means each subset X of vertices must have "many" neighbors. That is, the neighborhood set N(X) = {y : y is adjacent to some x EX} is "large" in comparison to the size of X. The difficulty lies in finding a good way to define "many" or "large," quantitatively. There is an obvious scenario in which the subset S is almost the entire vertex set and the vertex boundary 8(S) = N(S) - S is very small. The typical definition of expander graphs is as follows: A regular graph G on Tn vertices is a c-expander if every subset S of V (G) satisfies The key to the success in constructing expander graphs is its relationship with eigenvalues. Such a relationship can be used in two ways. 18(S) 12 c (1 - I  I ) I S I . Here the constant c is often called the expander coefficient. 2. Constructing large families of expanders. A general eigenvalue lower bound can often be used to establish a whole family of expander graphs. In particular, algebraic and number-theoretic techniques can be used to bound the eigenvalues for special (infinite) families of graphs, Another way to define the expansion factor is as follows: , 18(S)1 c = sup SC;V(C) ISI .ISI/n In the next section we will discuss various notions of expansion properties and their relations to eigenvalues. A variety of examples and explicit constructions will be given including Paley graphs, coset graphs, Margulis graphs, and Ramanujan graphs. In Section 6.4, we describe some classical applications of expanders to communication networks and we illustrate how to use expander graphs to create various building blocks for these networks. In Section 6.5, we discuss constructions for graphs with small diameter and girth. In the last section, we consider an extremal invariant of a graph which depends on the maximum eigenvalues of all possible weighted Laplacians. This invariant is closely related to Lovasz's {} function and it can be computed in polynomial time. We will describe its relationship to the chromatic number and clique number of a graph. We remark that this definition is somewhat unsatisfactory for certain problems since the expansion factor c' and the degree k are intimately related. For example, a random regular graph of degree k has an expansion factor of roughly k when the subset is small. The values of c and c' should be judged in comparison with a function of k. In such cases, it works out better to formulate the lower bound for 18(S)1 directly in terms of eigenvalues. The expansion factor c' is closely related to the Cheeger constant. In particular, for a regular graph G, , 1 , c > gc > -c - - 2 6.2. The expanders vol8S . where gc := infs . ( I S IS) ' as defined m Chapter 2. mm vo , vo The expansion property is crucial in many applications [24, 172, 180, 208, 209, 206, 237, 242] and has become a driving force for recent progress in construc- tive methods. Success here is due, in large part, to a combination of tools from graph The expansion of G is closely related to the discrepancy of G in the follow- ing sense: The discrepancy property implies every subset S contains close to the expected number of edges; therefore there are "many" edges leaving S. 
90 6. EXPANDERS AND EXPLICIT CONSTRUCTIONS 6.2, THE EXPANDERS 91 Another related invariant is the isoperimetric number [45, 197], denoted by i(G), and defined by i(G) = min I {{u,v} E E(G): u E 5,v f/. S} I sCN,lsl< 151 The so-called conductance is 1/ k times i( G) for a k-regular graph G [166]. Clearly, for a k-regular graph, we have also i(G) 2: k/2 - 2 disc(G). LEMMA 6.2. Suppose G is not a complete graph. For S <;;; V(G), the neighbor- hood N(S) satisfies vol N(5) 1 > vol 5 .\2 + (1 _ .\2) vol 5 vol G 1 1 _ (1 _ .\2) vol 5 vol G where .\ = maxi;io 11 - Ai I. We will give simple proofs which establish eigenvalue upper bounds for the expansion coefficient. Although the problem of checking whether a graph is an (n, k, c)-expander is co-NP-complete [29J,the following relationship provides an ef- ficient method to estimate the expansion and discrepancy of a graph. In Section 3,2, a similar bound was derived by examining the relation between diameter and eigenvalues. LEMMA 6.1. 1"07' II gmph G llnd S <;;; V(G), the VC7.tex 1J01tndar'y 8(S) = {x t/. S : x  yES} satisfies PROOF. In the proof of Theorem 3.1, suppose that we choose Pt(L) to be I - l- and Y = V(G) - N(X). Then we have o = (TI/2'1j;y,pt(L)TI/2'1j;X) vol X vol Y - v vol X vol X vol Y vol Y > -A vol G vol G Thus vol O(S) vol 5 2: A(2 _ A) vol S vol G 1 _ A(2 _ A) vol 5 vol G 2: A(2 _ A) vol S vol G .\2vol X vol Y > vol X vol Y. For Y = N(X), this implies vol N(S) 1 vol S > A 2 + (1 _ .\2) :  1 1 - (1 - .\2 ) vol S . vol G where A = 2At/(An-I + Ad, In other w01'ds, G is a A(2 - A)-expander. o PROOF. It follows from Theorem 3.1 and Lemma 3.4 of Chapter 3 that vol oS 1 - (1 _ A)2 -> . vol S - (1 - A)2 + vol S/val 5 By straightforward calculation, we get vol O(S) vol S For regular graphs, we give a direct proof here. LEMMA 6.3. Suppose G is a regular graph on n vertices and G is not a complete graph. For 5 <;;; V(G), the neighborhood N(5) satisfies 2: (2A - A2)vol S (1 - A)2vol S + vol S A(2 _ A) vol S vol G 1 _ A(2 _ A) vol S vol G 2: A(2 _ A) vol S vol G IN(5)1 > 1 ISI .\2 + (1 _ .\2)  where .\ = maxi;iO 11 - Ai I. 1 (1 - (1 _ .\2 ) vol S vol G PROOF. For 5 C V(G), we consider the characteristic function 'lj;s: as desired. o 'lj;s(x) = {  We consider the following inner product: if xES otherwise For a graph G and S <;;; V(G), we recall that the neighborhood N(S) of a subset S is defined as follows: ('Ij;sA,A'Ij;s)/k2 .LaW - Ai)2 N(S) = {x : x  YES}, < a + (.L an.\2 i;:: 1 Note that S is not necessarily contained in N(S). We consider the following varia- tions of the expander lower bounds: (6.1)  (1 _ .\2) 15 2 1 + .\2151. n 
92 6. EXPANDERS AND EXPLICIT CONSTRUCTIONS 6.3. EXAMPLES OF EXPLICIT CONSTRUCTIONS 93 On the other hand, Together with ('Ij;sA, A'Ij;s) L L I {w : {v, w} E E and {u, w} E E} I tiES YES ('Ij;sM., M'Ij;s) L L I {w: {v,w} E E and {u,w} E E} I tiES yES LIN(w)nSI 2 . wEV LIN(w)nSI 2 wEY LIN(w)nSI 2 > wEV (LWEV I N(w) n S 1)2 I N(S) I IS 2 1 k2 I N(S) I' (LwEV I N(w) n S 1)2  I N(S) I ISI 2 k 2 I N(S) ,. Combining this with (6.3), we have I N(S) I> ISI . - (1 - p2)411 + p2 Applying the Cauchy-Schwarz inequality, we have: Combining this with (6.1), we obtain o (6.2) I N(S) I > 151 IS' . (1 _ p2)  + p2 o We remark that if we consider the following modified matrix M for a bipartite graph (not necessarily regular), then the above proof works in a similar way. We define 1 M(u,v) = IT yd y For a bipartite graph, we can have a modified version for the expander theorem. For a bipartite graph G with vertex set xu l' and edges between X and Y, the incidence IIlatrix Jl1 = Jl1 (G) has colulllns indexed by vertices in X and rows indexed by vertices in Y. For x E X and y E Y, the matrix 1\.1 satisfies M (x, y) = 1 if and only if {x, y} is an edge. A bipartite expander graph depends on the eigenvalues of M. M as follows: LEMMA 6.4. For a bipar.tite graph G with ver.tex set Xu Y and edges between X and Y, suppose all vertices in X have the same degree. For a subset S of X, the neighborhood N(S) satisfies: LEMMA 6.5. For a bipartite graph G with vertex set Xu Y and edges between X and Y, and for a subset S of X, the neighborhood N(S) satisfies: IN(S)I 1 1 -> ISI - p2 + (1 - p2)411 ( 1 _ P 2 ) vol 5 vol G where p2 is the second largest eigenvalue of M. M. We remark that the inequalities in Lemmas 6.4 and 6.5 are strict if the eigen- values except for the largest are not all equal. IN(S)I 1 -> ISI - p2 + (1 - p2)411 1 ( 1 _ P 2 ) vol S vol G 6.3. Examples of explicit constructions where p2 k 2 is the second lar'.qest eigenvalue of JI{. JI{ where JI{ bipartite adjacency matrix defined above. M(G) IS the We will describe several useful families of expander graphs. For each construc- tion, the precise value of a bound for the eigenvalues will be discussed. Together with the theorems in Section 6.2, these constructions yield good expanders. We will begin with graphs with edge density about  and then proceed to graphs with lower edge density, say  for fixed k. Construction 6.3.1. The Paley graph Pp. Let p be a prime number congruent to 1 modulo 4. The Paley graph consists of p vertices, 0,1,2, . .. ,p - 1. Two vertices i and j and adjacent if and only if i - j is a non-zero quadratic residue modulo p. The eigenvalues of P p are exactly 1 - L e 2..2 /(p - 1) xEZ; PROOF. Suppose every vertex in X has degree k. Let PT denote the eigenvalues of 1\.1. M. We denote the largest eigenvalue of M. M by p = k 2 . Let the ai's denote the Fourier coefficients of characteristic function 1/15 with respect to the eigenfunctions of M. M. We consider the following inner product: (6,3) :2 ('Ij;s1\.1., JI.f'Ij;s) L aT fiT < (I - fl2) + (12151. rl. 
94 6. EXPANDERS AND EXPLICIT CONSTRUCTIONS 6.3. EXAMPLES OF EXPLICIT CONSTRUCTIONS 95 for each j = 0,'" ,p - 1. These are closely related to Gauss sums modulo p (see [165]). In particular, it is known that for any j t= ° (mod p), the Gauss sum L E Z. e2';{z!.. is either vIP - 1 or -vIP - 1. x p Therefore the eigenvalues of the generalized Paley sum graphs Pp,r,t satisfy Al 2: 1 - (r - 1)1 + 1 , A n -l  1 + (r  1)1 + 1 . p- p- Therefore, we have In the other direction, Paley graphs can be generalized to the following coset graphs on n vertices with edge density n-I+t for any positive integer t (see [51]). Construction 6.3.4. The coset graphs Cp,t. We consider the finite field GF(pt) and a coset x + GF(p) for x E GF(pt)  GF(p) (x). There is a natural correspondence between elements of the multiplicative group GF*(pt) and elements of {1,'" ,pt - 1}. For example, choosing a generator g, each element y in GF*(pt) corresponds to the integer k for which y = gk. Now we consider the coset graph Cp,t with vertices 1,. .. ,pt - 1 = n, and edges {a, b} if a + b is in the subset X of integers corresponding to the coset x + GF(p). The eigenvalues of the coset graph Cp,t are LaEX (}a for () ranging over all nth roots of 1. Al vIP- 1 1- 2(p-1)' v'P+ 1 1 + 2(p-1)' Al'1 The Paley graph is a favorite and frequently cited example in extremal graph theory, no doubt due to its many nice properties the existence of which are guar- anteed by eigenvalue bounds. For example, P p contains all induced subgraphs on cy'lOgJ) vertices (see [35]; also implicit in [146]). Construction 6.3.2. The Paley sum graphs Pp. The Paley sum graphs are basically the symmetric versions of Paley graphs without the constraint p == 1 (mod 4). Let p be any prime number. P p has vertices 0,'" ,p- 1 and two vertices i and j are adjacent if and only if i + j is a quadratic residue rr:odulo p. The eigenvectors for Paley graphs are rPj where rPj(k) = e27rijk, for j = 0, . . . ,n - 1. For sum graphs, the eigenvectors are (1 - Aj) rP-j rPj + y(l - Aj)(l - A-j) Bounding the eigenvalues of coset graphs leads to a natural generalization of WeiI's character sum inequality [165]. The following inequality was conjectured by the author [51] and proved by Katz [170] and others [181,183]. If(} is a (pt-1)-th root of 1 and () ¥ 1, we have I L (}a I (t - l)ViJ, aEX where X is the coset x + GF(p). where Aj is the eigenvalue for the eigenvector rPj of the Paley graph. Therefore the eigenvalues for the sum graphs are exactly 1 :!: y l(l - Aj)(l - A_j)l. For p == 1 (mod 4), the eigenvalues of the Paley sum graph is the same as those of the Pley graph. For p == 3 (mod 4), the eigenvalues of the Paley sum graph are 0, 1 - 2yp=T (with multiplicity ) and 1 + 2 (with multiplicity ). The Paley graphs and Paley sum graphs both have edge density about . They can be generalized to graphs with edge density  for any fixed constants t and r with t < r. Paley sum graphs are actually a special case of the following: Construction 6.3.3. The generalized Paley sum graphs Pp,r,T. For a fixed integer r > 0, let p = mr + 1 be a prime congruent to 1 mod 4 and let T c Z* consist of t non-zero residues so that for any distinct a, bET, ab- I is not p an rth power in Z;. The generalized Paley graph has vertex set {O, 1"" ,p - 1}. Two vertices i and j are adjacent if and only if i + j = aq for some a E T and q an rth power. The eigenvalues are Aj = (1 - L L e27rijax2)/(p - l)t, aET xEZ; The coset graph has edge density n 1- t , and the eigenvalues satisfy Al > 1-!.=l - v'P and A n -l  1 + t;;i . Construction 6.3.5. The Margulis graphs M n . In the early 70's, Margulis [192] ignited an entire movement toward the study of constructive methods by relating Kazhdan's property T to expanders. This approach was successfully continued by Gabber and GaIiI [137] who obtained ex- plicit values for estimating the expander constant. Here we illustrate some of these early constructions of these very elegant graphs, which we call Margulis graphs [8, 137, 192]. Set n = m 2 and V = Zm X Zm. Consider the following six transfor- mations from V to itself: I L e27rijX21  (r - l)ViJ. xEZ p 0'1 (x, y) 0'2 (x, y) 0'3(X,y) 0'4(X,y) 0'5(X,y) 0'6 (x, y) (Addition here is modulo m.) Let G = M n = (V, E) be the graph with vertex set V and with edges {u, v} if u = O'i(V) or v = O'i(U) for some i. (Thus, e.g., (0,0) is joined to itself by 2 loops _ (x,y+2x) (x,y+2x+1) (x, y + 2x + 2) (x + 2y,y) (x + 2y + 1, y) (x+2y+2,y) For j ¥ 0, using the well-known theorem of Deligne [94], we have 
96 6. EXPANDERS AND EXPLICIT CONSTRUCTIONS 6.3. EXAMPLES OF EXPLICIT CONSTRUCTIONS 97 2- V3 A l >-' - 3 and v are joined by s parallel edges where s is the number of walks of length k in M n from v to u. Thus the adjacency matrix of M has eigenvalues P where Pi are eigenvalues of the adjacency matrix of M n . Although this construction does not give as good eigenvalues as the following Ramanujan graphs, the construction schemes are simple and the approach is interesting. note that here we consider that a loop adds 2 to the degree of a vertex.) Obviously, G is 12-regular. Claim: Construction 6.3.6. The Ramanujan graphs xp,q. PnOOF. Let T be the (0,1) x (0,1) torus, and define two measure-preserving automorphisms 'ljJ\, 'ljJ2 on T by 1/J\ (x, y) = (x, y + 2x), 'ljJ2(X, y) = (x + 2y, y), where addition is modulo 1. The main part of the proof is based on the following fact proved as Lemma 4 of [137]. Here we state without proof this analytic result: If rjJ is measurable on T and IT rjJ = 0, then (6.4) hi rjJ. 1/Jl 1 - rjJ 1 2 + hi rjJ. 1/J:;1 - rjJ 122: c h rjJ2, where c = 4 - JI2. Now suppose that f : V 4 IR satisfies 'L';\=1 f(j, k) = O. Define a measurable function rjJ : T 4 IR as follows: If (j, k) E Zm x Zm then for j j+1 k k+1 - < x < -, -:<:; y < -, rjJ(x,y) = f(j,k). m- m m m One of the major developments in constructive methods was the construction of Ramanujan graphs by Lubotzky, Phillips and Sarnak [191] and independently by Margulis [193, 194, 195]. Ramanujan graphs are k-regular graphs with Al satisfying \ > 1 _ 2Vk=l Al - k' This eigenvalue bound is the best possible for fixed k where the number n of vertices approaches infinity (see Section 2.4). hi rjJ. 1/Jl 1 - rjJ 1 2 + hi rjJ. 1/J:;1 - rjJ 1 2 712 [ 2:::: .2:::: (J(ai(V)) - f(V))2 +  L . L (J(ai(v)) - f(V))2] vEV.=2,5 vEV.=1,3,4,6 The construction can be given for large classes of parameters for k and n using quotients of quaternion groups: : Let p be a prime congruent to 1 modulo 4 and let H(Z) denote the integral quaternions H(Z) = {a = a o + ali + a2j + a3k : aj E Z}. Let a = ao - ali - a2j - a3k and N(a) = aa = a + ai + a + a. It can be shown that there are precisely  conjugate pairs {a, a} of elements of H(Z) satisfying N(a) = p,a == l(mod 2) and ao > 1. Denote by 5 the set of all such elements. For each a in S, we associate the 2 x 2 matrix a _ = ( ao + ial a2 + ia3 ) a -a2 + ia3 ao - ial It can be checked that IT rjJ = 0, and The claim is proved. o Let q be another prime congruent to 1 modulo 4. By taking the i in a to satisfy i 2 == -1 (mod q), a can be viewed as an element in PGL(2, Z/qZ), which is the group of all 2 x 2 matrices over Z/qZ. Now we form the Cayley graph of PGL(2, Z/qZ) relative to the above p + 1 elements. (The Cayley graph of a group G relative to a symmetric set of elements S is the graph with vertex set G and edges {x, y} if x = sy for some s in S.) If the Legendre symbol () = 1, then this graph is not connected since the generators all lie in the index two subgroup PSL(2, Z/qZ), each element of which has determinant a square. So there are two cases. The Ramanujan graph xp,q is defined to be the above Cayley graph if () = -1, and to be the Cayley graph of PSL(2,Z/qZ) relative to S if () = 1. For () = -1, xp,q is bipartite with edges between PSL(2, Z/qZ) and its set theoretit complement. The Ramanujan graphs of interest here correspond to taking () = 1 and are (p+ l)-regular graphs with q(q2 -1)/2 vertices. The bipartite graphs with () = -1 are bipartite expander graphs. The eigenvalue Al can be determined to be 1 -  by using the results of Eichler [109] and Igusa [163] on the Ramanujan conjecture [191, 214] for the above case. In addition to having the optimum eigenvalue AI, Ramanujan graphs 1 :<:; 2m 2 L (J(u) - f(V))2. (u,v)EE Also IT rjJ2 =  'LvEv j2(v). Therefore, by (6.4) we have  "" (J(v) - f(U))2 2: -; L f2(v). 2m  m (v,u)EE vEV Thus, L f = 0 implies L (J(v) - f(U))2 2: 2c(f, J). (v,u)EE We can construct graphs with larger degrees and bounded eigenvalues by taking products of M n as follows. The graph M, has vertex set V, and two vertices u 
98 6. EXPANDERS AND EXPLICIT CONSTRUCTIONS 6.4. APPLICATIONS OF EXPANDERS IN COMMUNICATION NETWORKS 99 have many other nice properties. They serve as illuminating examples for various extremal problems, several of which we will discuss in Section 6.5. 6.4. Applications of expanders in communication networks n inputs There are many applications of expander graphs scattered about in recent re- search papers in theoretical computer science. Expanders are extensively used in randomized and derandomized algorithms, computational complexity, and parallel architectures. There are many "tricks of the trade" in using expanders for am- plifying a random bit, generating pseudorandom numbers, and constructing error- correcting codes, for example. We do not intend to cover these new applications since there are many more still being developed. Instead, we will focus on a classical example of using the power of expanders in communication networks. Among various applications of expander graphs, those in communication net- works have the longest history, and can be traced back to the early development of switching networks [63, 192, 208, 209]. Roughly speaking, a telephone network which provides connections for users is made of many parts or "gadgets", each of which performs some desired function. We will describe some of the gadgets that can be built by using expanders. A non-blocking network is a directed graph with two specified disjoint subsets of vertices, one of which consists of input vertices and the other of output vertices. Now suppose that 'a number of calls take place simultaneously in the network, i.e., there are vertex-disjoint paths joining some inputs to outputs in the graph. Suppose one additional call comes in and it is desired to establish a new pat.h joining the given input to the desired output without disturbing the existing calls, i.e., the new path is to be vertex-disjoint from the existing paths. The problem of interest is to minimize the number of edges in such a non-blocking network. n outputs major-access network FIGURE 1. A nonblocking network !! R(12n,5) 12n 2 12n !! M () 12n 2 To build a non-blocking network, we need several types of building blocks, one of which is called a k-access graph, which has the property that for any given set S of vertex-disjoint paths connecting inputs to outputs, a new input can be connected to k different outputs by paths not containing any vertex in S. If k is greater than or equal to half of the total number of outputs, the k-access graph is a so-called major access network. A non-blocking network can then be formed by combining a major access network and its mirror image as shown in Fig. 1. M(n) FIGURE 2. A major access network We construct here a major-access network M(n) with n inputs and 24n outputs by combining 2 copies of M(n/2) and 2 copies of the bipartite Ramanujan graphs R(12n,5) with 12n inputs and with degree p + 1 = 6, as illustrated in Fig. 2. To verify that the above construction is a major-access network, we consider an input v which must have access to 6n of the middle vertices. After deleting the n possible vertices in S, the remaining set has at least 5n inputs of M(n). In each of the Ramanujan graphs with degree k = 6 and>' = 1 - V5/3, we see that, by Lemma 6.4, the neighborhood of a subset S of size 5n has size at least: 5n 27n (1 - >.)2 + f2>'(2 - >') 4' Since there are two copies of the Ramanujan graph R(12n 5) here there are at least 2n neighbors of S. Among the ¥n such outputs, thre are a least n of them not in S, which is more than half of the outputs of M(n). Therefo:e the above construction yields M (n) and the number of edges of M (n) satisfies n e(M(n)) =2e(M("2)) + 6.12.2n. It can then be easily checked that the above major-access network has at most 144n log n edges and therefore the non blocking network has at most 288n log n edges. 
100 6. EXPANDERS AND EXPLICIT CONSTRUCTIONS 6.5. CONSTRUCTIONS OF GRAPHS WITH SMALL DIAMETER AND GIRTH 101 Another useful network is the so-called superconcentrator. Despite this impres- sive name, it actually has a very simple property. Namely, it is a graph with n inputs and n outputs, having the property that for any set of inputs and any set of outputs, a set of vertex-disjoint paths exists that join the inputs in a one-to-one fashion to the outputs (so that here it does not matter who is connected to whom.) The question of interest is to determine how few edges a superconcentrator can have. In fact, this has been taken as a measure for comparing the effectiveness of the expanders which are used to build superconcentrators. A simple recursive construction [192] of a superconcentrator is shown in Figure 3. 11. input Expander C 511./6 output 11. input 11. output Now the total number of edges in the superconccntrator S(n) satisfics e(S(n)) n + 2e(B) + e(S(5n/6)) 5 ( 5: ) FIGURE 4. A concentrator 5(11.) n + 2. 5/6n . 7 + e(S(5n/6)) It is easy to verify th.at the above superconcentrator S(n) has at most 76n edges. The number of edges m S(n) can be reduced to 69.8n by replacing S(n) by See! + !')n) where!' = .0288776, and in B each of the first ( - !')n inputs ot B has degee 4 or 5, and they are joined to a total of ( + !')n distinct outputs of B. It is worth mentioning that by using expanders, the existence of which is guar- anteed by probabilistic methods, one can construct superconcentrators with as few as 36n edges. The parameters of such probabilistic expanders are given in Theorem 6.6 (also, see [17]). We remark that he best currently known lower bound for a superconcentrator of size n is 5n + O(/ogn), due to Lev and Valiant [182]. THEOREM 6.6. For real numbers 0 < a < 1/(3 < 1, suppose that an integer k satisfies FIGURE 3. A superconcentrator In the network in Figure 3, there is a matching between the n inputs and n outputs. Furthermore, the graph B has n inputs and 5n/6 outputs satisfying the property that for any given n/2 inputs there is a set of vertex-disjoint paths joining the inputs in a one-to-one fashion to different outputs. For example, as defined in Section 6.2, an (n, 5/6, k, 1/2, 1/2)-concentrator has the above property. So for any given set of m inputs and m outputs in S(n) of Figure 3, we can use the matching to provide m - n/2 disjoint paths and let the rest be achieved recursively in s( 5 6 n ). Therefore the key part of the construction is made from an expander as in Figure 4. In Figure 4, the first n/6 inputs, each having degree 5, are joined to 5n/6 distinct outputs. The remaining 511./6 inputs are joined to the outputs by a Ilamanujan graph with degree 6 = p + 1. Now suppose we have a set of inputs X. It suffices to show that X has at least I X I neighbors as outputs. Here we verify the situation for I X 1= n/2 (the other cases where I X 1< n/2 are easier). If X contains at least Hi inputs among the first  inputs, then we are done. We may assume X contains at least 25 n inputs as an input set X' of the expander C. Since the expander graph has eigenvalue A = 1 - .,;5/3, it is straightforward to check that 9'n 12 > n/2, 4'25+ 5 k > H(a) + H(a(3) H(a) - a(3H(l/(3) where H(x) = -x log2 X - (1- x) 10gx(1- x) is the entropy function. Then for any mteger 11., there exists a k-regular bipar.tite graph with vertex set AU B, IAI = IBI = n, so that every subset X C;;;; A with IX I ::; an has at least (3IXI ne(qhbors in B. In fact almost all random k-regular bipartitc graphs betwcen two sets of n vertices satisfy the above property. The proof is by combinatorial probabilistic methods and can be found in [63]. 6.5. Constructions of graphs with small diameter and girth N(X') > I X' I > - A(2-A)12+(1-A)2 6 There are many related extremal properties that are satisfied by random graphs but are somewhat "weaker" than the properties mentioned in Section 6.2. One such example is the diameter, which is the maximum distancc bctween pairs of verticps, 
102 6. EXPANDERS AND EXPLICIT CONSTRUCTIONS 6.6. WEIGHTED LAPLACIANS AND THE LOV Asz 19 FUNCTION 103 There are graphs with small diamet.er but which do not have good expansion, discrepancy or eigenvalue properties. The following two related extremal problems often arise in interconnection net- works [110]: Problem 6.5.1. Given k and D, construct a graph with as many vertices as possible with degree k and diameter D. Problem 6.5.2. Given nand k, construct a graph with minimum degree on n vertices with diameter as small as possible. It is not difficult to see that a graph with degree k and diameter D can have at most M(k, D) = 1 + k + . ., + k(k - l)i-1 + .. . + k(k - l)D-I vertices, which is sometimes called the Moore bound. Let n(k, D) denote the maximum number of vertices in a graph with degree at most k and diameter at most D. Clearly, n(k, D) :<:; M(k, D). It has been shown that there are at most five kinds of graphs achieving the Moore bound, namely, cliques, odd cycles, the Petersen graph, the Hoffman-Singleton graph (with k = 7 and D = 2) and possibly the case of M(2, 57) (which remains still unresolved [113, 160]). A random graph has small diameter. To be specific, Bollobas and de la Vega [36] proved that a random k-regular graph has diameter logk-:I n -: 10gk_1 log n + c for some small constant c < 10. This is almost the best possIble m the sense that any k-regular graph has diameter at least 10gk_1 n. Upper bounds for the diameter in tcrms of eigenvalues were discussed in Chaptcr 3, Namely, a k-regular graph G r 10gn-l) 1 on n vertices has diameter at most 10g ( 1 ( I-A » . general theorem can be proved whi<;h ensures that by adding a random matching to k-regular graphs, say Ramanujan graphs, the resulting graphs have diameter about 10gk_1 n. It would be of interest to answer Problem 6.5.4 and its generalizations by explicit constructions [6, 18, 68, 133, 245]. Vijayan and Murty [245] asked the following problems related to reliability of graphs with diameter constraints: Problem 6.5.5. Given n, D, D' and s, what is the minimum number of edges in a graph on n vertices of diameter D with the property that after removing sedges the remaining graph has diameter no more than D'? These problems have attracted the attention of many researchers. There is a large literature on this problem [21, 22, 63, 65, 106] However, the answers are far from satisfactory and explicit solutions are few. Most problem of this type remain unsolved. The girth of a graph is the size of a smallest cycle in the graph [26, 164, 250]. The girth of a random k-regular graph is known to be 10gk_1 n [117]. In [191], the bipartite Ramanujan graphs on n vertices have girth about  10gk_1 n; which is better than that of a random graph in the sense of avoiding small cycles. (To be precise, the bipartite Ramanujan graph xp,q has q(q2 - 1) vertices and girth 410g p q - logp 4.) This is closely related to the following extremal problem which, though rather old, remains open [37, 227]: Pr'oblem 6.5.6. For a given integer t :::: 6, how many edges can a graph on n vertices have without containing any cycle of length 2t? . I, r 10K n 1 Using the above bound, the Ramanujan graph has diameter at mos 10g(I/(I-A» which comes to within a factor of 2 of the optimum diameter. In other words, the Ramanujan graph has the number of vertices about a factor of (k - 1)-D/2 times the Moore bound [160]. Quite a few other constructions, such as de Bruijn graphs [42] and their variations, fall within the range of 2- D times the Moore boud. !t remains an open problem to determine the maximum number n(k, D) of vertices III a graph with degree k and diameter D. R.elativ:l little is .known aout the uper bound for n(k, D). The following somewhat tnvml soundmg questIOn concernmg the upper bound is still unresolved [113]: Problem 6.5.3. Is it true that for every integer c, there exist k and D such that n(k, D) < M(k, D) - c? There are many papers on this problem; the reader is referred to [21, 22, 46, 65, 66] for surveys on this topic. Another direction is to allow additional edges to minimize diameter: Problem 6,5.4. How small can the diameter be made by adding a matching to an n-cycle? It was shown in [32] that by adding a random matching to an n-cycle the rpsult.ing graph has best possible diameter in the range of log2 n. In fact, a more Erdos conjectures that the maximum number f(n, t) of edges in a graph on n vertices avoiding C u is of order n1+I/!. It is not hard to see that f(n, t) < nIH/!. The Ramanujan graphs yield f(n, t) > nl+2/3! which is a substantial improvement upon previous lower bounds of nl+ 21' in [37]. Recently, Lazebnik, Ustimenko and Woldar [177] constructed graphs on n vertices, for infinitely many n, which have n 1 + 2/ (3t-3) edges containing no cycle of length 2t. 6.6. Weighted Laplacians and the Lovasz () function For a simple graph G and a weight matrix W = (w uv ) where W uv = W vu :::: 0 and W uv = 0 for u and v not adjacent or u = v, we define the W -weighted Laplacian .cw, a matrix with rows and columns indexed by vertices of G, 1 - wv,v if u = v, and W v ¥' 0 W v .cw(u, v) = w uv if u  v and u ¥' v, yWuW v o otherwise, where W v = L W uv . u 
104 6. EXPANDERS AND EXPLICIT CONSTRUCTIONS 6.6. WEIGHTED LAPLACIANS AND TilE LOV Asz ,9 FUNCTION 105 For a graph G with a weight matrix W, let Amax(GW) denote the maximum eigenvalue of the W-weighted Laplacian of G. In particular, let Amax(G) denote Amax(GW) when the weight matrix satisfies W uv = 1 if u  v and 0 otherwise. Let :c denote. an independent subset of G and let Mx denote the principal submatnx of M wIth rows and columns restricted to vertices in X. Then A A Mx = (Mdx = (TI/21)x(TI/21)x The maximum eigenvalue of M is Previously we have defined the Laplacian of a (fixed) weighted graph. The above definition is different in the sense that we start with a fixed graph G and consider all possible weight matrices. (TI/21)X(TI/21) = w(X) w w The (T function of a graph G is defined as fo1\ows: 1 u(G) = 1 + max A (G) - 1 W ntax W where w(X) = L W v . vEX The chromatic number X(G) of a graph G is the sma1\est integer k such that the vertices of G can be k-colored so that any two adjacent vertices have different colors. Bounds are known for X(G) in terms of the eigenvalues of the adjacency matrix A = (Auv) of G (where Auv = 1 if u and v are adjacent, and 0 otherwise). Let Pmin and pmax denote the smallest and largest eigenvalues of A, respectively. An upper bound of X(G) was first given by H. S. Wi\[ [248] who showed that X(G)  1 + pmax. For the lower bound, A. J, Hoffman [161] proved (also see [153]) X(G) 2: 1 _ pm ax pmin . Since the maximum eigenvalue of a principal submatrix of a symmetric matrix M IS no more than the maximum eigenvalue of M, we have A A - 1 2: -w(X) . w where W ranges over all weight matrices. ppos G ha chromatic number X(G) = k. Thus, the vertex set of G can be partItIOned mto k mdependent sets XI,. . . , X k . We then have A A - 1 2: -w(X i ) , i = 1,.. . ,k . w In particular, the sum over a1\ i satisfies k(A-1) > ..\  L w(X i ) i ..\. Here we will show that the u function serves as a lower bound for the chromatic number X(G) with a proof very similar to that in [161]. THEOREM 6.7. For any graph G which contains at least one edge, we have 1 X(G) 2: 1 + mJP' Amax(GW) _ 1 = u(G) This implies 1 X(G ) = k > 1 + - - A-1 and (5.1) is proved. o PROOF, We consider the matrix MI with the (u,v)-entry to be JWuw v . If we regard TI/21 as a row vector and (T I / 2 1)* as a column vector, we can write M I = (TI/21)(TI/21)* = TI/2JTI/2. As an immediate consequence of Theorem 6.7, we have the following coro1\aries: COROLLARY 6.8. For any graph G, we have where w = L W v and J is the a1\ 1 's matrix. v 1 X(G) 2: l+max , G' Amax(G w ) - 1 where G' ranges over all induced sub g ra p hs of G and W ranges over all weight matrices for G' . We consider eigenvalues of A M=L-I+-M I w We note that the inequality above is strict for some graphs (i.e" odd cycles for example). We also have the fo1\owing simpler and weaker inequality. COROLLARY 6.9. For a graph G, we have (G) > 1 1 X - + Amax(G) - 1 where G' ranges over all induced subgraphs of G. where>. = Amax(GW) denotes the maximum eigenvalue of the W-weighted Lapla- cian L of G. It is easy to see that. the eigenfunctions of L are eigenfunctions of M and the maximum eigenvalue of M is >. - 1. 
106 6. EXPANDERS AND EXPLICIT CONSTRUCTIONS 6.6. WEIGHTED LAPLACIANS AND THE LovAsz 19 FUNCTION 107 In a graph G, the clique number w(G) of G is the numer of vertices in G forms the largest complete subgraph (which is also called a chque). The problem of determining the clique number of a graph is known to be NP-complete [140]. A graph G is perfect if G and all its induced subgraphs have the property that the chromatic number equals the size of a largest clique. There is an excellent survy by Lovasz [189] on perfect graphs. In general, the clique number an.d the chromatic number can be quite different. Here we will show that the a functIOn serves as an upper bound for the clique number (also see [221]). THEOREM 6.10. The a function is closely related to Lovasz's {} function which was first intro- duced in Lovasz's seminal work on the Shannon capacity [188]. The {} function has many alternative definitions (see [151, 152]). One of the formulations states {}(G) = 1 + max Pmax(W ' ) W' Pmin(W') where Pmax(W ' ) denotes the maximum eigenvalue of W' and W' ranges over all matrices with rows and columns indexed by the vertex set of G satisfying W' (IL, v) ¥' o only if the vertices u and v are non-adjacent. (6.5) w(G) :::; a(G) The original definition for {}(G) is as follows: For a graph G, an orthonormal labeling of G is an assignment of a unit vector Xv in a Euclidean space to each vertex v of G, in such a way that (x,,, xv) = 0 if u ¥' v and u is not adjacent to v. The {} function {)( G) is equal to: . 1 {}(G) = mmmax- ( ) 2 x,y v xv,y PROOF. Suppose the clique number of G is k. Clearly, k > 1. Let 5 = {Vi, . .. ,Vk} denote the vertex set of the maximum clique. For each edge {u, v}, u, v E 5, we define W uv = W vu = 1 . where the minimum ranges over all orthonormal labelings x and all unit vectors y. Let () ¥' 1 denote a k-th root of unity, say, 21Ti () = exp(-). k We consider f(v) = (}j for v in C j , 1 :::; j :::; k. Then we have L 1(J(u) - f(v))1 2 w uv uv L If(vWw v As pointed out by A. Galtman [138], the a function can be expressed as : ( ) Pmax(W) a G = 1 + max . (W) W Pmm where W ranges over all matrices with rows and columns indexed by the vertex set of G satisfying W(u, v) > 0 only if the vertices u and v are adjacent. (6.6) Am ax > Therefore, we have v a(G) :::; {}(G). L I(}j - (}m12 jtm v The above formulation for a( G) coincides with that of a function introduced by McEIiece, Rodemich and Rumsey [198] in their study of bounds for the indepen- dence number (The notation o.L was used there). They showed that for a family of graphs the a function is equal to the Delsarte linear programming bound, Inde- pendently, A. Schrijver [221] considered the a function (with the notation {}I). In [221], an example by M.R. Best was given for a graph H satisfying a(H) ¥' {}(H). The vertex set of H is {O, 1}6 and two vertices are adjacent if and only if they differ in at most three of the six coordinates. LW v L 2:(1- ((}-j+m + (}j-m)/2) m k(k - 1) k 2 k(k - 1) k k - 1 The following definition for {}I(G) = a(G) was given by Schrijver: 1 w(G) = k :::; 1 + :::; a(G) Am ax - 1 For a graph G, an acute orthonormal labeling of G is an assignment of a unit vector Xv in a Euclidean space to each vertex v of G, in such a way that (xu, xv) 2: 0 if u = v or u is adjacent to v and 0 otherwise. Then a(G) = {}'(G) = minmax _ ( 1 ) 2 x,Y v xv,y Therefore and (6.5) is proved. o where the minimum ranges over all acute orthonormal labelings x and all unit vectors y. Combining (5.1) and (6.5), we have proved: w(G) :::; a(G) :::; X(G). So, altogether we have the so-called Sandwich Theorem: w(G) :::; a(G) :::; {}(G) :::; X(G). 
108 6. EXPANDERS AND EXPLICIT CONSTRUCTIONS How good are these inequalities? In other words, how effective can 19(G) or a(G) be used to estimate w(G) or X(G)? Although the experimental evidence indicates that they are good in many cases, theoretical results show that significant obstacles are present in this approach. CHAPTER 7 Erdos [112] proved that x(G) en -<- w(G) (logn)2 and for every 71, there is a graph on 71 vertices satisfying X(G) e'n ->-. w(G) - (logn)2 In fact, (6.8) is achieved by random graphs since Ramsey theory implies that a random graph has w( G) :<:; 2 log 71/ log 2 and therefore its chromatic number X( G) 2: n/w(G) 2: e'n/ log n. Eigenvalues of symmetrical graphs (6.7) (6.8) 7.1. Symmetrical graphs 1t has been shown ([124], also see [13, 122]) that for some (' > 0, it is impos- sible to approximate in polynomial time the independence number of a graph on 71 vertices within a factor of 71', assuming P ¥' N P. The exponent (' has recently been improved [157] , under similar assumptions, to 1 - <5 for every positive <5. On the positive side, there have been a numbcr of recent papers on approx- imation algorithms for coloring problems, max-cut problems and clique numbers using the 19 function [11, 154, 141, 173]. Although these approximation algo- rithms often have complicated statements for certain ranges of the parameters with incremental or weak improvements, this approach still represents a significant step towards the understanding of these hard problems. Roughly speaking, graphs with symmetry have "large" automorphism groups. There are various notions of symmetry in graphs such as vertex-transitivity, edge- transitivity, and distance transitivity (all of which we will soon define precisely). In general, the eigenvalues of symmetrical graphs have many remarkable properties, several of which we now mention: 1: For symmetrical graphs, eigenvalues can be easily bounded in terms of the diameter D and the degree k. For example, for vertex transitive graphs we have (7.1) 1 Al 2: kD2 ' Notes: The first four sections in this chapter are mainly based on a previous survey article [69]. Section 6.5 deals with several problems previously discussed in [65, 66, 68, 32]. Concerning the last section on the a function and the chromatic number, te reader is referred to an excellent survey paper by Knuth [170]. Related matenal can also be found in [151, 152]. The alternative definitions of the a function and its relationship to the 19 functions are given in Galtman [138], This implication has very interesting and important consequences. In many random walk problems, we might not even know the number of vertices in a graph, but the above inequality provides an efficient way to estimate the eigenvalues of a graph as long as the diameter and degree can be computed or bounded. This is a main component for the recent developments in rapidly mixing Markov chains [225]. Several eigenvalue inequalities with a form similar to (7.1) will be derived in a clean way in Section 7,2. 2: A graph is distance tmnsitive if for any two pairs of vertices (x, y), (z, w) with d(x, y) = d(z, w), there is a graph automorphism mapping x to z and y to w. Distance transitive graphs have very special spectra. We will describe a simple and natural method to determine the spectrum of a distance transitive graph. Basically, the spectrum of a distance transitive graph is the same as that of a corresponding contracted path with D + 1 vertices where D is the diameter. In fact, a distance transitive graph has exactly D + 1 distinct eigenvalues. 3: For some symmetrical graphs, eigenvalues can be explicitly determined by using group representations. We will discuss the general methods and give two examples: intersection graphs and the "Buckyball" graph (the truncated icosahedron). Inter- section graphs have vertices labelled by subsets and adjacency determined by the cardinality of intersections of the sets corresponding to the endpoints. The Bucky- ball graph is associated with the newly found molecule "Buckminsterfullerene C 60 " , the third form of solid carbon. Not only does it have beautiful symmetry (which can be described by the alternating group As or, equivalently, PSL(2,5)), but it also provides a good example of an application of a graph theory model to chemistry. 10Q 
110 7. EIGENVALUES OF SYMMETRICAL GRAPHS 7.2. CHEEGER CONSTANTS OF SYMMETRICAL GRAPHS III Before we proceed, we start with some definitions. For a graph G, an automor- phism f : V(G) -+ V(G) is a one-to-one mapping which preserves edges, i.e., for u,v E V(G), we have {u,v} E E if and only if {f(u), f(v)} E E. A graph G is ve7'tex-transitive if its aut.omorphism group Aut(G) acts t.ransi- tively on t.he vert.ex set V(G), i.e. , for any two vertex u and v t.here is an aut.omor- phism f E Aut(G) such t.hat f(u) = v. We sometimes write f(u) = fu ( especially when both f and u are elements of a group). THEOREM 7.1. Suppose r is a finite edge-transitive graph of diameter D, the Cheeger constant hI' satisfies 1 hI'> -. - 2D Then A homogeneous graph is a graph r together with a group H which acts tran- sitively on its vertex set. In other words, H is a subgroup of Aut(r) and for any t.wo vert.ices u, v E V(r) t.here is agE H such that gu = v. (Since G is the favorite common notation for both graph theorists and group theorists, we will try to avoid using G for either t.he graph or the group in connection with a hOlIlogeneous graph.) Any vertex-transitive graph r can be viewed as a homogeneous graph by taking Aut(r) as the associated group. However, the choice of the associated group gives different ways of labelling the vertices in the following sense: In a homogeneous graph r with the associated group H, the isotropy group I is defined as PROF. Let S denote a subset of vertices such that ISI   where n = 1V(r)I. We consider a random (ordered) pair of vertices (x, y), uniformly chosen over V(r) x V(r). Now, we cho.ose randomly a shortest path P between x and y (uniformly chosen over all possible shortest paths). Since r is edge-transitive the probabilit that P goes through a given edge is at most 2D y vol r' A path between a vertex from S and a vertex from S must contain an edge in E(S, S). Therefore we have We say that G is edge-transitive if, for any two edges {x,y},{z,w} E E(G), there is an automorphism f such that {J(x),f(y)} = {z,w}. It is not difficult to show that an edge-transitive graph is either vertex-transitive or bipartite (or both). 2IE(S, S)I . D _ vol r 2: Prob(x E S,y E S or x E S,y E S). This implies I = {g E H : gv = v} IE(S, S)I 2: ISllSlvol r Dn 2 E(S,S) 2: ISI 'kfSI Dn > 1 2D ' for a fixed vertex v. We can identify V with the coset space HII. The edge set of a homogeneous graph r can be described by an edge generating set K c H so that each edge of r is of the form {v, gv} for some v E V and 9 E K. For undirected graphs we require 9 E K if and only if g-I E K. Therefore Cayley graphs are homogeneous graphs in which the isotropy group I is triv- ial, I = {id}. In other words, the vertices of a Cayley graph are labelled by its associated group. 1 hl'>-. - 2D For example, the cycle C n can be viewed as a homogeneous graph with associ- ated group Z and isotropy group nZ. Of course, en can also be viewed as a Cayley graph with associated group Zn = ZlnZ. o THEOREM 7.2. Suppose r is a finite vertex-transitive graph of diameter D and degree k. Then the Cheeger constant hI' satisfies h > I' - 2kD' A symmetric graph is regular, so that its Laplacian satisfies .c=I-A k PROOF. We follow the notation in the previous proof. The automorphism group defines an equivalence relation on the ed g es of r. Two ed g es . I . f d . . el, e2 are eqUlva ent I an only If there IS an automorphism 1T ma pp in g e to e W th . d I 2. e can en conSl er equivalence classes of ed g es denoted b y E .., E , 1, , s. where k is the degree and A is the adjacency matrix, 7.2. Cheeger constants of symmetrical graphs We define the index of r to be . . vol r mdex r = mm - i 21E;i where E i enotes the i-th equivalence class of edges. Clearly, we have 1  index r < k. In partIcular, when r is edge-transitive, we have index r = 1. - Since r is vertex transitive, each equivalence class contains at least !! edges. Let Pi denote the probability that a pair of vertices is an edge in the i-t1 equivalcnee In this section, we will discuss several inequalities for Cheeger constants of vertex-t.ransitive and edge-transitive graphs. The various versions of the following inequalit.ies can be found in lIlany places (see Babai and Szegedy [14]). Here we give a simple proof of a strengthened version. 
112 7. EIGENVALUES OF SYMMETRICAL GRAPHS 7.3. EIGENVALUES OF SYMMETRICAL GRAPHS 113 class E i . Since all edges in the same equivalence class have the same probability, we have, for each i, THEOREM 7,6. For a ve7'tex-tmnsitive gmph r with diameter D, we have 1 2 index r 1 ).<-< t - lEd - vol r For a subset S of the vertex set with volS :<::: volS, and, for a pair of vertices x, y in reG), the probability of having one of x, y in S and te other in S is the same as the probability that P(x,y) contains an edge in E(S,S). Therefore, we have Prob(x E S, yES or XES, YES) < IE(S, S)ID mrxPi - 2 index r :<::: IE(S, S)ID. vol r . 1 Al  kD2 ' The above two theorems are special cases of the following theorem: THEOREM 7.7. For a vertex transitive graph r with diameter D, we have 1 Al > - D2 index r where index r = min ;Ik, ' and where E i denotes the i-th equivalence class of edges under Aut(r). Since _ - 21SII S I ProlJ(x E S, yES 01' :r E S, yES) =  n IE(S,S)! > 1 >  vol S - 2D index r - 2kD PROOF. We consider f : VCr) -* IR and we use the (equivalent) eigenvalue definition (1.5) in Chapter 1: we have as claimed. o n 2)f(x) - f(y))2 Al = min xy f k L L(J(x) - f(y))2 In fact, the above proof gives the following slightly stronger result. THEOREM 7.3. Suppose r is a finite vertex-tmnsitive gmph of diameter D. Then x y For each edge e = {x, y}, we define (7.2) 1 h r  2D index r ' fee) = If(x) - f(y)I, We then have We remark that in the inequality (7.2) the term index r cannot be deleted. There are, for example, Cayley graphs r with hr = k"v for some constant c. EXAMPLE 7.4. We considcr the Cayley graph with vertex set tl q x 71 2 and edge generating set {(k, 0) : k E 7l q } U {(O, 1)}. In other words, the graph r is formed by joining two complete graphs on q vertices by a matching. This is the "dumb-bell" graph and its Cheeger constant satisfies 1 2 1 h = - = -«- q kD D where degree k = q is large and diameter D = 2. n L f2(e) Al = min eEE . f k L L(J(x) - f(y))2 x y Let E i denote the i-th equivalence class of edges under Aut(r). For a fixed vertex xo, we choose a fixed set of shortest paths PxO,y to all y in r. We can now use the automorphism group to define, for each vertex x E VCr) and an automorphism 11' with 7r(xo) = x, a set of paths P(x) = {7r(PXO'Y)}' 7.3. Eigenvalues of symmetrical graphs Clearly, each path in P(x) has length at most D. For each edge e, we consider the number N e of occurrences of e in paths in P(x) ranging over all x. We here derive lower bounds for eigenvalues of edge-transitive and vertex- transitive graphs, These bounds are somewhat stronger than the bounds one ob- tains for general graphs by using Cheeger inequalities. THEOREM 7.5. For an edge-transitive graph r with diameter D and degree k, we have Two edges in the same equivalence class have the same value for N e . The total number of edges in all paths in P(x) for all x is at most n 2 D. For each i and e E E i , we have 1 Al  D2 ' N n2D n 2 D nDindexr e<-< = - 21Eil - 2 min IEil vol r t D index r k Now we consider, for a harmonic eigenfunction f achieving AI, 
114 7. EIGENVALUES OF SYMMETIUCAL GHAI'IIS 7.4. DISTANCE TRANSITIVE GRAPHS 115  2: f2(e)DN e eEE "" 2 D index r L.. f (e)D. k . eEE It is, of course, much easier to deal with a (D + 1) x (D + 1) matrix of the path P with nonzero entries only at coordinates of (i, i + 1), (i, i), and (i, i - 1), than to deal with the Laplacian of G. An eigenfunction for P can be transformed into an eigenfunction for r as follows: THEOREM 7.9. A harmonic eigenfunction for the contracted path P is an eigen- function for the distance transitive graph r. x y 2: 2:( 2: f(e))2 x Y eEP(x,y) < 2: 2: D 2: f2(e) x Y eEP(x,y) 2: 2:(J(x) - f(y))2 < PROOF. Suppose f is a harmonic eigenfunction for P. We define g(x) = f(vi) if x is in Vi. It is easy to check that g is an eigenfunction for r. 0 Therefore we have As a consequence of Theorem 7.8 and 7.9, we have >'1 n I: f2(e) k 2: 2:(J(x) - f(y))2 THEOREM 7.10. A distance transitive graph of diameter D has exactly D + 1 distinct eigenvalues. x y o PROOF. From Theorem 7.9, we know that there are at most D + 1 distinct eigenvalues. On the other hand, there are at least D + 1 distinct eigenvalues because otherwise the characteristic polynomial II (.c - Ai) would be of degree  d, 1 > D2 index r This completes the proof of Theorem 7,7. Ai distinct contradicting the fact that I,.c,.c 2 , . .. ,.cd are independent. o 7.4. Distance transitive graphs We recall that a graph r is distance transitive if for any two airs of vrti:es } . th d(x y) - d ( z W ) there is a graph automorphIsm f satlsfymg {x y} {z W WI , - , , . t' f()  z nd f(y) = w. In this section, all graphs we consider are dIstance ransl- tive. We first point out an easy observation which has many useful consequences. Observation: Let A denote an eigenvalue of a distance .transitive raph.r. Suppose . r L t fT. - { u E r . d ( u v) = } Then A IS achIeved by an we fix a vertex v m . e Vi - ".. ) eigenfunction which satisfies for each i, x, y E Vi Imphes f(x) = f(y . This observation follows from the fact that for any x, y E Vi ther is an aUltm.or- hism mapping x to y that fixes v. If we start from any eigenfunctIOn! aC.l1evm. g  the new function formed by assigning the average value in Vi to vertIces m Vi IS also an eigenfunction with the same eigenvalue. THEOREM 7.8. The eigenvalues of a distance tranitive graph r of diameter D are the eigenvalues of a weighted path P of D + 1 vertces. In fact, a slightly stronger statement is true. THEOREM 7.11. The eigenvalues of a distance transitive graph r of diameter D have the same values as the eigenvalues of a weighted path P of D + 1 vertices, obtained by contracting each Vi = {u : d(u,v) = i}, for a fixed v, into a single vertex. Of course, the eigenvalues of rand P have different multiplicities. Nevertheless, there is a simple method to determine the multiplicities of eigenvalues of r from eigenfunctiOIlS of P. Note that in P, all eigenvalues have multiplicity 1. THEOREM 7.12. In a distance transitive graph r, we consider the n x n matrix Aj with Aj(x, y) = 1 if d(x, y) = j in rand 0 otherwise. The eigenvalues for Aj are l"ilf(vj)/f(vo) for each harmonic eigenfunction f of P, PROOF. We form a path P by contracting each set Vi as defined above into one vertex The weight of the edge {Vi, vi+ I} in P is just the number of edesd betee fT d . V. The loop { V' v. } has wei g ht equal to twice the number 0 e ges m Vi an HI. .. . . f t' f with both endpoints in Vi plus the number of loops in Vi. For an elgen nc IOn f of r with eigenvalue A, we choose v so that f(v) is nonzero and w mp v mo o n tll n I)atll P Thcn we assi g n the average value of f (over the vertIcs I Vi) f 0 f i. ., ,. . I . 1 J(' elgen UlH' IOn P. CIParly, t.he n'sult.ing fuuct.iou is not always 0 all< IS a lannOIl . ., 0 of P with the same eigenvalue A, PROOF. Since Aj is a polynomial in A, then an eigenfunction f of A is an eigenfunction for Aj. From Theorem 8.9, a harmonic eigenfunction f of P is an eigenfunction of A, i.e., f(x) = f(v) for x E V v . Suppose the eigenvalue of f for Aj is N. We consider, for the vector 'Po = (1,0,.. . ,0) of length D + 1,t.he inner product (cjJo,7rAjf) = (cjJo,A'7rf) = A'f(vo) where 7r denotes the projection of Vcr) into P, i.e., 7rf(Vi) = L f(x). xEV; 
116 7. EIGENVALUES OF SYMMETRICAL GRAPHS 7.5. EIGENVALUES AND GROUP REPRESENTATION THEORY 117 We remark that 11' can be viewed as a matrix with rows indexed b V(P) and I . d d b Vc r ) such that 7r ( v X ) = 1 if x E V v and 0 otherwIse. Clearly, co umns III exe y , we have (CP07rAj, J) = IVjlf(vj). Therefore, ),,' = IVjlf(vj)/ f(vo). EXAMPLE 7.14. The Petersen graph and intersection graphs o The Petersen graph is a dist.ance transitivc graph on 10 vcrtices. The vcrt.ex set is labelled by all 2-subsets of {I, 2, 3, 4, 5}. Two vertices A and B are adjacent if and only if An B = 0. The eigenvalues are 0,  (with multiplicity 5), and  (with multiplicity 4). The Petersen graph is a special case of the intersection graph G(n,r,k) with vertex set. consisting of all r-subsets of {I,... ,n}. Thc vertir:cs A and B are adjacent. if IA n BI = k, The symmetriC- group S" acts on t.he graph with isotropy group Sr x S,,-r. Since (S",Sr x Sn-r) is a Gelfand pair [97], the spectral decompositions of the space F(v) = {J : V -+ R} are quite special: F(v) = Eo EB EI EB... EB Er U . TI . 7 " 7 10 ,tIld 7 12 we will show t.hat t.he lIlult.iplicities of each smg !eO! ems .'-',.' .,. cigenvalue can be determined from the contracted path P. THEOREM 7.13. For a distance-transitive graph r on n vertices, the multiplic- ity m('\) of an eigenvalue ,\ is m('\) = II ;1I2 l(vo) where 9 i. the cOTTesponding eigenfunction of the weighted path P contracted from r from a fixed vertex va, PROOF. Let gi'S denotc eigenfunctions of P and fi'S deIlote th corresponding harmonic eigenfunctions. Note that g(v;) = .jkIVil f(vi) where k IS the degree of r. We consider the following n x n matrix: D M i = L fi(Vj)Aj. j=O For a fixed i, the trace of M i is just the trace of J;(vo)Ao. Hence (7.3) tr(M i ) = n/;(vo). On the other hand, the eigenvalues of Aj are IV} Ifo( Vj)/ foe va), IV} III (Vj)/ II (va),. . . , . I . I . . t . ( \ ) m ( ,\ ) Therefore IVjlfD(vj)/ fD(VO) of respective mu tIp ICI Ies m "a ",. , D . , D tT.M L J;(Vj) tr Aj j=o /J /J IVj I L fi(Vj) L m('\dfl(Vj) ft(vo) j=O 1=0 D IVjl L J;(Vj)m('\i)J;(Vj) J;(vo) j=o 2 m('\;) IIgili fi(Vo)k ' Here, we use the fact that distinct eigenfunctions are orthogonal so that { 0 if p "" q L fp(Vi)fq(Vi)IVilk = II gp 11 2 if p = q. i where the dimension of E i satisfies dim E i = (7) - CI) for i 2 1, and dim Eo = 1. 7.5. Eigenvalues and group representation theory A brut.e force method for computing eigenvalues of a connccted graph on n vertices is to solve for x in the determinant, det(xI - £), of an n x n matrix. Before starting such an arduous task, it makes sense to see if the matrix can be diagonalized into smaller blocks. Group representation theory is exactly the answer to such prayers when the graph is homogeneous. Suppose r is a Cayley graph [25]with vertices labelled by a group 11. and with edge generating set K. Let p dcnote an irreducible representation of 11. of dimension I. This means that p maps the elements of 11. into I x I matrices in such a way that matrix multiplication is consistent with the group multiplication, Le., P(glg2) = p(gdP(g2)' The eigenvalues of r are exactly the eigenvalues of the smallcr matrix 1- .!.. L peg) Ikl gEIC for p ranging over all irreducible reprcscntations of 11.. Ear:h eigcnvaluc of t.hc dim p x dim p matrix has mult.iplicity dim p in the graph r. Suppose r is a homogeneous graph with associated group 11.. The vertex set can be identified by 1I./I where I is the isotropy group, The edge generating sct K = {gI : v  gv} for a fixed v is a union of double cosets K = IKI The eigenvalues of r are the eigenvalues of I -  L II L p(x) where k is thc gIEIC xEgI degree of r. Since g2(VO) = kJ2(vo), from (7.3), we have m('\) = II ;1I2 g2(vo). The proof of Theorem 7.13 is complete. The best way to illustrate the connection between homogeneous graph rand the irreducible representations of the associated group 11. is by examining concrete examples: o EXAMPLE 7,15. The cycle C n as a Cayley graph associated with Zn' The Laplacian can be diagonalized since the irreducible representations Pk(9) = (e 2 ':,," ,g), k = 0,... ,n -1, arc all 1-dimensionai. 
We remark that for the Gelfand pairs in Example 7.15, all irreducible repre- sentations are 1-dimensional. This simplifies the computation of the eigenvalues of the corrcsponding homogeneous graphs. In our final example we use terminology that may be unfamiliar to some readers. A quick summary of this can be found in [85] or [84, 86]. EXAMPLE 7.16. The Buckyball, a soccer ball-like molecule, consists of 60 car- bon atoms. It corrcsponds to a Cayley graph on As with edge generatin, set {(12345), (54321), (12)(23)}. The edges generated by (12)(34)"crrespond t dou- ble bonds" and the edges generated by (12345), (54321) to slgle bonds . he irreducible representations for the alternating group were determmed by.Frobemus [134] and they are of dimensions 1,3,3,4, and 5. This means the LaplaCian can be diagonalized into blocks of sizes 1 X ], 3 X 3 (with multiplicity 3), 3'. X 3' (a eold type with multiplicity 3), 4 x 4 (with multiplicity 4), and 5 x 5 (with multiplicity 5). Note that 1 2 + 3 2 + 3 2 + 4 2 + 52 = 60, Suppose we consider the weighted graph with .single bonds. of wcight 1 and double bonds of weight t. The eigenvalues of the adjacency matnx are exactly the eigenvalues of IIR 7. EIGENVALUES OF SYMMETRICAL GRAPHS 7.6. TilE VIRRATIONAL SPECTRUM OF A GRAPH 119 Thus, the eigenvalues of the adjacency matrix are the roots of the characteristic polynomial (x 2 + x - e + t - 1)(x 3 - tx 2 - x 2 - ex + 2tx - 3x + t 3 - t 2 + t + 2). In summary, the eigenvalues of the Buckyball can be written in closed form as roots of the following equations where the single bonds are weighted by 1 and the double bonds are weighted by t: (a): (x 2 + x - t 2 + t - 1)(x 3 - tx 2 - x 2 - ex + 2tx - 3x + t 3 - t 2 + t + 2) = 0 with multiplicity 5; (b): (x 2 + x - t 2 - 1)(x 2 + x - (t + 1)2) = 0 with multiplicity 4; (c): (x 2 + (2t + l)x + t 2 + t - 1)(x 4 - 3x 3 + (-2e + t - 1)x 2 + (3t 2 - 4t + 8)x + t 4 - t 3 + t 2 + 4t - 4 = 0 with multiplicity 3; (d): x - t - 2 = 0 with multiplicity 1. 7.6. The vibrational spectrum of a graph pa + pa- I + tpb for any irrcducible representation p and a = (12345), b = (12)(34), for the dimension 5 representation ps we have For example, The Laplacian L of a graph r is an operator acting on the space of functions {f : V(r)  IR}. A natural generalization is the vibrational Laplacian Lx which acts on the space F(V,X) = {f: V(f)  X} for some vector space X. We use the word "vibrational" since the spectrum of the vibrational Laplacian Lx of a graph r for the special case of X = IR3 is exactly the vibrational spcctrum of the moleculp whose atoms correspond to the vertices of r and whose bonds bct.wecn at.oms arc just edges of r [84]. pc,la) = U   I n We start with a homogeneous graph r with the associated group 7-l and isotropy group I. We can generalize the Dirichlet sum (see Section 1.2) as follows: Suppose that to each edge, e = {u, v}, of the graph we associate a self-adjoint operator, A" on X; we then define the quadratic form Q on F(V, X) by 1 (7.4) (g, LXg) = 2' 2)g(u) - g(v)] . A, ' [g(u) - g(v)] where the sum ranges over all edges of r. Suppose p denotes a representation of 7-l on X. Furthermore, suppose A, in (7.4) satisfies Aap = p(a)A,p(a)-1 where ae denotes the edge {ab, ac} and the edge e is denoted by {b, c}, Then it can be shown (see [84]) that the spectrum of Lx can be decomposed into the union of the spectra of the following operators ovcr all irreducible representations, of f: ( 2: Ag ) Q9 I - 2: Agp(g) Q9 ,(g) gEl( gEl( u 0 0 0 ) 0 0 0 ps(a- I ) = 1 0 0 0 1 0 0 0 1 (' -1 -1 -1 -1 ) p,lb) =  0 0 0 1 0 1 0 0 0 0 1 0 1 0 0 0 C' 1 - t -t -t 1-t ) p,la) , ",(a -, H 'p,lb) =  0 1 0 t 1 t 1 0 0 1 t 1 t 0 ] 0 (7.5) where Q9 denotes the cartcsian product (of matrices). Now we return to the example of the Buckyball graph. We will apply Hookc's law to derive the vibrational spcctrum of this graph, Let u E IR 3 and w E IR 3 denotc the equilibrium positions of the vcrtices labeled u and w. Lct. h : V  IR 3 
120 7 EIGENVALUES OF SYMMETRICAL GRAPHS 7.6. THE VIBRATIONAL SPECTRUM OF A GRAPH 121 describe a deviation from equilibrium, so that u + h(1L) is the new position of the vertex 1L. Then the potential energy associated to h can be expressed as: W(h) =  2>",w(l\u + h(1L) - (w + h(w))I\-l\u - wl\)2. In the above expression,. the sum is over all pairs {1L, w} of vertices connected by an edge, and k",w is the spring constant of that edge. If h is sufficiently small so as to enable us to ignore terms quadratic in h, we then have 1 lIu + h(1I) - (w + h(1II)) II  [liu - wll 2 + 2(u - w) . (h(1L) - h(1II))] 2  lIu - wll + W",w . (h(1L) - h(w)) the 180-dimensional displacement space decomposes into 48 = 3 x 16 irreducibles, Subtracting off two three-dimensional representations, we obtain: 2. The number of distinct vibrational modes is at most 46, For a vibrational line to be visible as an absorption or emission line in the infrared (as a transition between the ground state and a one-photon state) it is necessary that the associated irreducible representation be equivalent to (the com- plexification of) the representation of H. on the ordinary three-dimensional spacp {R:J in which the moleeule lies. where u-w In the Raman experiment, light of a definite frequency is scattered with a change of frequency. This change, known as the Raman spectrum, is associated to those representations which intertwine with the space 52 ({R3) of symmetric two tensors. Therefore, both the infrared spectrum and Raman spectrum can be directly determined by using the Frobenius reciprocity formula. For details on this, the reader is referred to [84, 230]. W",UI = lIu - wl\ is the unit vector from u to wand. denotes the scalar product on {R3. Then the quadratic approximation to W is given by W(h) =  L k",w[w",w . (h(1L) - h(W))]2. Hence, we may take Ae to be a 3 x 3 matrix: Ae = wu,w I8i w,w 3. The space of classical vibrational states has dimension 174. Any force matr'ix, F, invariant under the group A5 has (at most) 46 distinct eigenvalue, yielding four lines visible in the infrared and ten in the Raman spectrum. where e is the edge joining 1L to 111. We can now use the above methods and (7.5) to compute explicitly the vibra- tional spectra of a molecule in terms of the irreducible representations of A5.. The space of displacements is F(V, IR3) = {J : V --t {R3}. We choose p to be the ordmary three-dimensional representation (which is just rotation in {R3). Using irreducible representations of A 5 , we can then evaluate explicitly all vibrational eigenvalues by treating 3 x 3,9 x 9,9 x 9,12 x 12, and 15 x 15 matrices. We point out that the above methods not only determine the vibrational spec- trum, but also the specific representation associated to each eigenvalue. This addi- tional information is important in chemical applications. For the case of homoge- neous molecules, we can, in advance of all computations and independent of specific models for the potential energy, determine the number of representations of each type by a simple application of the Frobenius reciprocity formula. Now the space of displacements of the Buckyball has dimension 180 = 60 x 3. But the space of entire (infinitesimal) rigid displacements of the molecule a a whole is six-dimensional (the Lie algebra of the Euclidean group). By subtractmg these six dimensions, we get 1, The space of vibrational states is 174-dimensional, The 180-dimensional space is the tensor product of the regular representation with a three-dimensional representtion. So we must decompose the regular repre- sentation which contains each irreducible representation with a multiplicity equal to its dinension, We have already mentioned the irreducibles of A5 which we here dpnotp as 1, 3, 3',4 and 5, wlwre 3 is the thrpe dimensional representation given by t.he action of A5 on the icosahedron, and 3' differs from 3 in that the generator of dpgrpe 5 has been rpplaced by its square. Since 1 + 3 + 3 + 4 + 5 = 16, we see that Notes: The proofs in Section 2 are mainly adapted from [14]. There are several chap- ters on distance transitive graphs in Biggs [25]. Here we have given slightly different. proofs. The computation for the spectrum of the Buckyball graph is based on [87], More reference on the vibrational spectrum of graphs can be found in [84, 85, 86]. 
CHAPTER 8 Eigenvalues of subgraphs with boundary conditions 8.1. Neumann eigenvalues and Dirichlet eigenvalues In a graph G, for a subset S of the vertex set V = V(G), the induced subgraph determined by S has edge set consisting of a.lI edges of G with both endpoints in S. Although an induced subgraph can also be viewed as a graph in its own right, it is natural to consider an induced subgraph S as having a boundary. (Here and throughout, we shall denote by S the induced subgraph determined by S, when there is no danger of confusion.) There are two types of boundaries. The vertex boundary 8S of an induced subgraph S consists of all vertices that are not in S but adjacent to some vertex in S (also defined in Chapter 2). The edge boundary, denoted by as, consists of all edges containing one endpoint in S and the ot.her endpoint not in S, but in the "host" graph. The host graph can be regarded as a special case of a graph with no vertex boundary and no edge boundary. For an induced subgraph S with non-empty boundary, there are, in general, two kinds of eigenvalues - the Neumann eigenvalues and the Dirichlet eigpnvalues, subject to different boundary conditions. Neumann boundary condition: The Laplacian I:- acts on functions I : SU8S -t IR with the Neumann boundary condition, Le., for every x E 8S (8.1) 2: (J(x) - I(y» = O. yES,yx Dirichlet boundary condition: The Laplacian I:- acts on functions with the Dirichlet boundary condition. In other words, we consider the space of functions {J : V -t IR} which satisfy the Dirichlet condition (8.2) I(x) = 0 for any vertex x in the vertex boundary 8S of S. We remark that the Dirichlet boundary condition for graphs corresponds natu- rally with that for smooth manifolds. In fact, the general condition with boundary value specified by a given function on 8S will be discussed in the last section of this 121 
124 8. EIGENVALUES OF SUBGRAPHS WITH BOUNDARY CONDITIONS 8,2. THE NEUMANN EIGENVALUES OF A SUBGRAPH 125 chapter. As we will see, problems with the general boundary condition can often be reduced to problems with the Dirichlet boundary condition (8.2), The Neumann boundary condition (8,1) conesponds to the Npumann boundary condition for Riemannian manifolds: af(x) = 0 al/ for x on the boundary where 1/ is t.he normal direction ort.hogonal to the t.angent hyperplane at x, Neumann eigenvalues are closely associated with random walk problems whereas the Dirichlet eigenvalues are related with many boundary-value problems. (b): for x E 85, L (J(x) - fey» = o. Y {X,Y}E8S This is the Neumann condition. Equivalently, 1 f(x) = d' x 8.2. The Neumann eigenvalues of a subgraph 2: I(y) Y {X,Y}E8S where d denotes the number of neighbors of x in 5. (c): for any lunction h: 5 U 85 -t IR, we have 2: h(x)LI(x) = 2: (h(x) - hey» . (J(x) - I(y». xES {x,Y}ES. (8.3) >'5 inf NO I:. ES f(x)d.=O 2: (J(x) - f(y»2 {x,y}ES. L f2(x)d x xES We remark that the proofs of (a) and (b) follow by variat.ional principles and that (c) is a consequence of (b). Using Lemma 8.1 and equation (8.3), we can rewrite (8.3) by considering the operator acting on the space of functions {f : 5 -t IR}, or, alternatively on the space of functions {J : 5 U 85 -t IR and I satisfies the Neumann condition}: Lpt. S dpllotp a subd of th/' V('rt('x ('t. \I(G) of C. Let. S* ,kllot.e tlw Ullioll of the edges in 5 and the edges in iJ5. We define the Neumalln eigenvalUe of an induced subgraph 5 as follows: (8.4) >.S inf I:f(!jd.=O E 12(x)d x xES 2: l(x)Lf(x) xES 2: (I(x) - l(y»2 . {x,Y}ES' mf sup NO c E(J(x) - (Yd x xES In general, we define the i-th N('umann ('igenvalue >'S,i to be 2: (J(x) - f(y»2 . {x,y}ES. >'s i = mf sup 2 ' NOf'ECil 2:)/(x) - f'(x» d:r xES where C k is the su bspace spanned by functions rPj achieving >'s,j, for 0 S j S k. Clearly, >'s,o = 0, We use the notation that >'5,1 = >'s and we remark that d x still means the degree of x in G (independent of S). From the discrete point of view, it is often us('[ul t.o express t.he >'S,i as eigen- values of a mat.rix £s. To achieve t.his, we first derive the following facts: LEMMA 8.1. Let I denote a function I : S U 85 -t R satisfying (8,3) with eigenvalue >.. Then I satisfies: 2:g(x)£g(x) xES E g(x)2 xES . f (g, £g)s In g1.1"/21 (g, g)s where £ is the Laplacian for the host graph G and (/1, f2)s = 2: It (x)f2(x). xES inf g1.Tl/21 For X C V, we let Lx denote the submatrix of L restricted to the columns and rows indexed by vertices in X. We define the following matrix N with rows indexed by vertices in 5 U 85 and columns indexed by vertices in 5. (a): for x E 5, N(x,y) = { 1 d' x o if x = y if x E 5 and x i- y if x E 85, y E 5 and x  y otherwise Lf(x) = E (I(x) - fey» = >.f(x)d x , y {:r,y}ES. Further, we define an 151 x 151 matrix N s = T- 1 / 2 N* Lsuos N T-I/2 
126 8. EIGENVALUES OF SUBGRAPHS WITH BOUNDARY CONDITIONS 8.3. NEUMANN EIGENVALUES AND RANDOM WALKS 127 wll('rp N' dpnot.ps thp t.ranspos(' of N. It is msy to see from equation (8.4) that the :>"S,i are exactly the Neumann eigenvalues of N s . In fact N s has an eigenvalue 0 and, if 5 is connected, it has 151 - 1 positive eigenvalues, This can be proved by using the Neumann condit.ion a$ follows: 1-p xy inf X,YES ffO 2: U(x) - f(y))2 + 2: (f(x) - f(y))2/d z xrvz""""y x,yES,z'l.S 2: f2(x)d x xES 2: U(x) - f(y))2 + L L[d:f 2 (x) - (2: f(y))2]/d: x"'y z(/S x......,z y"'"'z > inf x,yES xES yES NO 2: f2(x)d x xES For an induced subgraph 5 of a graph G, we consider the following so-called Neumann random walk: The probability of moving from a vertex v in 5 to a neighbor u of v is lid" if u is in 5. If u is not in 5, we then move from v to each neighbor of u in 5 with the (additional) probability 1/d"d where d denotes the number of neighbors of u in 5. The transition matrix P for this walk, whose columns and rows are indexed by 5, is defined as follows: > L (f(x) - f(y))2 + L LU 2 (x) - f 2 (z)) x-y z'l.sx-z inf x,yES xES NO L f2(X)d x xES 8.3. Neulnann eigenvalues and random walks  2: (f(x) - f(y))2 + 2: 2:U(x) - f(Z))2 x-y z'l.S x-z inf x,yES XES No 2: f2(X)d x xES (8,5) 1 1 fP(v) = 2: T f(u) + 2: d d' f(u) uES ( U uES tL z u"'t' u"""" z......, v z'l.S L (f(x) - f(y))2 . f {x,y}ES 1Il No L f2(X)d x xES :>..S The stationary distribution is d v l2: d u at the vertex v. We remark that above Neumann walk is somewhat difIeren from the random walks often used (in which if v has r neighbors not in 5, then the probability of staying at v is rid".) In. a way, the Neumann walk takes advantage of "reflecting" from the boundary as dictated by the Neumann boundary condition. The eigenvalues Pi of the transition probability matrix P associated with the Neumann walk are related to the Neumann eigenvalues :>"S,i as follows: where f ranges over all functions f : 85 U 5 --+ IR satisfying 2: f(x)d x = 0, xES and for x E 85 2: (!(x) - f(y)) = O. YES,yx Inequality (8.6) is quite useful in bounding the rate of convergence of Markov chains for problems which can be formulated as random walks in a subgraph with a bound- ary. Pi = 1 - :>"S,i. Suppose 5 is an induced subgraph of a k-regular graph. The above random walk can be described as follows: At an interior vertex v of 5, the probilbility of moving to each neighbor is equal to 1/k. (An interior vertex of 5 is a vert.ex adjacent to no vertex outside of 5.) At a boundary vertex v E 85, the probability of moving to a neighbor u of v is 1/k if u is in 5, and, in this case where u rt 5, an (additional) probability of 1/(kd) is assigned for moving from v to each neighbor of u in 5, The stationary distribution of the above random walk is just the uniform distribution. In particular, we have (8.6) P = PI = 1 - :>"S,I = 1 - :>"s, 
128 8. EIGENVALUES OF SUBGRAPHS WITH BOUNDARY CONDITIONS 8.5. A MATRIX-TREE THEOREM AND DIRICHLET EIGENVALUES 129 8.4. Dirichlet eigenvalues (1): for xES, £g(x) =  L ( g(X) - g(y) ) = Ag(X) ,;d;y,;d;,fiI; {x,Y}ES. (2): for any function h : V --+ IR, L h(x)£g(x) = L ( h(x) _ h(y) ). ( g(x) _ g(y) ) xES {X,Y}ES.,;d; ,fiI; ,;d; ,fiI; We consider a graph G with vertex set V = V(G) and edge set E = E(G). Let S denote a subset of V and we assume that the vertex boundary 8S is nonempty. We use the notation f E D* to denote that f satisfies the Dirichlet boundary condition f(x) = 0 for x E 8S. The Dirichlet eigenvalues of an induced subgraph on S are defined as follows: inf g#O gED. L (J(x) - f(y))2 {x,y}ES. L f2(x)d x xES L ( g(x) _ g(Y) )2 {X,Y}ES.,;d; ,fiI; L g(x)2 xES The proof of (1) follows from the variational principles and will be omitted. To see (2), we note that L h(x)£g(x) - L ( h(x) _ h(y) ). ( g(x) _ g(y) ) xES {X,Y}ES.,;d; ,fiI; ,;d; ,fiI; L g(x) ( h(x) _ h(y) ) x Eo s,;d;,;d; ,fiI; o. (8.7) A(D) I inf NO fED. . f (g, £g) In - #0 (g, g) gED. As an immediate consequence of Lemma 8.2, for functions f : S --+ IR under the assumption that f(y) = 0 for y E 8S, we have, for all XES, £f(x) = £sf(x) In general, we define the i-th Dirichlet eigenvalue Ai to be L (J(x) - f(y))2 (D). {x,y}ES. A. = mf sup "" 2 t NOf'Ec,_t (J(x) - f'(y)) d x xES where £s is the submatrix of £ restricted to columns and rows indexed by vertices in S. We note that since 8S i- 0, £s is nonsingular. All eigenvalues of £s are positive. Hence The Dirichlet eigenvalues of the induced subgraph on S are just the eigenvalues of £S and the determinant of £s can be expressed as: ISI det £s = II AD) . i=1 where C i is the subspace spanned by eigenfunctions CPj achieving Aj, for 1 :<::: j :<::: i. We use the notation AiD) = A<f). We will index the Dirichlet eigenvalues for a subgraph on ISI vertices by 1 :<::: i :<::: ISI. With very similar proofs to those in Chapter 1, it can be shown that for a connected induced subgraph S of a graph G with as i- 0, we have 0< A(D) < lasl < 1 I - vol S - 8.5. A matrix-tree theorem and Dirichlet eigenvalues One of the classical combinatorial theorems is the matrix-tree theorem which states that the determinant of any cofactor of the combinatorial Laplacian is equal to the number of spanning trees in a graph. This result can be traced back to Kirchhoff [171]; see also Maxwell [196], Sylvester [232] and Cayley [47]. There is a large literature of related work such as Thtte [239], Bott and Mayberry [39], Trent [238], Uhlenbeck and Ford [240], Renyi [218], and Moon [200]. 0< A(D) < 2 t - In this section, we consider a generalization of the matrix-tree theorem for induced subgraphs of a graph (see [89]). For an induced subgraph S with non- empty boundary in a graph G, we define a rooted spanning forest of S to be any subgraph F satisfying: (1) F is an acyclic subgraph of G, (2) F has vertex set S U 8S, (3) Each connected component of F contains exactly one vertex in oS. for 1 :<::: i :<::: ISI. LEMMA 8.2. For an induced subgmph S, let 9 denote an eigenfunction of £ with Dirichlet eigenvalue A, i.e., 9 : S --+ IR satisfies (8.7) and the Dirichlet boundary condition g(x) = 0 for x E oS. Then 9 satisfies 
130 8. EIGENVALUES OF SUBGHAPIlS WITH BOUNDARY CONDITIONS 8.6. DETERMINANTS AND INVARIANT FIELD THEORY 131 151 II d r II ,\; TES i=-l Proof: From Claims 1 and 2, we know that edges of X form a forest and each connected component cont.ains exactly one vertex in 8S, There is a column indexed by an edge with only one nonzero entry, say (.7:1, Cl) with XI E S. Therefore, 1 Idet llxl =  ldetll)1 where ll) denotes the submatrix with rows indexed by S - {Xl} and colulllns indexed by X - {e}. By rellloving one edge and one vertex at a time, WI' cvpnt.ually obtain The following theorem (see [89]) relates the product of t.he Diriehlet eigenvalues of S to the enumeration of rooted spanning forests of S: THEOREM 8.3. For an induced sl1bgmph S in a gmph G with tiS i= 0, the number of rooted spanning fOT'csts of 5 is 1/Ih('7'e Ai, 1 ::; i ::; 151, aT'e the Dirichlet rigenvalues of the Laplacian of S in G. { 1 ,jd; ll(x,e) = _ ,jd; D if e = {x, y}, X < y 1 Idetllxl = n0J:. xES Combining Claims 1-3, we have 151 II Ai PROOF. We consider t.he incidence matrix II with rows indexed by vertices in S and columns indexed by edges in S* defined as follows: i=l det £ = L det B x det llx x if e = {x, y},.7: > y 1 n d I {rooted spanning forests of S} I. xES x This completes the proof of Theorem 8,3. o otherwise. We have (8.8) L = II ll* We remark that the usual matrix-t.ree t.heorem can be viewed as a special (:;ISP of Theorem 8.3. Namely, for a graph G, we apply Theorem 8,3 to an induced sllhgraph H on V(G) - {v} for some vertex v in G, The rooted spanning forests corrpspond in an one-t.o-one fashion to all t.rees in G. where B* denotes the t.ranspose of B. Then ISI II Ai i=1 det £ 8.6. Determinants and invariant field theory det. B B* L det llx det ll"x. x wll('re X ranges o\'('r all possible choicps of s - 1 edges and llx (iPnot.es the squarp submatrix of II whose s - 1 columns correspond to the edges in X. Conformal invariant theory for free bosons intimatdy usps t.hp dd,'rIllinant of the Laplacian with Dirichlet boundary conditions (see [142], [176]). The discrete version can be described as follows: For an indllcfd subgraph S with non-empt.y boundary 8S, suppose a is a function defined on till' boundar.\' (\S. (Often t.he function a satisfies sOllie periodic condit.ions as well.) 'I'll(' "pnprgy" for a funct.iou f is related to Claim 1: If the subgraph with vert.ex set S u tiS and edge set X contains a eycle, then del, llx = D. The proof follows from the fact that the columns restricted to those indexed by the cycle are dependent. Claim 2: If t.h€' subgraph formed by edge set X contains a connected component having t.wo wrt.ices in 8S, then det.llx = 0, Proof: LPI. }' dpnot.e a connected component of t.he subgraph form€'d by X. If Y contains !!lore than on£' v€'rtex in 8S, then Y has no more than IE(Y)I - 1 vertices in S. Thp submatrix fOflllPd by the coluIllns corresponding to edges in }' has rank at most IE(} ')\ - L Cons€'qumtly, det llx = D. H(J) = L[J(x) - f(y)J2 xy xES where the summation ranges over all edges {x, y} at least one endpoint of which is in S. The partition function can be expressed as Z(a) = J e- c H(f) where f ranges over all functions whose restriction on 8S is a, Claim 3: If t.he subgraph formed by X is a rooted forest of S, then 1 I det llxl = n ,jd; ' xES x To compute Z(a), we note that the function fo t.hat minimizes H(J) and shares the same value as a on t.he boundary, also satisfies t.he following condit.ion for all xES: L(Jo(x) - fo(y)) = D. y yx 
132 8. EIGENVALUES OF SUBGRAPHS WITH BOUNDARY CONDITIONS 8.6. DETERMINANTS AND INVARIANT FIELD THEORY 133 This can be proved by variational principles. Also, it is not difficult to show that such a function exists if 5 is connected and, when it exists, is uniquely determined. For any function 9 whose restriction to 55 is (7, we consider imitations. The heat kernel of a graph plays a major role there and will be discussed In the next chapter. 1 = 9  10 Clearly, 1 satisfies thc Dirichlet condition. Wc can rewrite H(g) as follows: H(g) L (f(x) - l(y))2 + L (fo(x) - IO(y))2 {x,y}ES. {x,y}ES. + L (f(x) - I(y))(fo(x) - lo(Y)) {x,Y}ES. L (!(x) - l(y))2 + L Uo(x) - IO(y))2 {x,Y}ES. {x,y}ES. + L lo(x) L(J(x) - I(y)) xES. yES T'"'-'Y Notes: The Neuann .eigenvale and Neumann walks are mainly based on [60] and [79]. More discussIOn on DIrIchlet eigenvalues can be found in [176] and also in [89]. L (f(x) - l(y))2 + L (fo(x) - IO(y))2 {x,y}ES. {x,y}ES. Therefore, we have Z = e- c HUo) ! e- c H(!) where 1 ranges over all functions satisfying the Dirichlet condition. If we express 1 relative to the basis formed by orthonormal eigenfunctions cPi of the induced graph 5 with n vertices, we obtain I=LxicPi. Thus, IJ(!) = LX;A; i and Z e- c HUo) J e-CL,>'ixdxi ISI c- n / 2 (IJ Ai)-1/21r- n / 2 . i=1 Therefore thc present problem is reduced to the problem of evaluating the prod- uct n:\ Ai of the Dirichlct eigenvalues which, in turn, is the same as enumcrating rooted spanning forests of an induced subgraph. The problem of evaluating the determinants of Laplacians on Riemann surfaces has been considered by many researchers (e.g., Polyakov [212] in string theory, Ray-Singer [216] in analytic torsion, D'Hoker and Phong [95] in connection with Selberg's zeta function, Sarnak [220], Osgood, Phillips and Sarnak [203, 204] for isospectral sets). The discrete parallel involves a combinatorial trace formula and zeta functions, which however will not be included in this book because of space 
CHAPTER 9 Harnack inequalities 9.1. Eigenfunctions A crucial part of spectral graph theory concerns understanding the behavior of eigenfunctions. Intuitively, an eigenfunction maps the vertices of a graph to the real line in such a way that edges serve as "elastic bands" with the effect of pulling adjacent vertices closer together. To be specific, let I denote a harmonic eigenfunc- tion with eigenvalue>. in a graph G (or for an induced subgraph S with nonempty boundary). Locally, at each vertex, the eigenfunction stretches the incident edges in a balanced way. That is, for each vertex x, I satisfies L (I(x) - I(y)) == V(x)d x . y yx Globally, we would like to have some notion that adjacent vert.ices are close to one another. In spectral geometry, Harnaek inequalities are exactly the tools for cap- turing the essence of eigenfunctions. There are many different versions of Harnack inequalities (involving constants depending on the dimension of the manifold, for example,) We consider the following inequality for graphs: Harnack inequality: For every vertex x in a graph G and some absolute constant c, any eigenfunction I with eigenvalue>. satisfies (9.1) d L (I(x) - l(y))2 S c>.m;x/ 2 (z). y yx Nevertheless, the above inequalit.y in general does not hold for all graphs. An pa.sy counterexample is the graph formed by joining two complete graphs of the same size by a single edge. The main goal of this chapter is t.o establish the Harnack inequality (9.1) for certain homogeneous graphs and their subgraphs. In the next section, we will dis- cuss several notions of convexity for graphs. After we establish a Harnack inequality for certain homogeneous graphs, we will examine Harnack inequalities for Neumann eigenvalues and Dirichlet eigenvalues for various convex subgraphs. We will also use the Harnack inequalit.y t.o derive lower bounds for eigenvalues in terms of the diameter and degree of the graph. This section is mainly based on [58] and [56]. 1'11) 
1 :16 !J. IIAHNACI< INEQlJALlTmS 9.2. CONVEX SUBGHAPIIS OF 1I0MOGENEOlJS GHAPIIS 137 9.2. Convex subgraphs of homogeneous graphs Convex subgmphs aKa- 1 =K. In ot.her words, K is invariant. as a sct nndcr conjugation by elemcnts of K. For cxamplc, a homogeneous graph associat.ed with an abclian group is invariant and we call the graph an abelian homogencous graph. Suppose a homogeneous graph f is associated with a nonabelian group 71.. If t.he edge generating set. K is a subgroup of 71., then f is still invariant. An induced subgraph 5 of a homogeneous graph f with vertex boundary 05 is said to be convex if for any subset X C 05, we have (9.2) IN*(X) \ (5 U 05)12: IXI where N*(X) = {y : y E X or y  x E X}. In other words, any subset X of the boundary. 05 of 5 has at least as many neighbors outside of 5 as the cardinality of X. We WIll call (9.2) the boundary expansion property. LEMMA 9.2. If two induced subgmphs FI,F2 are both convex, then the induced subgmph FI n F 2 is convex. Let r denote a homogeneous graph with an associat.ed group 71. and isot.ropy group I. Let. K denot.e t.he edge generating set.; we require 9 E K if and only if g-I E K. We say that a homogeneous graph is invariant if for every element a E K, we have Before we give definitions for convex subgraphs, some explanations are in order. Although t.he following various not.ions of convexity are quite natural and interest- ing by themselves, thcy arc dictat.ed by t.he proofs given later for establishing the Harnack inequalit.ies for Neumann eigenvalues and for Dirichlet eigenvalues. An- other motivation in defining convex subgraphs is in its relevance with random walk problems. Many combinatorial enumeration and sampling problems involve families of combinatorial objects which can be regarded as vertices of convex subgraphs of appropriat.e host graphs. Harnack inequalities and the resulting eigenvalue bounds can be used to derive polynomial t.ime upper bounds for the rat.e of convergence for t.hc sampling problem, which often thcn give efficient approximation algorit.hms for t.he associat.ed PllIlmcration problems. PROOF. Suppose X C o(H n F 2 ). We can part.ition X into two parts XI = X n oF I and X 2 = X \ oF I . Clearly X 2 is contained in Fl. Since Fl and F 2 are convex, we have IN*(Xt) \ (F l U OFt) I 2: IXi! IN*(X 2 ) \ (F 2 U OF 2 )1 2: IX 2 1. Since N*(X 2 ) \ F 2 C Fl U oF l , we have (N*(X 2 ) \ (F 2 U oF 2 )) n (N*(Xt) \ (F l U oFt)) = 0. Hence Strongly convex subgraphs IN*(X) \ (F I n F 2 U o(F I n F 2 )1 > IN*(Xd \(F l U oFl)1 + 1N*(X 2 ) \ (F 2 U oF 2 )1 2: IXd + IX 2 1 = IXI. and the proof is complete. We note that (A) is implicd by the following condition: o . EXAMPE 9.3. We consider thc space 5 of all m x n matrices with non-negative Itegral entnes having column sums Cl,.. . ,C n , and row sums rl,.. . r m . FIrst: we cnsruct a homogeneous graph r with vertex set consisting of all m x n atnces.wlth mtegral (pssi.bly negative) entries. Two vertices u and v are adjacent If they differ at four entnes m some submatrix determined b y two C o lum ns " d k .. 1, J an rows , m satlsfymg An induced subgraph 5 of a homogeneous graph r with vertex boundary 05 is said to be strongly convex if the edge generating set K satisfies the following condition: (A): For all a, bE K , x E 05, if ax E 5, bx E 5, then we have b-Ia E K. (B): For all pairs of vcrtices u and v in 5, all shortest paths joining u and v are contained in 5. Clearly, the intcrsection of two strongly convex subgraphs is strongly convex, EXAMPLE 9.1. Suppose we consider a homogeneous graph ft with vertex set {(al,a2,'" ,ad: ai E Z'Lai = n}. A vertex (al,'" ,ai,'" ,aj,'" ,at) is i adjacent to (al,'" ,ai + 1,'" ,aj -1,'" ,at) for 1 :<::: i,j:<::: t. In particular, for a fixed i, we definc Hi = {(ai, a2,' . . ,ad : ai 2: O} to be a halfplane. It is easy to sce that. Hi is st.rongly convex and nH i = {(al,a2"" ,at) E V(rd: ai 2: O} is strongly convex. Uik = Vik + l,ujk = Vjk -l,Uim = Vim - 1,ujm = Vjm + 1 It is easy to see that f is a homogeneous graph with an edge generating set consisting of all 2 x 2 submatrices (_ -). A halfplane consists of matrices the (i,j)th entry of which is non-negative for some i and j. It is easy to see that 5 is just tl intersection of halfplanes. Ie We emark tha the definitions given here regarding convex subgraphs are far from bel.ng exhaustlve. One simple and general not.ion of convexity is to cmbed he vertices of the host graph into a manifold. A convex subgraph is just an mduced. subgrap!l on the intersection of the vertex set of the host graph with some submmfold havmg convex boundary. The techniques in this section are not enough t denve Harnac ineqalities for such a general definition of convex subgraph. We wlll return to this tOpiC after we discuss the heat kernels of graphs in t.hc IH'Xt chapter. 
138 9. HARNACK INEQUALITIES 9.3. A HARNACK INEQUALiTY FOR HOMOGENEOUS GRAPHS 139 9.3. A Harnack inequality for homogeneous graphs Now we consider Then the following inequality holds for all x E V(r) and a> 2: 1 >.a 2 - "[J(x) - f(axW + a>.j2(x)  _ 2 sup f2(y). k a- y aEK. 1 k L[J2(x) - f2(ax)) aO:: 2" 1 k  f(x)[f(x) - f(ax)) - k L[J(x) - f(ax))2 aEK. aEK. 2 1 " 2>.j (x) - k [J(x) - f(axW. aEK. Combining the above arguments, we have, for any positive a: We will first prove the following Harnack inequality for homogeneous graphs which are invariant. Lf2(X) THEOREM 9.4. In an invariant homogeneous graph r with edge generating set K consisting of k generators, suppose a function f : V(r) -+ IR satisfies 1 Lf(x) = - L[J(x) - f(ax)] = >.j(x). k aEK. 1 L(k L[J(x) - f(axW + a>.j2(x))  2a>.2 f2(x) aEK. p(x) =  Llf(x) - f(gxW gEK. (a - 2)>' " - k [J(x) - f(axW. aEK. Now we consider a vertex v which maximizes, over all XES, the expression 1 k L[J(x) - f(axW + a>.j2(x). aEK. PROOF, We define and we consider Lp(x) = :2 L L Hf(x) - f(ax)]2 - [J(bx) - f(abx)]2} bEK. aEK. - :2 L L[J(x) - f(ax) - f(bx) + f(abxW bEK.aEK. 2 + k2 L L[J(x) - f(ax) - f(bx) + f(abx)J[f(x) - f(ax)). bEK.aEK. We have 1 o  L( k L[J(v) - f(av))2 + a>.j2(v)) aEK.  2a>.2 f2(v) - >.(a k- 2) L[f(v) - f(av)f. aEK. This implies x = 2 k2 L L [J(x) - f(ax) - f(bx) + f(abx)) [J(x) - f(ax)] bEK. aEK. :2 L {L[J(x) - f(ax) - f(bx) + f(bax)]} [J(x) - f(ax)] aEK. bEK. + :2 LlL(J(abx) - f(bax))J[f(x) - f(ax)) aEK. bEK. 2>' 2 " " k L[J(x) - f(axW + k 2 l(J(abx) - f(bax))][f(x) - f(ax)). aEK. aEK. bEK. 1 " 2>.a k [J(v) - f(avW  - f2(v) aEK. a - 2 for a > 2. Therefore for every x E V(r), we have Let X denote the last double summation above. Then 1 k L[J(x) - f(axW + aV 2 (x)  aEK. 1 k L[J(v) - f(avW + aV 2 (x) aEK. 2>.a 2 2  a _ 2 f (v) + a>.j (x) a 2  - 2 >.max f2 (y) a- y for a > 2. The proof of Theorem 9.4 is complete. o Since r is an invariant homogeneous graph, we have L(J(abx) - f(bax)) = 0 bEK. By taking a = 4 in Theorem 9.4 we have THEOREM 9.5. In an invariant homogeneous graph r with edge generating set K consisting of k generators, suppose a function f : v(r) -+ IR satisfies 1 Lf(x) = k L[J(x) - f(ax)) = V(x). aEK. and therefore Lp(x)  X = 2: L[J(x) - f(axW. aEK. 
140 9. HARNACK INEQUALITIES 9.4. HARNACK INEQUALITIES FOR DIRICHLET EIGENVALUES 141 1 k L[f(x) - f(ax)f ::; 8.\ SUpf2(y). aEK. y Let </J(x) deote q,a(x), We consider, for xES, 1 Lq,(x) k L[q,(x) - q,(bx)] bEK. ::;  L[(J(x) - f(ax))2 - (J(bx) - f(abx))2] + a.\ L[!2(x) - f2(bx)] bEK. bEK. y+Z. Then for all x E VCr), 9.4. Harnack inequalities for Dirichlet eigenvalues In this section, we consider Laplacians acting on functions with Dirichlet bound- ary conditions. Let S denote a convex subgraph of a graph G. We first prove a useful lemma which which is a consequence of convexity. We examine y = 1 k L[(J(x) - f(ax»2 - (J(bx) - f(abx»2] bEK. 2 k L(J(x) - f(ax) - f(bx) + f(abx)(J(x) - f(ax) bEK. 1 -k 2')f(x) - f(ax) - f(bx) + f(abx))2 bEK. 2 k{L[J(x) - f(bx)] - 2)f(ax) - f(abx)j}(J(x) - f(ax») bEK. bEK. ::; 2.\[J(x) - f(axW ::; LEMMA 9,6. For a convex subgraph S of a graph G, an eigenfunction f (with Dirichlet eigenvalue .\) defined on SU8S, can be extended to all vertices of G which are adjacent to some vertex x in S U 8S so that it satisfies L(J(x) - fey)) = ,\f(x)d x . y yx PROOF. First we note that any eigenfunction f must have value 0 for any x E 8S. To extend f to all vertices adjacent to some vertex in S U 8S, we consider a system of 18S1 equations: L(J(x) - fey») = ,\f(x)d x y yx since Lf(x) = ,\f(x) for xES U 8S. Also, we have Z a.\ L[J2(x) - f2(bx)] bEK. for each x E 8S. The variables are fez) for every z r:t S U 8S and z  yES U 8S. The boundary expansion condition (9.2) implies that any k equations involve at least k variables for k ::; 18S1 and thus assures that this system of equations has solutions. 0 < a.\{L 2[J(x) - f(bx)]J(x) - L[J(x) - f(bxW} bEK. bEK. < a.\{2k,\f2(x) - L[J(x) - f(bx)f}. bEK. In particular, for v achieving the maximum value of q" we have THEOREM 9.7. Suppose S is a convex subgraph in an abelian homogeneous graph r with edge generating set IC consisting of k generators. Let f : S --t IR denote an eigenfunction with associated Dirichlet eigenvalue.\. Then the following inequality holds for xES and a E IC: 0::; Lq,(z) ::; 2ka.\2 f 2 (z) - .\(a - 2) E[J(z) - f(azW aEK. and q,g(x) = [J(x) - f(gx)f + ka,\f2(x) [J(z) - f(azW ::; 2k.\a f 2 (z) a-2 for a > 2. Therefore for all XES, g E IC, gx E S, we have [J(x) - f(gxW + ka,\f2(x) < [J(z) - f(azW + kn,\f2(x) 2k.\a 2 < a-2 f (z)+ka,\f2(x) k .\a 2 ::; _ 2 maxf2(y) a - yES for any a > 2. The proof of Theorem 9.7 is complete. o k.\a 2 [J(x) - f(ax)]2 + ka,\f2(x) ::; _ 2 sup f2(y) a - yES for any a > 2. PROOF. Using Lemma 9.6, we can extend f to all vertices adjacent to some vertex in S U 8S, For g E IC, we define for xES U 8S. First we note that the maximum value of q,g(x), ranging over all g E IC, x E Su8S, is achieved by some edge {z,az} where z E S. By taking a = 4 in Theorem 9.7 we have 
42 9. HARNACK INEQUALITIES 9.5. HARNACK INEQUALITIES FOR NEUMANN EIGENVALUES 143 From the definition of strongly convex subgraph b . d' Therefore, we have ' x IS a Jacent to gx for all bx E W. THEOREM 9.8. Suppose S is a convex subgraph in an abelian homogeneous lraph r with edge generating set K consisting of k generators. Let f : S -t IR denote In eigenfunction with associated Dirichlet eigenvalue >.. Then for all xES, a E K, 've have [f(x) - f(ax)]2  Sk>.supf2(y). yES 1 rPg(x)  tv L m;:XrPg(bx)  rPa(Z). bEW 9.5. Harnack inequalities for Neumann eigenvalues Case 2: Suppose gx E 8S and xES. rPg(x) [f(x) - f(gx)f + ka>.J2(x) 1 [f(x) - Wi I.:: f(bgx)f + ka>.J2(x) bEW' 1  Wi I.:: [f(x) - f(bgx)f + kaV2(x) bEW' 1  I L maxrPg(x) w bEW' 9 .  rPa(Z) where W' = 8gx n Sand w' - IW'I H because of strong convexity. - . ere we use the fact that bgx is adjacent to x In this section, we focus on Laplacians acting on functions which satisfy the Neumann boundary condition. For strongly convex subgraphs, a similar but slightly different Harnack inequality for Neumann eigenvalues can be derived. The proof is based on the assumption that the homogeneous graph is abelian and uses the Neumann boundary condit.ion, THEOREM 9,9. Suppose S is a finite strongly convex subgraph in an abelian homogeneous graph r with edge generating set K consisting of k generators. Let f : S -t IR denote an eigenfunction with associated Neumann eigenvalue >.. Then the following inequality holds for xES, a E K and ax E S: k).a 2 [f(x) - f(ax)]2 + kaV 2 (x)  - sup f2(y) a - 2 yES for any a> 2. Case 3: Suppose that x, gx E 8S. We define WI W 2 W 3 {b: bx E S,bgx E S}, {b: bx E S,bgx r:t S}, {b: bx r:t S,bgx E S}. PROOF. We consider, for some 9 E K, rPg(x) = [f(x) - f(gx)]2 + ka>.J2(x). We set Wi = IWi! and w = WI + W2 + W3. Then <pg(x) [f(x) - f(gx)f + kaV 2 (x) [ W3 f( x ) 1 "" W2 1 W + tv  f(bx) - - f(gx) - - I.:: f(b x)]2 bEW,UW 2 W W bEW, UW 3 9 Let {z, az} be an edge in S at which the maximum value of rPg (x) ranging over all 9 E K, x, gx E S, is achieved. 1 "" ka>. "" rPg(x)  -  [f(bx) - f(gxW + -  f(bx)2. W bEW W bEW +kaV 2 (x) 1  tv{ I.:: [f(bx) - f(bgx)f + I.:: [f(bx) - f(gxW bEW, bE W 2 + I.:: [f(x) - f(bgxW} bEW 3 ka>. { "" 2 +--w-  f (bx) + L f2(bx) + L f2(x)}. bEW, bEW 2 bEW 3 Suppose we can show that bx  g x for b E W d b e I . 2 an x  gx lor b E W TI b app ymg Cases 1 and 2, we have .I, ( x ) < .I, (z) d . d 3. len y 'l'g _ 'l'a ,as eSlre . To see that bx  gx for b E W 2 we consider b " s . . are in S. By the d fi 't' f ' . gx E u and ItS neighbors bx gx e 111 IOn 0 strong convexity we have bx Al b' bE W 3 , since bx E 8S and its neighbors x, bgx' are in S.  gx. so, x  gx for The rest of the proof is quite similar to that of Theorem 9.9, so will be omitted. o Claim: rPg(x)  rPa(z) for all x, gx E 8S U S. Proof We consider the following three possibilities: Case 1: Suppose gx E S and x E 8S. The Neumann condition implies that f(x) = .!.. I.:: f(bx) W bEW where V = 8x n Sand t1J = IVI. Therefore we have rPg(x) [f(x) - f(gx)]2 + ka>.J2(x) 1 1 [- "" f(bx) - f(gxW + ka>.[- L f(bxW. w t1J bEW bEW Thus 
144 9. HARNACK INEQUALITIES By taking (} = 4 in Theorem 9.9 we have THEOREM 9.10. Suppose S is a strongly convex subgraph in an abelian ho- mo eneous graph r with edge generating set IC consisting of  generators. Let f : g5 -t IR denote an eigenfunction with associated Neumann etgenvalue A. Then For all x E 5 a E IC, we have J" 2 ) [J(x) - f(axW ::; 8kASUpf (y . yES CHAPTER lO Heat kernels 9.6. Eigenvalues and diameters The Harnack inequality in previous sections can be used to derive the following eigenvalue inequality: THEOREM 9.11. The Neumann eigenvalue AS of a convex subgraph 5 of an abelian homogeneous graph r satisfies 10.1. The heat kernel of a graph and its induced subgraphs sup If(x)1 = 1 = sup f(x). xES xES . ( ) f( ) - 1 and let v denote a vertex with Let It denote a vertex with f It = maxxES x- . I . t . " f( x ) - 0 We now consider a shortest path P f(v) < O. Suc I a v ex IS s S11lce  -. xES ) Since the diameter of 5 is in 5 joining u and v, say, P = (u = VO, VI," . ,Vt = v . D, we have t ::; D. Many of the most powerful techniques in spectral geometry involve heat kernels, We will consider heat kernels for a graph or an induced subgraph having Laplacian acting on functions with boundary conditions. The name "heat kernel" is due to the fact that it is a fundamental solution of the following heat equation: au at = -£u. In a way, the Laplacian is associated with the rate of dissipation of heat. To be precise, suppose for a graph G on n vertices, or for an induced subgraph 5 on n vertices, we consider the Laplacian £ acting on functions with Neumann or Dirichlet boundary conditions (as defined in Chapter 8.) We can write £ as follows: 1 AS 2: 8kD2 where k is the degree of rand D is the diameter of 5. PROOF. Let f denote an eigenfunction defined on 85 achieving AS = A. We can choose f such that n-l £ = I: A;li i=O where Ii is the projection onto the ith eigenfunction CPi of the induced subgraph 5. For any t 2: 0, the heat kernel Ht of G is defined to be the n x n matrix Ht I:e->.;tI i We consider t-l S = I:[J(Vi) - f(VHl)]2. i=O e- tC (2 I - t£ + - £2 _ 2 By Theorem 9.lO, we have In particular, s ::; 8kAD. Ho = I On the other hand, we have where I denotes the identity matrix. > t-l 2)f(Vi) - f(Vi+iW i=O ..!..(f(u) - f(v))2 D 1 D All information about a graph is, of course, contained in its heat kernel. One of the main sources of power in using the heat kernel is the presence of the additional variable t. For example, the it provides flexibility for using the maximum principle. Sometimes, it is easier to establish inequalities or equalities involving the heat kernel either for all t or for a large range of t. We can then often deduce the spectrum by selecting t appropriately. s 2: 1 A 2: 8kD2 and the proof of Theorem 9.11 is complete, o We remark that the definition for the heat kernel for graphs is exactly the parallel of the heat kernel for Riemannian manifolds (see the book of Yau and Schoen [251]). The first four sections in this chapter are adapted from [60]. Section lO.5 is based on [79], Therefore we obtain 
146 10. HEAT KERNELS 10.2. BASIC FACTS ON HEAT KERNELS 147 10.2. Basic facts on heat kernels For the Dirichlet boundary condition, we have, for any vertex x in 5S, Let S denote an induced subgraph of a graph G. Let H denote the heat kernel of S subject to Neumann or Dirichlet boundary conditions. LEMMA 10.1. The heat kernel Ht for a graph G with eigenfunctions cPi satisfies Ht(x, y) = 2::>-,\;t <pi(X)<pi(Y). i F(x, t) = 0 (v): I.:: ( F(x, t) - F(y, t) )2 = I.:: F(x, t)£F(x, t) where S. denotes the {x,y}ES. va;; ..;cr;; xES set of all edges with at least one endvertex in S. PROOF. The proof follows from the fact that Ht = I.:: e-,\;t Ii PROOF. (i) is obvious, and (ii) follows by considering the a1l1's function 1: I.:: Ht(x,y)y'd; Y (H t T 1 !21)(x) Ii(x, y) = <pi(X)<pi(Y). T 1 !2 1 (x) ../d: . and o To see (iii), we have LEMMA 10.2. For 0::; s ::; t, we have I.:: H.(x, y)Ht-.(Y, z) = Ht(x, z). y aF at a -Ht! at _ie-a f -£F. The proof of Lemma 10.2 follows from the definition (by matrix multiplication). For a function f : S U 5S --+ IR, we consider The proof of (iv) follows from the fact that all eigenfunctions f have a corresponding F which satisfies (iv). F(x, t) I.:: Ht(x, y)f(y) yESU6S (Htf)(x). To prove (v), we consider I.:: F(x, t)£F(x, t) xES I.:: F(x, t)T- 1 !2 LT- 1 !2 F(x, t) XES I.:: Ht(x,y)y'd; =../d: yESu6S (iii): F satisfies the heat equation: aF = -£F at (iv): Under the Neumann boundary condition, we have, for the any vertex x in 5S, I.:: F(x,t) ( I.:: ( F(x,t) _ F(y,x) ) ) xES va;; Y va;; ..;cr;; {x,y}ES. I.:: ( F(x,t) _ F(y,X) )2 y va;; ..;cr;; {x,y}ES. by using the Neumann or Dirichlet condition as described in (iv). o Here we consider some useful facts about F and Ht: LEMMA 10.3. (i): F(x,O) = f(x) (ii): For xES U 5S, LEMMA 10.4. For all x, yES U 5S, we have Ht(x, y)  O. PROOF. The matrix A = 1-£ has all entries non-negative. Therefore etA has all non-negative entries. Since ,, ( F(x,t) F(y,t) ) _ O £F(x,t) =  fT - fd - y v '-'x V '-'y xy Ht = e-te tA , all entries of Ht are non-negative. The lemma is proved. o 
148 10. HEAT KERNELS 10.3. AN EIGENVALUE INEQUALITY 149 10.3. An eigenvalue inequality ::r the Laplacian with Neumann boundary condition, the above expression is equal In this section, we will establish an inequality for lower bounding the eigenvalue Al of a graph or a subgraph with boundary. The main method here is by repeatedly using the heat kernel and using various properties of the heat kernel. 2 L : F(x, t) ( F(x, t) _ F(y, t) ) xESUS t Vd; Vd; ...;rr; 2L!!. F(x,t) ( F(x,t) _ F(y,t) ) xES dt va; ..;;r; ...;rr; 2" d F(x, t) L- dt fT £F(x, t). xES V '-'x Suppose we have a function f : 5 U 55 --+ JR. We consider (10.1) 2 " rTT ( f(Y) F(X,t) ) g(x,t) = L-Ht(x,y)ydxdy fT - fT yE S y d y V Ux For the Laplacian with Dirichlet boundary condition, (10.4) is equal to 2 L F(x,t) L ( F(x,t) _ d F(y,t) xESUS Vd; y dt,jd; dt...;rr; ) {x,y}ES. 2 L F(x, t) L (!!. F(x, t) _ !!. F(y, t) ) xES,jd; y dt,jd; dt...;rr; {x,y}ES. = 2 L F(x, t)£  F(x, t), xES where F(x,t) = LHt(x,y)f(y). Therefore, we have y g(x,t) = LHt(x,y) Jdx/dy f2(y) - F2(x,t) yES By summing over x, we have (10.2) L g(x, t) = L L Ht(x, Y h./dx/dy f2(y) - L F2(x, t). xES xES yES x Using Lemma 10.3 (ii), (iv) and (v), we obtain L g(x, t) xES ( 10.3) In either case, (10.4) is equal to L f2(y) - L F2(x, t) yES x i t d - ds LF2 (x,s)ds o xES -2 1 t L F(x, s) :s F(x, s)ds o xES 2 [L F(x, s)£F(x, s)ds o xES 2 [ L ( F(x,t) _ F(y,t) ) 2 ds. o {x,y}ES. ,jd; ,,;rr; d 2 L dt F(x, t)£F(x, t) xES " d d -2 L.. d t F(x, t) . -F(x, t) xES dt -2 L(  F(X, t))2 xES s:: 0. Therefore L ( F(x,t) _ F(y,t) ? s:: {X,y}ES.,jd; ,,;rr; L ( F(x,O) _ F(y,0) )2 {X,y}ES.,jd; .,fJ; L ( f(x) _ f(Y) )2 {x,y} E s...;a; ...;rr;' We claim that for t  0, we have Fact 1: L ( F(X,t) _ F(y,t) ) 2 < L ( f(X) _ f(y) ) 2 {x,y}ES. p;  - {x,y}ES. P; .,fJ; To see this, we consider and Fact 1 is proved. !!. L ( F(X,t) _ F(y,t) ) 2 dt ..jd;.jd; {x,y}ES' 2 L ( F(x,t) _ F(y,t) )(!!. F(x,t) _!!. F(y,t) ) {x,y}ES. va;  dt P; dt,,;rr;' Substituting the inequality of Fact 1 into (10.3), we get Lg(x,t) 2[ L ( F(x,s) _ F(y,S) )2ds xES 0 {X,y}ES...;a; .;;r;; (10.5) s:: 2t L ( f(x) _ f(Y) )2 {X,y}ES.,jd; .,fJ;' (10.4) 
150 10. HEAT KERNELS 10.4. HEAT KERNEL LOWER BOUNDS 151 In the other direction, we consider the lower bound: f(y) F(x, t) 2 LLHt(X,Y) VdXdy ( Id - vcr; ) xES yES V l£y (  x ) '" fey) F(X,t) ) 2d L infHt(X,y) d L..,,( q: - va; Y xES yES Y yES V (,y x ( '" i nf Ht(X,y)Vf[; ) infL( f(Y) -c)2d y . L.." yES Id cER d y xES V l£y Y it follows from (10.7) that Combining (10.5) and (10.6), we have L ( f(x) _ f(Y) )2 yVf[;,fJ; {x,Y}ES. sup f( ) c L( -.L - c)2d y yE S "fiI; 1 '" . f [It(x, y)va; > - L.." 11l . - 2t yES ,fJ; xES 1 '" . f Ht(x,y)Vf[; Al 2: - L.." III 2t xES yES "fiI; .!. ( inf d t + ace) ) 2t y#xo y ( :J where 8 2 denotes the second largest degree in G. Thus, we have 1 (10.9) Al 2: 28 2 ' For example, for G = P3, the path with 3 vertices, it is true t.hat Ao = 0, Al = 1, and A2 = 2, while our estimate in (10.9) gives Al 2: 1/2. Applying this to G = I<n, the complete graph on n vertices, yields A n 1 2: 2(n _ 1) while the true value is Al = nl(n -1) (again off by a factor of 2). In fact, as pointed out by L. Lovasz, Al 2: 1/82 follows by directly using the Rayleigh quotient. L g(x, t) xES 2: (10.6) > Therefore we have proved the following: (10.8) 1 L . f H!(x, y)Vf[; A > - 1Il - 2t S yES ,fJ; xE For the remainder of t.his section, we will restrict ourselves to special subgraphs of homogeneous graphs that are embedded in Riemannian manifolds. Such a re- striction will allow us to derive eigenvalue bounds for graphs using the known results on eigenvalues of RIemannian manifolds. Also, the restricted classes of graphs still include many families of graphs which arise in various applications in enumeration and sampling. We remark that in Chapter 9, we derive eigenvalue lower bounds for subgraphs of homogeneous graphs with stronger convexity conditions by using a Harnack inequality. Both the definitions and the methods are different here. Roughly speaking, our goal here is to use the (continuous) heat kernels of the manifolds with convex boundary for deriving as the lower bound function for the (discrete) heat kernel. THEOREM 10.5. . I \ 1 for a n induced sub g ra p h S with heat kernel Ht (i) The Neumann etgenva ue /\ satisfies (10.7) 1 '" . f Ht(x, y)Vf[; A] > - L.." 1Il . - 2t S yES VJ:; xE (ii) The Dirichlet eigenvalue A for an induced subgraph S with heat kernel H! satisfies Suppose r is a homogeneous graph with associated group 11.. Here we assume that the edge generating set /C c 11. is symmetric, Le., 9 E /C if and only if g-1 E /C. 10.4. Heat kernel lower bounds Suppose vertices of r can be embedded into a manifold M with a measure f..L such that Theorem 10.5 can be used to establish eigenvalue lower bounds if we can effec- tively find good lower bounds for the heat kernels. ere, we. discus two examples. The first example is a direct, and simple way of usmg the mequahty (1O.). The second example is to bound the kernel for a "convex sub graph': by rela:ing It to an associated continuous heat kernel for an appropriate Riemanrnan ma111fold. We consider the special case of a graph G with no boundary. I adition, suppose the graph G has a "covering" vert.ex Xo with the property that Xo IS dJacent to every other vertex y in G. The degree of Xo is n - 1 where G has n vertices. We will apply (10.7) with t -t O. Since Ht = I - tf:- + ace), f..L(x,gx) = JL(y,gy) for any 9 E /C and x, y E Vcr). In addition, if JL(X,gX) =JL(y,g'y) for any g, g' E /C and x, y E VCr) then r is called a lattice graph. An induced subgraph on a subset S of vertices of a lattice graph r is said to be a convex subgraph if there is a submanifold M with convex boundary such that S consists of all vertices of r contained in M, i.e., S = M n Vcr). Furthermore, we require that for any vertex x, the Voronoi region Rx = {y : JL(Y, x) < f..L(y, z) for all z Ern M} is contained in M. 
152 10. HEAT KERNELS 10.4. HEAT KERNEL LOWER BOUNDS 153 EXAMPLE 10,6. As in Example 9,3., we consider a homogeneous graph r with vertex set consisting of all Tn x n matrices with integral (possibly negative) entries having column sums CI, ' .. ,C n , and row sums 1'1, . . . 1'm. Two vertices x and yare adjacent if they differ at four entries in some submatrix determined by two columns i,j and two rows k, m satisfying Xik = Yik + 1,xjk = Yjk -l,xim = Vim -l,Xjm = Yjm + 1 It is easy to see that r is a homogeneous graph with edge generating set consisting of all 2 x 2 submatrices ( _ i - i ). Obviously, r can be viewed as eing embeddd in the mn-dimensional Euclidean space M = JRmn. In fact, r IS embedded \11 a (mn - Tn - n + l)-dimensional subspace of M. We consider the set 5 of all m x n matrices with non-negative integral entries with given row and column sums. Suppose we choose the submanifold M, determined by U denotes the volume of the Voronoi region, and Co is an absolute constant satisfying Co::; Comin{CI,C;I} for some absolute constant Co. The proof of Theorem 10.7 is rather long and complicated. We will sketch the major ideas here; the details can be found in [60]. There are three major parts. Part 1: Lower bounds for the continuous heat kernel. Let h(t, x, y) denote the heat kernel of M and let u(t, x) = h(t, x, y) satisfy the heat equation 'i,, L-, .I.ij -- 1 i 8 (Ll- at )u(t,x) = 0 with the Neumann boundary condition LXij = Ci i a 8v u(t,x) =0 for any boundary point x. 1 Xij > -'2' It is easy to verify that 5 is a convex subgraph of the lattice graph r, Here we state the main theorem for bounding the eigenvalue .xl of a convex subgraph, THEOREM 10.7. Let 5 denote a convex subgraph of a lattice graph and suppose 5 is embedded into a d-dimensional manifold M with a convex boundary and a distance function J.L. Let K denote the set of edge generators and suppose I' = min{J.L(x,gx) : g E K}. In the first order approximation of the discrete Laplacian [, by the continuous Laplace operator, Here the Laplace operator Ll is taken to be 1'2 a 2 Ll = TKT L ag2 . gEl( Also, we assume that J.L(x,gx) = I' for all x E V(r) and g E K. Li and Yau established the following lower bound for H in their seminal paper [184]: (10.10) 2d" I' )2 - ' K I  (J.L(x,gx) 8g 2 gEl(. 8 2 Lai,j ax. ax' . . '] ',] consists of exactly one of a and a-I for all a E K. _ 2d [, 1'2 Theorem: Let M denote a d-dimensional compact manifold with boundary aM. 5uppose the Ricci curvature of M is nonnegative, and if 8M f= 0, we assume further that 8M is convex. Then the fundamental solution of the heat equation with the Neumann boundary condition satisfies where K* Suppose that h(t,x,y) 2: C-I(I')(vol(Bz(Vt))-lexp -Jl(X,y) (4 - I')t for some constant C(I') depending on I' > 0 and d such that C(I') -t 00 as I' -t 0, (Here, vole . ) denotes volume and Bz(r) denotes the intersection of M with the ball of radius l' centered at x.} CI/::; (ai,j) ::; C 2 1 where I is the identity matrix. Then the Neumann eigenvalue .xl of 5 satisfies the following inequality: Co l' 1'2 .xl 2: d 2 D(M)2 However, the above version of the usual estimates for the heat kernel cannot be directly used for our purposes here since the constant C is exponentially small depending on d. A more careful analysis of the heat kernel is needed. To lower- bound the discrete heat kernel, we will use the following lower bound estimates for the (continuous) heat kernel (a proof can be found in [60]). where U 151 l' = vol !II ' 
154 10. HEAT KERNELS 10.4. HEAT KERNEL LOWER DOUNDS Ifi5 For any a > 0, and a 2: cdo:, (1 + a)-d -(1 + a)t-t 2 (x,y) (10.11) h(t, x, y) 2: 4Bx( ..;at) exp at Suppose we choose a = , and C2tO = dD 2 (M), where C2 = 22/d and D(M) denotes the diameter of M. (We may assume D(M) :::: 1.) By using (10.11) we have bounds of Ht(x, V). The detailed proofs in [60] are somewhat long and will not be reproduced here. Using this, we then have C7U Ht(x,y) :::: _ I . vo M Part 3: Eigenvalue lower bound. c' h(C2 t O,x,y) :::: vol M ' Now we can combine all the estimates and use Theorem 10.5. Hence, Part 2: Approximate the discrete heat kernel by the continuous heat kernel, We define the following function k(t, x, y) which will serve as a lower bound for the heat kernel of the graph. k(t,x,y) = CI ( h(C2 t,x - z,y)<p(z)dz J M where <p is a bell-shaped function, for example, a modified. Gausian function exp(-c'lz/12) with compact support, say, {izi < /4}, and which satisfies (10.12) CI 1 <p(z)dz = C3 (C4)d h and c are chosen so that the above quantity is within a constant factor were C3 4 S k(t ) be a pp roximated by of the volume of the Voronoi region Rx. 0, ., x, y can h(C2t,X, y)U or .x 1 I> :::: - mf Ht(x, y) 2t xES yES :::: C7 U 151 tvolM :::: C7 2 r cP D(MF where U denotes the volume of the Voronoi region and r denotes the ratio Ul51/vol M, This completes the sketch of the proof for Theorem 10.8. To get a simpler lower bound for .x, we note that the diameter D(5) of the convex subgraph 5 and the diameter of the manifold are related by (10.14) D(M) S  D(5). (10.13) ( h(C2 t ,Z,y)dz JR. Therefore, we have the following: COROLLARY 10.8. Let 5 denote a convex subgraph of a simple lattice graph and suppose 5 is embedded into a d-dimensional manifold M with a convex boundary. Then the Neumann eigenvalue .xl of 5 satisfies the following inequality: Cor .xl :::: cPD2(5) when t is not too small (using the gradient estimates of h which are also proved in [60])). Here U denotes the maximum over x of the volume of Rx. From (10.12), we have where k(to-€',x,y) CI 1M h(C2 (to - '),x - z,y)<p(z)dz  { <p ( z)dz :::: vol M J M C7 U :::: volM . {C C -I } and the Harnack inequalities in the continuous case mln I , 2 U 151 r = vol M ' D(5) denotes the (graph) diameter of 5, K denotes the set of edge generators, and Co is an absolute constant depending only on the simple lattice graph. REMARK 10.9. For a polytope in JRd, we can rescale and choose the lattice points to be dense enough to approximate the volume of the polytope. For example, if we have (10.15) C  S DI(M)/d where C7 S c' are used. We note that the c's (with the exception of C2, which is a sclin factor) denoe some appropriate absolute constants, In the nex.t section, we will give an examp e of computing the c's in the eigenvalue computatIOn of Example 10.7. In order to show that k(t,x,y) is indeed a lower bound for Ht(x: y ).' a proof is nppd('d, TlJ('re are sevel al sets of sufficient conditions for estabhshmg lower where DI denotes the diameter of M measured by the LI norm and C is some absolute constant, then the number of lattice points provides a good approximation for the volume of the polytope. This implies that r :::: c for some constant c. The above inequality (10.15) can be replaced by a slightly simpler inequality: C' d S D(5) for some constant C'. These facts are useful for approximation algorithms for the volume of a convex body, which we discuss in the next section. 
156 10. ImAT KERNELS 10.5. MATRICES WITH GIVEN ROW AND COLUMN SUMS 157 REMARK 10.10. There are many graphs G that can be embedded in a lattice graph in such a way that the diameter of G satisfies D(G)  VJ D(M) . (' For such graphs, Theorem 10.7 implies a somewhat stronger result: cr .x  d2 D(G)2 We first need to place our contingency table problem into the framework of the preceding section. The manifold M wiII consist of all real mn-tuples x = (xu, X12,. . . 'x mn ) satisfying LXij = ri, LXij = Cj j i Since L ri = L Cj then i j 10.5. Matrices with given row and column sums dimM = N:= (m - l)(n - 1) . The graph r has as vertices all the integer points in M, i.e., all x with all Xij E Z. The edge generating set K consists of all the basic moves described above. Hence, IKI = (';') (). The set S wiII just be T = T(f, c), the set of all T E r with all entries nonnegative. Thus, where l' is as defined in Theorem 10,7. One of the classical problems in enumerative combinatorics is to count (or es- t.imate) the number of matrices with nonnegative entries havng iven ro and column sums (as described in Example 10,7), This problem anes II!  vnety of applications, such as graph enumeration, goodness of fit tests m stat.lstlcs: .enu- meration of permutations by descents, describing tensor product decompositIOns, counting double cosets, etc. In particular, in statistics it is often referred t as the "contingency table" problem and has a long history, It seems to be a partlu- larly difficult problem to obtain good estimates for the number of such tables -:V lth given row and column sums. In order to attack his problem, a standar .techlllque depends on rapidly generating random tables with nearly equal probability. In this section we wiII use the theorems in the preceding sections to estimate the eigenvalue .xl for the convex subgraph with vertices correspond.ing to matrices with given row and column sums. By using these bounds we can denve convergence bounds for Neumann random walks on this subgraph [79]. Given integer vectors f = (rl,'" ,r",), C = (CI,'" ,cn) with ri, c .O and L r i = L Cj, we consider the space of all Tn x n arrays T with non-negative mteger i j entries satisfying with the property that S = ni,j{T E r: Xij  a} . Similarly, the manifold M c M is defined by M = ni,j{X EM: Xij > -1/2} . It is clear that M is an N-dimensional convex polytope and S = T is the set of all lattice points in M, and consequently convex in the sense needed for (10.10). It is easy to see that T is connected by the basic moves generated by K, and that each edge of r has length 2. Our next problem is to deal with the term 151 vol U in ( ) . vol M 10.10 . In particular, we would like to show this is close to 1, provided that ri and Cj are not too small. To do this we need the following two results. Claim 1. Suppose L C JRN is a lattice generated by vectors VI, . . . ,V N. Then the covering radius of L is at most R :=  C IIV.1I2) 1/2 LT(i,j) = Cj, l:S;j:S;n. PROOF. The assertion clearly holds for N = 1. Assume it holds for all dimen- sions less than N. It is enough to prove that any point x = (XI,... ,XN) in the fundamental domain generated by the Vi is at most a distance of R from some Vi. Let Xo be the projection of x on either the hyperplane generated by VI,... ,VN-I, or a translate of the hyperplane by VN, whichever is closer (these are two bound- ing hyperplanes of the fundamental domain). Thus, d(x,xo) :S; IIVNII. By the induction hypothesis, LT(i,j) = ri, l:S;i:S;m Let us denote by T = T(f, c) the set of all such arrays. We wiII show that for the Neumann walk on the space of tables T(f, c) where . { . ri . Cj } ( 1) 3/2 ( 1) 3/2 mm mill -, mill - > C m - n - . n J m ( N I ) 1/2 d(xo,Vj):S; 't"VdI2 for some j < N . Hence, we have (10.16) A. > [3200, 'Ic(m - 1)'(,. - 1)' mh. { 2;>f. >j } r ( 1 N-I ) 1/2 d(x,Vj):S; 4"vN12 +  t; IIvdl 2 = R as claimed. o 
158 10. HEAT KERNELS 10.5. MATRICES WITH GIVEN ROW AND COLUMN SUMS 159 Claim 2. If M is convex and contains an open ball B(cRN) of radius cRN, with cN  2, then (10.17) 4-I/c < 151volU < 1 - vol M - ( N ) 1/2 where VI,. ' . VN generate r, and R =  VI IIv,II 2 At the end of this section, we illustrate how a specific value can be derived here for Co (as well as in several other cases of interest, as well). In particular, for contingency tables, we can take Co = 1/800. Since PROOF, Consider a contracted copy (1 - fJ)M of M with the origin centered about the center of the ball B(cRN) C M. Let L be any bounding hyperplane of M, and let (1 - o)L be the corresponding contracted copy of L. Let x E (1 - o)M and suppose there exists a lattice point y E V(r) \ 5 such that x is contained in the Voronoi region for y. Hence, R > d(x, y)  I  coRN. However, this is a contradiction if we take fJ = c ' { 1/2 ( '"' J' CJ 2 .) 1/2 } diam M < 2 min (  r; ) L.. then (10.18) can be written as follows: For the natural Neumann walk P on the space of tables T(f, c) where min { min, min Sf.. } > c(m - 1)3/2(n _ 1)3/2 , n J 11t we have Consequently, for the choice 0 = c we must have x in the closure of the Voronoi region of some lattice point in 5. Therefore, 151 vol U  vol(l - o)M (10.19) A, > [32oo,,'/«m - 1)'(.. - 1)' mh, { >i. >,>' } r' i.e., To convert the estimate in (10.16) to an estimate for the rate of convergence of P to its stationary (uniform) distribution 7r, we consider N 151 vol U > ( 1 _ .2... ) > 4-I/c vol M - cN - Claim 2 is proved. fl(t) < (l-.xd .vol5 mm degr x x if cN  2. o (10.20) . ( . ri . c j ) So = nun nun -, lIun - . , n J 11t We begin constructing an element To E M recursively as follows. loss of generality that , vol 5 :::; e-A,t_ = e->.t151. deg r and .xl is the least nontrivial Neumann eigenvalue of Laplacian of 5. Thus, if In order to apply the result in Claim 2, we must find a large ball in M. Let So denote the smallest line sum average, i.e., Suppose without (10.21) t> 2. In ITI .xl E rl So = -. m Then, in To, set all elements of the first row equal to So, and subtract So from each value Cj to form cj = Cj - So, 1 :::; j :::; n. Now, to complete To, we are reduced to forming an (m - 1) by n table 1'6 with row sums r2,. .. r m and column sums c , . .. ,c. The key point here is that all the line sum averages for 1'6 are still at least as large as So. Hence, continuing this process we can eventually construct a table To (with rational entries) having least entry equal to so. Consequently there is a ball B(so) of radius So centered at To E M which is contained in M (since to leave M, some entry must become negative). Therefore, if we assume So > cN 3 / 2 then by Theorem 10,7 and (10.17), then fl(t) < E. Note that 4c 0 4- I / C (10.18) .xl  N2(diamM)2 for some absolute constant Co > 0 where cN  2 (since for tables, all the generators have Ipngt.h 2, so that R:::; N I / 2 ). ITI  min { I.I ':. I.I '! } Thus, by (10.16) and (10.21), if (10.22) t > 6400,'/<m'..' min { >i. >,>' } H + m+ ;;: ">c,. m 2,= ", '; } ) then fl(t) < E, provided min { min ,min Sf.. } > c(m - 1)3/2(n _ 1)3/2 , n J n 
160 10. HEAT KERNELS 10.6. RANDOM WALKS AND THE HEAT KERNEL 161 It remains to bound the constant Co occurring in (10.10). Briefly, as in Theorem 10.7, we have The corresponding matrix Q has the following coefficient values for its various entries: 2d -fiLs   ( l-I(x,gX) ) 2  I K I  I 8g 2 gEK.* 8 2 L aij 8x ,8x . . . t J ',) Entry (Xij, Xij) (Xij,Xi'j) (Xij,Xij' ) Coefficient where d:= dimM, e:= minl-l(x,gx), 1-1 denotes (Euclidean) length, and K* C K gEK. consists of exactly one element from each pair {g, g-I }, 9 E K. (Xij, Xi' j') (m - l)(n - 1) -(m - 1) -(m - 1) 1 C 1 1:S (aij) :::; C 2 1 Thus, Q has two distinct eigenvalues: one is mn with multiplicity (m - l)(n - 1), and the other is 0 with multiplicity m + n - 1. Now, dim M = (m - l)(n - 1) and the operator corresponding to Q when restricted to M has all eigenvalues equal to mn. So the matrix (aij) has all eigenvalues equal to 2mn\;)()n-1) = 8, and consequently we can take C 1 = C 2 = 8, and Co = 1/800. This completes the computation of Co in the lower bound of .xl for thc contingency table problem. In [79], using similar methods, eigenvalue lower bounds are derived for a num- ber of problems including restricted contingency tables, symmetric tables, compo- sitions of an integers, and so-called knapsack solutions. Suppose C 1 and C 2 are constants so that whcre I is thc identity opcrat.or on 11'[, and X :S Y means t.hat thc operator Y  X is non-negative definite, In particular, we can take for C 1 and C 2 the least and great cst eigenvalues, respectively, of (aij) restricted to M. Now, from the arguments in [60], it follows that when M is Euclidean then the constant Co in (10.10) can be taken to be Co = min(C1,C21) . 100 Thus, to determine Co in various applications, our job becomes that of bounding the eigenvalues of the corresponding matrix (aij). First we consider m x n contingency tables. With each edge generator 9 = , 2 Xij - Xi'j - Xij' + Xi'j' we consider /gz in terms of the x's. 10.6. Random walks and the heat kernel 8 2 8g 2 8 2 8 2 8 2 8 2 -+-+-+--2 8Xij2 8xL 8xj' 8xh 8Xij8xi' j 8 2 8 2 8 2 -2 -2 -2 8x ij dxij' 8Xi'j'dxi'j 8 X i'j' dx ij' 8 2 8 2 + 2 + 2 8Xij8xi' j' 8Xi' jdXij' 8 2 In the previous sections, we discussed methods for bounding eigenvalues using the heat kernel. As we will see here, heat kernels also playa crucial role in bounding the rate of convergence for random walks in a direct way. We will consider the relative pointwise distance (as defined in Section 1.5) to the stationary distribution for a random walk with an associated weightcd graph G. THEOREM 10.11. Suppose a random walk is associated with a weighted graph G with heat kernel Ht. The relative pointwise distance of the random walk of t steps to the stationary distribution is bounded above by Expanding, we have vol G Ll(t) :::; maxHt(x,y) fTT x,y V dxd y We can abbreviate this in matrix form as Xij Xi' j Xij' Xij 1 -1 -1 Xi' j -1 1 1 Xij' -1 1 1 Xi'j' 1 -1 -1 Xi'j' 1 -1 -1 1 PROOF. Let P denote the transition probability matrix of the random walk. We note that the convergence of the random walk p. after s steps is related to the heat kerncl H. as follows: We need to consider the operator (10.23) liP' - r- 1 / 2 poT1/211 II LI:T 1 / 2 11 i#O :::; IIH. - Poll :S e-'>' 8 2 L 8g2 gEK.. where we recall that Ii is the projection onto the eigenspace generated by the i-th eigenfunction. 
162 10. HEAT KERNELS Aftpr s stcps, t.he relative point.wise dist.ance of p.' to the stationary distribution n(x) is given by IPS(y, x) - n(x)1 (s) = max ( ) . x,y 1f X CHAPTER 11 Let 1/Jx be defined by 1/Jx(Y) = {  if y = x, otherwise. Sobolev inequalities We have (t) l1/Jy (pt) 1/Jx - n(x)1 :tx n(x) l1/Jy T- I / 2 (I - £)t T1/21/Jx - n(x)J n:tx n(x) rnax It/J y T- 1 / 2 (2::: It)T- 1 / 2 t/J x lvoIG x,y i#O  rnaxlt/JyT-l/2(Ht - PO)T-i/21/JxlvoIG x,y vol G  max Ht(x, y) J d d x,y x y 11.1. The isoperimetric dimension of a graph Th em 10.12 im p lies that an upper bound for the heat kernel can be used eor Th ' d th powerful to bound the convergence rate for random walks. IS an many 0 er consequences of the heat kernel will be discussed further in the next two chapters. In spectral geometry, Sobolev inequalities are among the main tools for control- ling eigenfunctions. In this chapter, we will derive the discrete versions of Sobolev inequalities. The proofs are self-contained and entirely graph-theoretic although many of the concepts and ideas can be traced back to the early work of Nash [251] on Riemannian manifolds. On one hand, graphs and Riemannian manifolds are quite different objects. Indeed, many of the theorems and proofs in differcntial geometry are very difficult to translate into similar ones for graphs (since there are no high-order derivatives on a graph). In fact, some of the statements of the theorems in the continuous cases are obviously not true in the discrete setting. On the other hand, there is a great deal of overlap between these two disparate arcas both in concepts and methods. Some selected techniques in the continuous casc can often be successfully carried out in the discrete domain. In particular, we will sec that the methods of Sobolev inequalities for differcntialmanifolds can be effectively utilized in dealing with general graphs. In Chapter 9, Harnack inequalities havc been derived only for very special graphs (homogcneous graphs and thcir convex subgraphs). Here we will establish Sobolev inequalities for all graphs by using a key invariant, the isoperimetric dimension of a graph (also see [59]). The proof techniques in this chapter are quite similar to their parallels for the continuous case [49], [251]. (10.24) Hence, if we choose t such that 1 vol G t = - log . , >.. (' mlll x d x I  ( t ) < (' 1n thc next section wc will use Theorem thcn aftcr t stcps, we lave '-' 'f vol G . 10,11 and the logarithmic Sobolev tcchniques to reduce the factor 0 min, d,  (10.24). We say that a graph G has isoperimetric dimension <5 with i.soperimetT'ic con- stant C6 if for every subset X of V(G), the number of edges betwccn X and the complement X of X, denoted by IE(X,X)I , satisfies (11.1) - 0-1 IE(X,X)I  c6(vol X)T where vol X  vol X and C6 is a constant depending only on J. In othcr words, wc can define the so-ealled Sobolev con.stant C6 by C6 = inf IE(X, ':l x (volX)--' where vol X  vol X. We will prove two discrete versions of the Sobolev inequalitics in Scctions 11.2 and 11.3. We will show that for <5  1 and for any function f: V(G) --+ IR, 
164 II. SOBOLEV INEQUALITIES 11.2, AN ISOPERIMETRIC INEQUALITY 165 UV 6 5-1 L If(u) - f(v)l 2: CI mn(L If(v) - ml T=T d v ) --.. V There is another concept related to isoperimetric invariants, the so-called "mod- erate growth rate" or "polynomial growth rate" condition [15] ( also see [98]). For a vertex v in a graph G and an intcger r, we define (11.2) (11.3) and for 0 > 2, 1 (L If(u) - f(VW)I/2 2: C2 mn(L If(v) - mjl'd v )" V Nr(v) = {u E V(G) : d(u,v):::; r} uv where d(u, v) denotes the distance between u and v. We say a graph G has poly- nomial growth rate of type (c,o) if vol Nr(v) 2: C r O for all vcrtices v and vol N r :::; vol G /2. h -..M... IIer e the constants CI and C2 depend only on O. In fact we will were"( - 0-2' 0-1 d > r,;-;-o-I show CI 2: Co (! an C2 _ v Co "'2,\' The Sobolev inequalities can be used to derive the following eigenvaluc inequal- ities (see Section 11.4): (11.4 )  ->.;t vol G e :::; C3f}72 ifD It can be shown that a graph with isoperimetric dimension 0 and isoperimetric constant Co has polynomial growth rate of type (c', 0) for some c'. However, there are graphs which have polynomial growth rate of type (c,o) but which do not have isoperimetric dimension O. For example, consider the graph H which is formed by taking two copies of a graph having polynomial growth rate of type (c,o) and joining them by an edge. It is easy to see that H has polynomial growth rate, but H cannot have isoperimetric dimension O. In fact, this is an example which has polynomial growth rate, but its associated random walk is not rapidly mixing. On the other hand, graphs with bounded isoperimetric dimension have good eigenvalue bounds and are therefore rapidly mixing. and 2 (11.5) Ak 2: C4 ( vo G ) 1 for suitable constants C3 and C4 which depend only on O. In a sense, a graph can be viewed as a discretization of  Rieman.nian manifold in IR n where n is roughly equal to J. The eigenvalue bound III (11.5) .IS an aaloe of Polya's conjecture [211] for Dirichlet eigenvalues of regular domallls M III IR . 2n ( k ) 2/n Ak>- - - W n vol M h . s the vo lume of the unit disc in IR n . Here, we consider Laplacians of were W n I . . t' d' general graphs and obtain eigenvalue estimates in terms of the Isopenme nc 1- mension. We remark that a closely related isoperimetric invariant [48] is the Cheeger constant ha of a graph G (discussed in Chapter 2), In fact, the ?heeger constant can be viewed as a special case of the isoperimetric constant Co wlt.h J = 00. We note that the first Sobolev inequality (11.2) can be expressed as IIV' fill 2: cdlfll6 We remark that for symmetrical graphs, these two notions -polynomial growth rate and isoperimetric dimension- are basically the same. Using a result of Gromov [148] on the growth rate of a finitely generated group, Varopoulos [244] showed that a locally finite Cayley graph of an infinite group with a nilpotent subgroup of finite index has polynomial growth rate of type (c,o) depending only on the structure of the group. An excellent survey on this topic can be found in [15]. 11.2. An isoperimetric inequality We will first prove the following. THEOREM 11.1. In a connected graph G with isoperimetric dimension 0 > 1 and isoperimetric constant co, for an arbitrary function f : V (G) --+ IR, let m denote the largest value such that IIV' fib 2: c211fll1' for "( = 20/(0 - 2), In general we can define the Sobolev constants Sp,q of a graph, for p, q > 0, as follows: L d v :::; L duo V u f(v)<m f(u)?:m and the second one (11.3) as Then L If(u) - f(v)1 2: CI (L If(v) - ml 6 d v )¥ . lIV'fll p Sp,q = mf sup IIf _ II . ffD cEIR C q For example, the Cheeger constant ha of a graph G is just SI,I'. The two S?bole inequalities in (11.2) and (11.3) concern Sl,q and S2,q for ccrtam q dependlllg 0 the isoperimetric dimension J. uv V where CI = Co 0;1 . Here we state two useful corollaries, The first one is an immediate consequence of Theorem 11.1 and the second one follows from the proof of Theorem 11.1. 
166 II. SOBOLEV INEQUALITIES 11.2. AN ISOPERIMETRIC INEQUALITY 167 COROLLARY 11.2. In a connected graph G with isoperimetric dimension J and isoperimdric constant c, for an arbitrary function f : V( G) -+ IR we have L If(u) - f(v)1  CI min(L If(v) - mI6dv) m Then L Ih(u) - h(v)1 L ailh(i - 1) - h(i)1 uv uv v J-1 2: c LS;-'-(h(i - 1) - h(i)) where CI = C I . COROLLARY 11.3. In a connected graph G with isoperimetric dimension 0 and isoperimet7'ic constant C, fOl' a function f : V(G) -+ IR and a vertex 1/J, define -I -l > cLlh(i)l(S i+"1 -S;--;S) i<io f (v) = { max{f(v), f(w)} w min{f(v),f(w)} where m is as defined in Theorem 11.1. Then L Ifw(u) - fw(v)1 + awlf(w) - ml2: CI(L fw(v)6) if f(w) 2: m if f(w) < m uv v -I -I +C L Ih(i)I(S;--;S - S ;)I ) i>io WI + W 2 We consider WI first; W 2 can be dealt with in a similar way. 0-1 CI = co, WI  _I -I C  h(i)((S; + d;)--;S - S;--;S) iio where a w = { I{{u,v} E E(G): f(u) > f(w) 2: f(v)}1 I{{u,v} E E(G): f(u) 2: f(w) > f(v)}1 if f(w) 2: m if f(w) < m.  0 - 1 d. > C h(i)-'-T ;<;0 0 SI - 1  2: C 0 - 1  h(i) 6=1 d; o -L ;=0;;0 (h(i)-I Si)l/  L Ih(i)1 -I d; S - { {v: f(v) 2: f(w)} w - {u: f(u) :'S f(w)} if f(w) 2: m if f(w) < m. Roughly speaking, the proof of Theorem 11.1, although a bit lengthy, is just repeated applications of summation by parts (which, of course, is just the discrete version of integration by parts). Namely, for any Xi and Yi, for i = 0,'" ,n + 1, the following simple equality holds: (11,6) n n L(Xi+1 - Xi)Y; = L Xi(Yi-1 - Yi) + Xn+IYn - XoYo i=O I 0-1 2: C 0 ( 2: Ih(i)1 I d i ) I/ l$to 0-1 -L -I 2: c L Ih(i)l-ld;)--;S. i$io i:Sio and the last two terms vanish if Xo = Yn = 0 or Yo = X n +1 = O. We will use (11,6) repeatedly in the following proof of Theorem 11.1: Combining this with the corresponding bound for W 2 , we have We define Ai notation f(i) f(vJ) 2: f(V2) 2: '" 2: f(v n ). {{vj,vd E E(G) : j :'S i < k} and ai = IA;\. We use the f(v;) and d i = d v ,. Define Sj = L d j , st = L d j and j<i j?i Si = min{Sj, St}. Clearly, Si = st for f(i)  m and Si = Sj for f(i) < m. From the definition in (11.1), we have J-l ai  c(vol Si)-'-. 0-1 (  . -L -I  _I ) c \lh(z)I-ld;)  +(Ih(i)l -I d;)--;S 0- 1 (  ) I 2: c lh(i)I -l di and Theorem 11.1 is proved. o PROOF. For a given function f : V(G) -+ IR, we label the vertices so as to satisfy WI + W 2 We remark that Corollary 11.3 follows from the above proof and the fact that for f(w) 2: m, We use the convention that So = Sn+1 = O. Let h(i) = h(v;) = f(Vi) - m, and suppose f(i o ) = m, L Ifw(u) - fw(v)1 = L a;(h(i - 1) - h(i)) uv i f(i)?'f(w) 
168 11. SOBOLEV INEQUALITIES 11.3. SOBOLEV INEQUALITIES 169 Now we use summation by parts again and we obtain  L Ih(i)l(ai - ai-d - awlh(w)l. i h(i)h(w) 11.3. Sobolev inequalities 2P I      The second Sobolev inequality (11.3) is more powerful than the first one (11.2). However, its proof in Theorem 11.4 is also more complicated than that of Theorem 11.1. Basically, the proof consists primarily of iterations of "summation by parts" using Theorem 11.1. THEOREM 11.4. For a graph G with isoperimdric dimension 0 > 2 and isoperi- mct7'ic constant CJ, any function f : V (G) -+ IR satisfies (L If(u) - f(v)12)I/2  C2 n(L If(v) - ml"dtl)lj-y uv v where I = /!.2 and C2 = ..jCi J:;i . We define PROOF. We follow the notation in Theorem 11.1 where h(i) = h(Vi) = f(vi)-m and f(i o ) = m. Also, we denote hi (x) = htl,(x). L Ih(u) - h(v)12 UtI L(h(i - 1) - h(i)) L Ih(j) - h(k)1 {j,k }EA,  L(h(i - 1) - h(i)) L Ihi(j) - hi(k)l iio {j.k}EA i L h(i)Ui+I (h(i) - h(i + 1)) iio L h(i)(UHIh(i) - Uih(i - 1)) iio L h(i)((UHI - a;)h(i) - ai(h(i - 1) - h(i)) i::;io L h(i)(UHI - ui)h(i) - L h(i)(UHI (h(i) - h(i - 1)) iio (io L h(i)(Ui+I - ai)h(i) - 2P I i$io T i = Laj(h(j - 1) - h(j)) + ailh(i)l. j9 From Cor. 11.3, we have + L(h(i - 1) - h(i)) L Ihi(j) - hi(k)1 iio {j,k}EA, PI +P 2 . We will give a lower bound for the second part PI where without loss of generality we may assume that all h(i)'s are positive. The second part can be proved similarly. PI    L h(i) ( L Ihi+I(j) - hi+I(k)l- L Ihi(j) - hi(k)l ) iio {j.k}EA,+\ {j,k}EA,  h(;j (.'" (h(i) - h(i + 1)) - (m'-A'" Ih,(j) - h'(k)l) L h(i) aHI(h(i) - h(i + 1)) - PI. i$io T. . L Ifv, (11) - fv,(v)1 + ai(J(i) - m) Uv 0- 1  ....L J-I  CJ-;s(h(j)J-Idj)-;r j<i 0- 1 I J-I .- cJ-T J o · It follows from the definition of T i that T i - Ti-I = (Ui - ui-dh(i - 1). 
170 Hence, PI    2:  > II. SOBOLEV INEQUALITIES 11.4. EIGENVALUE BOUNDS 171 In particular, we have  L h(i)(ai+1 - ai)h(i) iio Ht(x,x) = L(H(x,y))2. V We consider, for a fixed x, a at Ht(x, x) L h(i)(Ti+l - T i ) a 2 LH (x,y) at H  (x, y) v i$io 6 0-1 "\;" h ( i ) T, 6-i' (( 1 + h(i) 6=l d i ) 6;;1 _ 1) C6 40 . T! i::;i o t 6 (0 - 1)2 ., 6;;1 h(i) 6-1 d i C6---;W- L h(l)T i T' i'Sio t 6 (0 - 1)2 . h(i) 6-1 d i C6- "\;" h(l) 1 4J2  T" is:io 1 25 (J - 1)2 h(i) 1=1 d i c6- L L 25 · 40 2 .. ( h ( i ) 1=1di)l 1:S;;tO L H (x, y)( -£H(y, x)) v since the function H  (x, y), with y as the variable and x fixed, satisfies the heat equation in Lemma 10.3 (iii). Now we use Lemma 10.3 (iv) and get .!!...H x x = _ "\;" ( H(Y,x) _ H(Z'X) ) 2 at t ( ,) f:::z .jd; Vd; We apply TheoreIU 11.4 by again considering H(y,x) as a function ofy with fixed x. For I = l!.2 ' we have i<io a (0-1)2 ( ( Ht(Y,X) ) 1' ) 211' at Ht(x,x)::::; - C6 4r  /;t; - m d v To proceed, we need an additional fact. 6-1  C6 (0-;)2 ( Lh(i)&d i ) --' 40 . < . 1_ t O  C6 (0 -0;)2 (L h(i)1'di)' 4 . < . t_ 1 o (11. 7) LEMMA 11.5. ( "\;" ( Hf(X'Y) ) 1' )  /J :sf  VJ;; - m d v (3V d,,) ,- v d v In a similar way we have In this section, we assume 0 > 2 since we will use the second Sobolev inequality to establish eigenvalue bounds. Let Ht denote the heat kernel of G. FrOIU Section 10.2, the heat kernel satisfies Ht(x,y) = LHs(x,z)Ht-s(z,y), Therefore, since I 2: 2. (0 - 1)2 2 P2 2: C6(L Ih(iWd i );-. 40 . > . t_ 1 0 "\;" ( H  (x, y) ) 2 2:  VJ;; - m d v . v v ( ) ! 0-1 1 (h(i) - h(j))2 2: 2b( Ih(iWd i );- 'J PROOF. We apply Holder's inequality for 1 = 1 + 1, P q L /;gi ::::; (L 1f)I/p(L gj)l/q i o where we take p = I - 1, q =  and Hdx,y) ...l I  -ml,-T, H.!.(x,y)  I 2 - ml ,-1. VJ;; 11.4. Eigenvalue bounds Iv gv We then have 1  (I HY) _mll'd v );-=T (I HY) -m,dvr-' 
172 II. SOBOLEV INEQUALITIES 11.4. EIGENVALUE BOUNDS 173 L ( H(X'Y) ) 2 d > -m y' - Id y V"'y provided that m'  m/2 > O. This, however, follows from the definition of m as in Theorem 11.1 and the fact that H  0 and can be deduced as follows: m' Vd; vol G 1 vol G L If! (x, y)Jd; y vo G ( L H(x,y)Jd; + L H(X,Y)Jd; ) yEM;t yEM;; 1  vol G L H(x,y)Jd; yEM;t m vol M:  vol G m Ht(x,y) It remains to bound L I  - mld y from above. y y By using Lemma 10.3 (ii), we have ( 11.8) L ( H(X'Y) _ m' ) dy ,jd; y LH(x,y)Jd; - m'vol G y ..;;i: - m'vol G o  2 , Vd; m-- - vol G' If X) If! (y,x) where M: = {y :  m} and M; = {y : r.I < m}. Recall from the d. v d. definition of m, we have vol M:  vol G /2. This completes the proof of Lemma 11.5. 0 by choosing m' to be /1 (y,x) , _ . /1  (y.x) m' } Now Define N: = {y :  2 m } and N x = {y. ,jd; < . We note that  I Il(x,y) ' Id  -m y ..(d; y L ( II(:,Y) _ m' ) dy + L_ (m' _ HY» ) d y YEN;t..(d; yEN. ( Hl{X,y» ) 2 L m' -  d y yEN;; :::; 2 L m'd y yEN;; 2 ,;a:; .  d y volG  yEN;;  ( H(X,y) ) 2  ( If(X,y) , ) 2  IT - m d y   IT - m d y y V d y y V d y because of (11.8). We now return to inequality (11.7). Using Lemma 11.5, we obtain :::; 3 ..;;i: 8 8t Ht (x,x) (  ( H(X,y) ) 1' ) 211' :::; -cs  Id - m d y y V"'y lli.::..U (  ( H(X,y) ) 2 ) 0 rJ  :::; -cs  IT -m d y (3V d x) 0 y Vdy 2(0-1) (  ( H(X,y) , ) 2 ) 0 rJ  :::; -cs  IT -m d y (3V d x) 0 y Vdy  2 IT 2 lli.::..U rJ  :::; -cs((H(x,y) - 2m'H(x,Y)vdy + m' d y » , (3Vd x )- , y 'rJ '2 2(=1) rJ  :::; -cs(Ht(x,x)-2mvd x +m vol G) , (3Vd x )- 0 d x 2!.L::..!l rJ 2(0-2) :::; -cs(Ht(x,x) - vol G ) , (3Vd x )- 0 :::; 2..[d;. Therefore,  Hl{x,y) I d I 2 -m y ,jd; y :::; L I H(x,y) - m'ld y + L 1m' - mld y ,jd; y y :::; 2..;;i: + L m'd y y 
174 11. SOBOLEV INEQUALITIES 11.5. GENERALIZATIONS TO WEIGHTED GRAPHS AND SUBGRAPHS 175 h - ( (6_;)2 ) 2(-y-I)h We note that 1 - 2(:c.!) = -. We consider were C5 - C6 U' l' a d x ) - f -(Ht(x,x) - _ I G at vo a d x 1-2i=.!.1. at (Ht(x,x)- voIG ) 7 - ( H ( X X) - )-2().!!..Ht(x,x) ° t, vol G at 2c 5 ( H ( ) _ )-2()+2()(3"jd;,)-2() 2 T t x, x vol G 2 25 (30t:)-2() using the preceding inequality for -ftHt(x,x). Therefore, we obtain d 2 IJ 2() ( ) dx ) -f ( Ht ( xx)---=-)-' 2 c6(3yd x )- 7 t+(Hox,x - volG ' vol G IJ 2( ) d x ) 2 2 c6(3yd x )- 7 t + (1 - vol G -. 2 c6(3"jd;,)-2()t where C6 = 2C5/0. This is equivalent to d x C3 d x Ht(x,x) - vol G :::; d for all t > O. Therefore e A . t k ::::; c3vol G. inf --y- t t'i 2Ake 6 c3vol G. (8)'1 since the function  is minimized when t = 2t . This implies Ak  !...()f 2e c3vol G C4()f vol G h - 6 2/6 were C4 - 2e c 3 . o We remark that the constants C3 and C4 can be explicitly computed from the proofs but are somewhat messy expressions. Here we derive these inequalities with no intention of carefully optimizing the constants. 11.5. Generalizations to weighted graphs and subgraphs C3 vol G LHt(x,x) -1:::; ----;r-' x In this section, we consider weighted undirected graphs G with edge weights wu,v = wV,u for vertices u, v of G. We can define the isoperimetric dimension of G in a similar way: We say that G has isoperimetric dimension ° and isoperimetric constant C6 if 6/2 I where C3 = 9c 6 . I ence, Since L L wu,v 2 c6(vol X)I-l uEX VEX LHt(X,X) = L(Le-)"t<p(x)) = Le-)"t, x i  x for all X  V(G) with vol X :::; vol X where d v = L wu,v, and vol X = L d v . u VEX we have proved the following: THEORBM 11.6. )" (;3vol G ke- · :::;  t'i The results in previous sections can be generalized for the Laplacians of weighted undirected graphs with boundary conditions. We will state these facts but omit the proofs which follow along the lines in the previous sections. THEOREM 11.8. Let G be a weighted undirected graph with edge weights Wu,v for vertices 11, v of G, and suppose G has isoperimetric dimension ° and isoperi- metric constant C6. Let S denote a subset of vertices of G. Then, any function f : S U oS -+ IR with either Dirichlet or Neumann boundary conditions satisfies 6 6-1 L !feu) - f(v)lwu,v  clmin(L If(v) - mI 6 - ' dv)-r m {u,v}ES' vES where S' consists of all edges with at least one endpoint in S, and CI = c6 6:;/ . THEOREM 11.9. Let G be a weighted undirected graph with edge weights W"'V for vertices u, v of G, and suppose G has isoperimetric dimension ° > 2 and isoperi- metric constant C6. Then any function f : V(G) -+ IR with either Di1'ichlet or Neumann boundary conditions satisfies L If(u) - f(vWw u ,v)'/2  C2 n(L If(v) - mll'd,,)l h {u,V}ES. VES (11,9) L -),t c3 vol G e'::::; t'i i#O is a constant depending on 0. where C3 From Theorem 11.6, we derive bounds for eigenvalues. THEOREM 11.7. The k-th eigenvalue Ak of L satisfies k 2/6 Ak 2 C4 ( vol G ) where C4 is a constant depending on 0. PROOF. From (11.6) we have 
176 I\. SOBOLEV INEQUALITIES where I = l!.2 and C2 = ..jCi 5:;/ . THEOREM 11.10. For a weighted undirected graph G and an induced subgraph S, the Dirichlet or Neumann eigenvalues of S satisfy  ->.,t c3 vol S e S t 5 / 2 i#O wher'e C3 is a constant depending only on J, THEOREM 11.11. Suppose a weighted undirected graph G has isoperimetric di- mension 0 and isoperimetric constant C5. Let S denote an induced subgraph. The k-th Dirichlet or Neumann eigenvalue of S satisfies Ak 2': C4()2/5 vol G where C4 is a constant depending only on O. CHAPTER 12 Advanced techniques for random walks on graphs 12.1. Several approaches for bounding convergence Suppose in a graph G with edge weights Wx,y, a random walk (xo, XI,' .. ,x.) has transition probability P(u,v) = Prob(xi+1 = v I Xi = u) = wu,v d u where d u = L wu,v. The number of steps required for a random walk to converge v to the stationary distribution 71', where d x  7r(x) = vol G ' vol G = dx, x is closely related to the eigenvalues of the Laplacian (see Sections 1.5, 10.5). In particular, suppose we define (12.1) A= { AI 2 - An-I if 1 - Al 2': An-I - 1 otherwise. Then the relative pointwise distance of P to 71' after 5 steps satisfies .6.(5) max IP'(y,x) - 7r(x)1 S e-c x,y 7r(x) if (12.2) c vol G 5>-log-. - A minx d x We remark that this can be slightly improved by using the lazy walk as described in Theorem 1.16. Therefore, the A in (12,2) can be taken to be A = { 2A;1 An-I + Al Here Ai'S are eigenvalues of the Laplacian of the graph G (see definitions in Chapter 1). (12.3) if 1 - Al 2': An-I - 1 otherwise In this chapter, we will describe several methods for reducin g the factor lo g ':01 G mln d z in (12.2) by using the log-Sobolev constant. Suppose G = (V, E) is a graph with edge weights Wx,y for x, y E V. The log- Sobolev constant a of G is the least constant satisfying the following log-Sobolev '-7 
178 12. ADVANCED TECHNIQUES FOR RANDOM WALKS ON GRAPHS 12.1. SEVERAL APPROACHES FOR BOUNDING CONVERGENCE 179 inequality for any nontrivial function f : V -+ JR: '" '" f2(x)vol G  (I(x) - f(y))2W X ,y  0:  f2(x)d x log L 2 {x,Y}EE xEV f (z)d z zEV Aother a?proach for bounding the convergence rate for random walks in a graph IS .by uSIg Sobolev in:qulities nd the isoperimetric dimension of a graph (defined In SectIOn 11.1). This will be discussed in Section 12,5. As a consequence for grap.hs with bounded isoperimetric dimension, their random walks have partic ularly Ulce bounds for convergence, In other words, 0: can be expressed as follows: L (I(x) - f(y))2w x ,y . {x,y}EE O:c = 0: = } L f2(x)d x log j2(x)vol G xEV L f2(z)d z zEV (12.4) . The efinition for the log-obolev constant for a graph G can be easily gener- ahzd t mduced subgraphs with boundary conditions. Let 5 denote a subset of ertlces m a graph G and let 5' denote the set of edges with at least one endpoint m 5. et 85 denote the vertex boundary of 5. The log-Sobolev constant a(D) for the mduced subgraph 5 with Dirichlet boundary condition can be defined S as follows: where f ranges over all nontrivial functions f : V -+ JR. Logarithmic Sobolev inequalities first arose in the analysis of infinite dimen- sional plliptic differential operators. Many developments and applications can be found in the survey papers [16, 149, 150, 231], Recently, Diaconis and Saloff-Costc [101] used a discrete version of the logarithmic Sobolev inequality for improving convergence bounds for Markov chains. In Section 12,2, we will improve (12.2) to: (t)  e 2 - c (12.7) L (I(x) - f(y))2w x ,y (D) . f {x,Y}ES. ' O:s =m f '" f 2 ( ) t . I j2(x)vol S  x (x og xEV L f2(Z)d z zES ;e: ranges over all nontrivhll functions f : 5 U 85 -+ JR satisfying f (y) = 0 for if (12.5) 1 volG c t  -log log --;-- +-. 20: mm x d x A Also, the l-Sobolev constant O:s for the induced subgraph 5 with Neumann boundary condition can be defined as follows: Also we will show 1'V(t)  I-c e (12.8) L (f(x) - f(y))2W X ,y . f {x,y}ES. O:s = In J#.c L f2(x)d x log f2(x)vol 5 XEV L f2(Z)d z zES if 1 volG c (12.6) t> - log log --;-- + -. - 40: mm x d x A This is a slight improvement of [101] in which Diaconis and Saloff-Coste proved that TV(t)  e l - c where f ranges over all non-constant functions f : 5 U 85 -+ III Many methods for bounding log-Sobolev constants for graphs can be extended to the log-Sobolev constant for certain subgraphs as well. if 1 c t  20: loglogn + :\ for regular graphs, So, lower bounds for log-Sobolev constants can be used to improve convergence bounds for random walks on graphs and certain induced sub- graphs. However, the problem of lower bounding log-Sobolev constants seems to be harder than finding eigenvalue bounds (even for special graphs). One relatively easy method is to use comparison theorems that will be discussed in Section 12.2. . A relatively easy upper bound for the log-Sobolev constant is half of the first eigenvalue Al of the Laplacian L of G. LEMMA 12.1. For a graph G (with no boundary or with Dirichlet or Neumann boundary conditions), we have (12.9) Al 0:<-. - 2 A direct and powerful approach for estimating the log-Sobolev constant is by using the logarithmic Harnack inequalities. In Section 12.4, we will establish a logarithmic Harnack inequality which has a similar flavor to the Harnack inequality (discussed in Chapter 9). This provides an effective method for controlling the behavior of the function achieving the log-Sobolev constant. However, the proofs here hold only for homogen(;ous graphs and their special subgraphs. PRO.OF. et f denote a harmonic eigenfunction associated with eigenvalue AI. We consider f = 1 + f for some small  > O. Since Lx f(x)d x = 0, we have '" f'2 ( x ) d x = vol G + 2'" f 2 ( )d    x x. x x 
180 12. ADVANCED TECHNIQUES FOR RANDOM WALKS ON GRAPHS 12.2. LOGARITHMIC SOBOLEV INEQUALITIES 181 From the definition of Q (see (12.4», we have a :0::; L (f'(x) - f'(y»2W X ,y {x,y}EE "'" '2 ( ) I f'2(x)vol G  f x d x og xEV L f'2(x)d x xEV For a funct.ion f : V(G)  IR, we define the (7r;p)-norm of f, denot.ed by "IIfll p , to be I II "lIfll p = ( L JP(X)7r(X» ) I/p XEV(G) We consider In particular, Al a <-. - 2 "IIfll2 = (f2(X)7r(X») 1/2 = 117Tl/2 fll2. The ain proof for .(12.5) onsists of two parts. In the first part (Theorem 12.2), we wIll see that the mequahty (12.10) relating the ]rnorrn to the 2-norm for certain p, implies the improved convergence bound for random walks. The second part (Theorem 12.4) states that the inequality (12,10) can be derived from the log- Sobolev inequality. THEOREM 12.2. Suppose that in a weighted graph G, its heat kernel H. satis- fies 1= L (f'(x) - f'(y»2W X ,y = 1'2 L (f(x) - f(y»2W X ,y, {x,Y}EE {x,Y}EE Also, by repeatedly using L f(x)d x = 0 and 10g(1 + x) = x - x 2 /2 + 0(x 3 ), we x have II = 21'2 L f2(x)d x + 0(1'3). x By taking I' close to 0, we obtain o (12.10) "lIf 7T I / 2 H. 7T- 1 / 2 11p :0::; "lIfll2 There are many examples which show that equality in (12.9) does not hold [98]. Suppose (12.9) holds or even that the log-Sobolev constant is within a constant factor of .xl. Then the random walk on G converges to its stationary distribution in order 0(Ai 1 log log (vol G/max degree». For a regular graph on n vertices, the number of steps required is of order Ail log log n. For example, for the n-cube Q", it can be shown that its log-Sobolev constant is equal to AI/2 = l/n. Therefore the lazy random walk on the cube Q" ( with 2" vertices) converges in time order n log n. We remark that just as the eigenvalues of a weighted cartesian product of graphs can be determined (see Section 2.6), i.e., 1 .xG0Il = 2'(AG + .xII), the log-Sobolev constants also also have the same property: 1 aG0Il = -(aG + all). 2 This can be used to determine the log-Sobolev constant for Q" and will be left as an exercise. for all f : V(G)  IR, and p = el3. for some positive value (3. Then the random walk on G satisfies .6.(t) s: e 2 - c if 2 volG c t 2': - log log --:-- +_ /3 mlll x d x A where A is as defined in (12.1) (or (12.3) for the modified walk defined in (1.16}). PROOF. We define q by 1 1 -+-=1. p q or a vertex x of G, let Vlx denote the characteristic function satisfying Vlx(Y) = 1 If x = y, and 0 otherwise. For a function f : V  IR, we consider 12.2. Logarithmic Sobolev inequalities l1/1x 7T- 1 / 2 H. 7T 1 / 2 fl I (1/1x 7T- 1 +1/q) (7T 1 / p - I / 2 H. 7T 1 / 2 1)1 (  (. 1f-' (y))'.(y)) ./. ((f1f'/' H. 1f-'/'(Y»"(Y») '/' "II1/1x7T-lllq "lIf7T 1 / 2 H.7T- 1 / 2 I1p by using Holder's inequality. s: (12.11) Let G denote a weighted graph on n vertices. For a function f : V(G) -+ IR, we may view f as a column vector, or a 1 x n matrix as a row vector. The stationary distribution 7r(x) = dx/vol G will be regarded as a column or row vector. Let 7T denote the diagonal matrix with value 7r(x) = d x /vol G as its (x, x)-entry. 
182 12. ADVANCED TECHNIQUES FOR R.ANDOM WALKS ON GRAPHS 12.2. LOGAR.ITHMIC SOBOLEV INEQUALITIES 183 We consider THEOREM 12.3. Suppose that in a weighted graph G, its heat kernel H. satis- fies ,,1I1/Jx 7r- 1 1lq ( )1/Jx 71'-1 (y))q7r(Y)) l/q (7r(x)I-Q)I/q 7r(x)-I/ p S ( olG )1/1'. mlll x d x Using the hypothesis that p = e{3. and choosing 8 as 1 volG s = - log log --;-- d ' (3 mill x x "lIf 71'1/2 H. 71'-1/2111' S "lIflb for all f : V(G) --+ IR, and p = e{3. for some positive value (3. Then the random walk on G satisfies .6. TV (t) S el-C if we have 1 volG c t> -log log- +- - (3 minx d x oX where A is as defined in (12.1) (or (12.3) for the modified walk as in (1. 16}}. volG C log log ", V 'n O:_ -fJ/J (--;--)]/1' = e . - =e. mm x d x From (12.10) and (12.11), we have, for any f, l1/Jx 71'-1/2 H. 71'1/2 fl s e "lIf7r 1 / 2 H. 71'-1/2111' S e "lIflb. In particular, for the heat kernel and the projection 10 into the zeroth eigenfunction, we have l1/Jx7r-1/2(H.+r - 10)71'1/2 fl S IVJx7r-l/2H.(Hr - 1 0 )71']/2 fl s e ,,1I7r- 1 / 2 (Hr - 10)71'1/2 fib s ell(Hr - 1 0 )71'1/2 fll2 < ell (Hr - 10Hb 1171'1/2 fib < e 1 -),r "II fib. PROOF. We follow the notation in Theorem 12.2. 1 .6. TV 2' m;x L l1/Jx p .+ r (y) - 7r(y)l Y s 1 2' m;x L l1/Jx 7r- 1 / 2 (H.+ r - 1 0 )7r 1 / 2 (y)1 y 1 - max '" e 1 -),r 7r (y) 2 x  y 1 1-),r -e 2 s s by using (12.12). o l1/Jx7r-1/2(H.+r - 10)gl S e 1 -),rll g lb Now we proceed to show that the log-Sobolev constant can be used to determine (3 in the above theorems. This proof is very similar to the continuous case ([149]; also see [101]). THEOREM 12.4. In a graph G with log-Sobolev constant a, its heat kernel Ht satisfies This is equivalent to for all g. This implies (12.12) l11/Jx7r-1/2(H.+r - 1 0 )112 < e 1 -),r. Therefore, the random walk on G converges to the stationary distribution under relative pairwise distance as follows (see (10.23)): ' .6.(28 + 2r) S max l1/Jx 7r- 1 / 2 (H2.+2r - 10)7r- 1 / 2 1/Jyl x,y S maxll1/Jx7r-l/2(H.+r - 1 0 )112 'lI1/J y 7r- 1 / 2 (Hs+r - 1 0 )112 x,y "lIf 71'1/2 Ht 71'-1/2111' s "lIflb for any t > 0, p = e 4Qt + 1, and for any f ; V(G) --+ IR. PROOF. From the definition of a, we have LU(x) - f(y))2w(x,y)  a Lf 2 (x)d x log f:(x)2 xy x L f (z)7r(z) S e 2 - 2 ),r by using (12.12) and the Cauchy-Schwarz inequality. Now, we take r = 2 c )' , t = 2s + 2r, and the proof is complete, 0 for any nontrivial function f. In particular, we can replace f by fp/2 and we obtain (12.13) LUP/2(X) - fp/2(y))2w(x, y)  a L JP(x)d x log f(x)p , xy x L JP(z)7r(z) \Ve ran also obtain a similar statement for the convergence bound under t.he total variation distance. Now we need the following inequality which is not hard to prove: (12.14) 4(p - 1)(a p / 2 - If'/2)2 S p2 (a - b)(a p - 1 - bp-I). 
184 12. ADVANCED TECHNIQUES FOR RANDOM WALKS ON GRAPHS 12.3. A COMPARISON THEOREM FOR THE LOG-SOBOLEV CONSTANT 185 for all a, b  0 and p  1. From (12.13) and (12.14), we have f (x)P a  JP(x)7r(x) log  x L f P (z)7r(z) by using the heat equation in the weighted version of Lemma 10,3. Substituting into (12.17), we obtain F'(t) p' 2( gP(x)7r(x) log gP(x) - log G(t)) p x 1 - vol G L(gP-l(x) - gP-I(y))(g(x) - g(y)) xy :::; L(fP/2(x) - fP/2(y))2w(x, y) xy (12.15) :::; p2 L(fv-I (x) - 1"-1 (y))(f(x) - f(y))wT,y 4 ( p - 1) xy 1 p' P gP(x) vol G ( p2 L Lg (x)d x log 10gG(t ) - x x (gP-l(x) - gP-l(y))(g(x) - g(y))wx,y) We now replace f by 9 = f7r I / 2 Ht7r- 1 / 2 in the above inequality and define p as a function of t: xy p=p(t)=1+e 4at . Note that p' = p'(t) = 4a(p - 1). From (12.15), we have :::; 0 by using (12.16). This completes the proof of Theorem 12.4. o (12.16) p' Lg P (x)7r(x) log Ig(x)IP - L(gP-l(X) - gP-l(y))(g(x) - g(y))WX,y :::; O. p2 x  gP(z)7r(z) xy Therefore we have THEOREM 12.5. In a weighted graph G with log-Sobolev constant a, we have .6.( t) :::; e 2 - c if F(t) = "lIgllp' Clearly, F(O) = "lIflb. If we can show that the derivative F'(t)  0, then --;e have "lIglip = F(t) :::; F(O) = "lIfll2 as desired. It remains to show F (t) :::; O. SInce F(t) = ((f7rl/2 Ht7r-1/2(X))P7r(X)) l/p = (G(t))l/p, 1 vol G c t> -log log- +_. - 2a minx d x ).. THEOREM 12.6. In a weighted graph G with log-Sobolev constant a, we have .6. Tv (t) :::; e 1 - c /2 if Now we define 1 vol G c t> -log log- +-. - 4a minx d x ).. we have 12.3. A comparison theorem for the log-Sobolev constant (12.17) F'(t) = (- : logG(t) + :i) ) F(t), An improvement of the convergence bounds in (12.4) depends on knowing (or estimating) the value of a, which, if anything, is harder to estimate than ).,1 (for general graphs). We can bypass this difficulty to some extent by the following (companion) comparison theorem for a. Its statement (and proof) is in fact quite close to that of Lemma 4.14. We note that G'(t) p  gP- 1 7r(X)(f7r 1 / 2 :iHt 7r- 1 / 2 (X)) + p'  gP(x)7r(x) log g(x) L dt x x LEMMA 12.7. Suppose G = (V, E) and G' = (V', E') are connected graphs, with logarithmic Sobolev constants a = ac and a' = ac" respectively. Suppose p : V  V' is a surjective map satisfying: I + II We consider the above sum of I as a product of matrices (where A* denotes the transpose of A): I P-1 7r l/2:i H 7r ' / 2 f * p 9 dt t -p gP- I 7r 1 / 2 (H t 7r 1 / 2 r _p gP-I7rI/2(7rl/2g* - L(gP-l(X) - gP-l(y))(g(x) - g(y))WX,y vol G xy (i) If d x and d, denote the degrees of v E V and x' E V', respectively, then for all x' E V' we have L d x  cd, . xEp-1 (x') (ii) For each edge e = xy E E there is a path P(e) between p(x) and p(y) in E' such that: (a) The number of edges of P(e) is at most £.; 
186 12. ADVANCED TECHNIQUES FOR RANDOM WALKS ON GRAPHS 12.4. LOGARITHMIC HARNACK INEQUALITIES 187 L We S m We' e:e'EP(e) If G and G' are regular with degrees k and k', respectively, then we have , k a >-a. - k'lm (b) For each edge e' E E', we have where We denotes the weight of the edge e. Then 12.4. Logarithmic Harnack inequalities (12.18) a'> a. - ern In previous sections we discuss log-Sobolev techniques that were adapted from the continuous case. In this section, we will consider the logarithmic Harnack inequality which was first motivated by the discrete problem on random walks, As it turns out, we can obtain the logarithmic Harnack inequalities for both Riemannian manifolds and for finite graphs. PROOF. Consider a function 9 : V' -+ JR which achieves the log-Sobolev con- stant a' in G'. Define f: V -+ JR such that f(x) = g(p(x)). Then we have L g2(e')we' e'EE' L J2(e)w e eEE IxIIxIII. 5(J) 5(J) . 5(g) For a smooth, compact, connected Riemannian manifold M, we let V denote the gradient with the associated Laplace-Beltrami operator .6.. Suppose M has no boundary or has a boundary which is convex (as defined in (12.5)), We consider .6. acting on functions f : M -+ JR satisfying a' 5(g) L g2(e')w e , e/EE' L f2(e)w e eEE (12.19) (12.20) I Ifl 2 = vol M  2 g(x) 5(g) =  f (x)d x log  2 x  f (z)n(z) satisfying the Dirichlet or Neumann boundary conditions. The log-Sobolev constant a of M is the least value satisfying: (12.21) 1M f2(x) log f2(x) S a 1M IV f(xW. where z Suppose f is a function achieving the log-Sobolev constant a. Then it can be shown that f satisfies the following equation: (12.22) .6.f = -afIogf2 Using (12.22), the following logarithmic Harnack inequality for the function f de- fined on M satisfying (12.20): (12.23) IV fl 2 + af 2 1 0g f2 S asup(f2 log f2). Exactly as in the proof of Lemma 4.14, we obtain 1 I> - , II> a. - lrn - It remains to show I II 2: c (which we do using a nice idea of Holley and Stroockj d. [101]). First, define F(, () :=  log  -  log ( -  + ( for all , ( > O. Note that F(, () 2: 0 and for ( > 0, F(, () is convex in . Thus, for some eo > 0, provided M has non-negative Ricci curvature. 5(J) L F(J2(x), eo)d x xEV ,, C") d') F(g(x')') > L cd,F(g(x')2) since F 2: 0 x'EV' The inequality in (12.22) is similar to the Harnack inequality except for a logarithmic factor. So, we call (12.22) the logarithmic Harnack inequality. It can be used to derive the following lower bound for log-Sobolev constants for a d- dimensional compact Riemannian manifold M with non-negative curvature ( also see [96]): ..x l 1 (12.24) a 2: mm{ 8e ' d D2(M) } where D(M) denotes the diameter of M and .xl is the first eigenvalue of the Lapla- cian. > c L F(g(x')2d,) by convexity x'EV' Suppose 5 denote an induced subgraph of G, We consider all nontrivial func- tions f : 5 U 85 -+ JR satisfying c5(g) . This implies I II 2: c and (12.18) is proved. o L f2(X)d x = vol 5. x 
188 12. ADVANCED TECHNIQUES FOR RANDOM WALKS ON GRAPHS 12.4. LOGARITHMIC HARNACK INEQUALITIES 189 where d x denotes the degree of x. The log-Sobolev constant a with the Neumann boundary condition satisfies: L (f(x) - f(y))2 . f {x,y}ES. as = I? L f2(x)d x logf2(x) xES PROOF. We use Lagrange's method, taking the derivative with respect to f(x) of the log-Rayleigh quotient (which is the right side of (12.4)). Then we have 2(f(x)d x logf2(x) + 2f(x)d x ) L(J(x) - f(y))2 xy + rtf(x) = 0 (L f2(X)d x log f2(X))2 2Lf(x) L f2(x) log f2(x) x x (12.28) where f ranges over all nontrivial functions satisfying the Neumann (or Dirichlet) boundary condition. (The case with Dirichlet boundary condition can be worked out in a similar way.) The function f achieving the log-Sobolev constant a in (12.4) satisfies: (12.25) L(J(x) - f(y)) = odxf(x) log f2(x) y yx for some constant CI. After substituting for a, the above expression can be simpli- fied to: (12.29) Lf(x) - a(J(x) log r(x) + 2f(x)) + c2f(x) = 0, After multiplying (12.29) by f(x) and summing over all x in V, we have L (J(x) - f(y))2 - a L f2(x)(log f2(x) + 2) + C2 L f2(X) = 0, xl"'VY X X where y  x means y is adjacent to x. For the discrete case, we can only establish the logarithmic Harnack inequality for invariant homogeneous graphs (which are defined later in Section 3). This implies C2 = 2a. Therefore we obtain from (12,29) Lf(x) = af(x)d x log f2(x). o (12.27) 1 a> - 24kD2 o log J We state here the following logarithmic Harnack inequality for homogeneous graphs which are invariant (as defined earlier in Chapter 9). THEOREM 12.9. In an invariant homogeneous gmph r with edge genemting set K consisting of k generators, SUppose a function f : V(r) -+ IR achieves the log-Sobolev constant and satisfies (12.20). Then the following inequality holds for all x E V(r): L[!(x) - f(axW ::; 6kc.nnax{U 2 logU 2 (1 +  log2 U 2 ), 1} aEK. (12.26) L(J(x) - f(y))2 :::; 6ad x sup f 2 (z) log f 2 (z)(1 +  log f 2 (z)). z y yx For a graph G with isoperimetric dimension 0 (see definition in Section 11.1) and with the assumption that G is a k-regular invariant homogeneous graph or a strongly convex subgraph, we can use (12.26) to show that where where D denotes the diameter of G. Since a random walk on a graph G on n vertices is close to stationarity after order loglognla steps, the above lower bounds for the 10gS?bole: cons.tant .a immediately imply a convergence bound of order (log log n )kD If the tsopenmetnc dimension is bounded. The proofs for log-Harnack inequalities are somewhat complicated. We will give a proof to (12.25) and describe both the discrete and continuous results. THEOREM 12.8. FOI' a gmph G, suppose f : V -+ IR satisfies (12.20) and achieves the log-Sobolev constant, and L f2(x)d x = vol G. Then f satisfies, for U = sup If(y)1  1. y THEOREM 12.10. In an abelian homogeneous gmph r with edge generating set K consisting of k generators, consider a strongly convex subgraph S of r. Suppose a function f : S U oS -+ IR satisfies the Dirichlet or Neumann boundary condition and achieves the log-Sobolev constant. Also, assume L f2(X)d x = vol S. Then xES the following inequality holds for all xES: L[!(x) - f(axW ::; 6komax{U 2 10gU 2 (1 +  log2 U 2 ), 1}. aEK. x The proofs of Theorems 12.9 and 12.10 are similar to, but somewhat more complicated than, those in Sections 9.3, 9.4, and 9.5. The complete proofs can be found in [62], any vertex x, Lf(x) = L(J(x) - f(y)) = af(x)d x logf2(x). y yx There are several useful properties that a function achieving the 10g-SoboIev constant possesses. Here we state SOllie without giving the proofs (see [62]), 
190 12. ADVANCED TECHNIQUES FOR RANDOM WALKS ON GRAPHS 12.5. THE ISOPERIMETRIC DIMENSION AND THE SOBOLEV INEQUALITY 191 THEOREM 12.11. In a connected invariant homogeneous graph f with edge generating set K consisting of k generators, suppose a function f : V(f)  IR achieves the log-Sobolev constant and L f2(x)d x = vol G. Then for all x E V(r), where u = sup If(z)1, . we have x k is the degree, and D denotes the diameter of S, and)..1 denotes the first eigenvalue of the Laplacian of G. u = sup If(y)1 s e k . y where e is the base of the natural logarithm. THEOREM 12.12. In a connected invar'iant homogeneous invariant graph G = (V, E), suppose a function f : V  IR satisfies the logarithmic Harnack inequality and L f2(x)d x = vol G. Then the log-Sobolev constant a of G satisfies 12.5. The isoperimetric dimension and the Sob ole v inequality x We recall that a graph G has isoperimetric dimension 0 with an isoperimetric constant C6 if for every subset X of V(G), the total sum of edge weights between X and the complement X of X satisfies  6-1  Wx,y 2': c6(vol X)--' xEX,y'i'X where vol X S vol X and C6 is a constant depending only on 11. . ( 1 1 ) a 2': mm 32kD2 ' 24kD2 I() U 2 ' whel'c U = sUP. If(z)1, k denotes the dcgl'ce, and JJ denotes the diametel' of G. THEOREM 12.13. Let S denote a strongly convex subgraph of a connected abelian homogeneous graph. Suppose a function f : V  IR satisfies the Dirichlet or Neu- mann boundary condition and achieves the log-Sobolev constant a. Also, assume L f2(x)d x = vol S. Then the log-Sobolev constant a of G satisfies xES We will establish the following convergence bound using the isoperimetric di- mension. In a weighted graph G with isoperimetric dimension 0 and isoperimetric constant C6, we have .6.(t) S e- C if .)..1 1 a 2': mm(4" 24kD 2 1 0g U2 )' where U = suP. If(z)l, k is the degree, and D denotes the diameter of S, and )..1 denotes the first eigenvalue of the Laplacian of G. c c' t> -+- -)..0 ).. where c' = log(c"ci1) for some absolute constant C". A k-regular abelian homogenous graph or a strongly convex subgraph has the eigenvalue bound To prove this, we will need the following version of the Sobolev inequality (see Section 11.3 and [60]): For any function g : V(G)  IR and for 0 > 2, (12.30) L Ig(u) - g(v)1 2 w(x,y) 2': ci:;f(L Ig(v) - mI2-Ydv) u"-'v v where I = 62 and c = C6(0 - 1)2/402. 1 A 1 >- - 8kD2 and this lower bound is sharp up to a constant factor (the factor of k is necessary for some homogeneous graphs). As a consequence of Theorems 12.4 , 12.9, and 12.10, the log-Sobolev constant and the eigenvalue )..1 can differ by at most a factor of log U. We will prove a discrete version of the classical regularity theory of De-Georgi- Nash-Moser [251]: THEOREM 12.15. For a weighted graph G with isoperimetric dimension 0, sup- pose f is a harmonic eigenfunction with eigenvalue)... Then we have sup I f2(X) Is c6/2 )..6/2 L f2(x)d x x For graphs with isoperimetric dimension 11 (defined in Section 11.1), we can derive a lower bound for n in terms of 11, x for some absolute constant C. THEOREM 12,14. Let S denote a strongly convex subgraph of a connected ho- mogeneous invar'iant graph with isoperimetric dimension o. Suppose a function f : V  IR satisfies the Dirichlet or Neumann boundary condition and achieves the log-Sobolev constant. Also, assume L f2(x)d x = vol S. Then the log-Sobolev xES PROOF. By (12.13), we have L AIfP(x)ld x L 1fP-1(x)1 L f(x) x constant a of G satisfies L(J(x) - f(y)). (JP-1(x) - f P - 1 (y))w(x,y) xy . Al 1 a 2': 111ln( 4" 24kD2 0 log 0 )' (12.31) 2': L 4(p 1) (f P / 2 (x) - jP/2(y)f w(x,y). xy p 
192 12. ADVANCED TECHNIQUES FOR RANDOM WALKS ON GRAPHS 12.5. THE ISOPERIMETRIC DIMENSION AND THE SOBOLEV INEQUALITY 193 Now we use t.he Sobolev ine'<}lIalit.y (12.30) wit.h!J = f"/2 and also (12.31). We have where C2 = 4e 2 cI' The proof of Theorem 12.15 is complete. o ( ) Ih  rp(x)d x < c- I  (JP/ 2 (x) - JP/2(y)f w(x,y) x,y 2 :s c- I (p ) ..\  fP(x)d x . 4p-1 x We note that in the proof of Theorem 12.15, it suffices to start with a function f satisfying (12.31). Here we state a slightly more general version of Theorem 12.15. COROLLARY 12.16. For a weighted graph G with isoperimetric dimension 0, suppose f is a function satisfying  ..\fP(x)d x   1"-1 (x) L f(x). Or, for q  0, (12.32) ( ) Ih  rq(x)d x x x 2 :s c-I--L..\" fq(x)d x . q-1  x Then we have sup I f2(X) I:s C/2 ..\/2 L f2(X)d x x x We apply (12.32) recursively. For q = 2, we have (FY(X)dx r h :s c 1 4..\ f2(X)dx where CI = c- I . Setting q = 2, we have for some absolute constant c. I/-/ (  f22 (x)d x ) :S (cI 2 1 ..\  f2 (x)d x ) l/a :S (CI ..\)Ih (  f2(X)dx ) Ih 2,. - 1 x ( 4 2 ) Ih :S (cIW+lh 4 2,  1 L f2(X)d x . x As a consequence of the above theorem, we have THEOREM 12.17. In a weighted graph G with isoperimetric dimension 0 and . .. I d lk h . .. O( log vol G Isopenmetnc constant c, t Ie ran om wa approac es statlOnanty In ..\0 + c' I) steps where c' = log(c"c,51) for some absolute constant c" and..\ = ..\1 if 1-..\1  ..\n-l - 1 and..\ = 2..\t!(..\1 + ..\n-d otherwise. PROOF. We replace f by gx = 1/;x1f-1/2(Ht - IO)1f-1/2 in Theorem 12.15. It can be checked that 9;(y)dy y vol G 1/;x 1f-1/2(H2t - IO)1f-1/21/;x Extending to q = 2,i, we get (  f2; (x)d x ) IN (CI..\)I+1/a+ ..+Ih; 4 (  ) Ih (  ) Ih2 ...  f2(X)d x 2,. - 1 2,.2 - 1 x < :S e-2t>'II1f-l/21/;xIl2vol G -21>. vol G :S e -. d x Since gx is orthogonal to the eigenfunction 4>0 of C, we have e- t >. 9(y)dy  g-I(y) L 9x(Y), y y 1 1 1 1+-+...+ :S ---r , " 1 - - , o 2' By Corollary 12.16, we have sup I g;(x) I:S c/2e->'t/2 9;(Y)dy. y We now note that Finally, we consider Moreover, 4 (  ) Ih (  ) lh2 2, - 1 2,.2 - 1 4  / 2 .!.++...+.i.. :S ,." " (t) max Ipt(y,x) - 7r(x)1 x,y 7r(x) max max 19x (y) I x y :S maxc/2e-t>'/2 L9;(y)d y x y /2 -t>'/2 vol G :S c e minx d x where c = C"c,5l. Theorem 12.17 is proved. o :S 4/2,./(2-2) :S (4e2)/2. Therefore we have sup I f2(x) I:S c/2 ..\/2  f2(X)d x x x 
194 12. ADVANCED TECHNIQUES FOR RANDOM WALKS ON GRAPHS Many invariants of the hypercube Qn can be effectively evaluated using the fact that Qn is the cartesian product of an edge. The convergence bound for the random walk problem on Qn is of order n log n (as described at the end of Chapter 1) . When dealing with subgraphs of Qn, the random walk problems become more complcated. We say Q is a punctured cube if it is a subgraph of Qn obtained by removmg one vertex from Qn. We will use the isoperimetric dimension approach as follows: Bibliography The isoperimetric problems on hypercubes have long been studied. For a fixed number m, the edge boundary of a subset X <:::; V(Qn) with vol X = Tn, is minimized when X is close to a Hamming ball (i.e., Nr(v) for some v and r). In other words, the isoperimetric dimension for Qn is 8 = n/ log n and the isoperimetric constant q = 1. Using Theorem 12.17, we have  ( t ) < log vol Qn - 8>' < nlogn. For. a punctured cube Q, the isoperimetric dimension stays virtually unchanged. So It follows from Theorem 12.17, that its (lazy) random walk converges in time O(nlogn). [IJ H.L. Abbott, Lower bounds for some Ramsey numbers, Discrete Math. 2 (1972), 289-293. [2] A. Agresti, Categorical Data Analysis, John Wiley and Sons, New York, 1990. [3] D. Aldous, On the Markov-chain simulation method for uniform combinatorial simulation and simulated annealing, Prob. Eng. Info. Sci. 1 (1987), 33-46. [4J D. Aldous, Some inequalities for reversible Markov chains, j, London Math. Soc. 25 (1982), 564-576. [5] N. Alon, Eigenvalues and expanders, Combinatorica 6 (1986), 86-96. [6] N. Alon and F .R.K. Chung, Explicit constructions of linear-sized tolerant networks, Discrete Math. 72 (1988), 15-20. [7] N. Alon, F.R.K. Chung and R.L. Graham, Routing permutations on graphs via matchings, SIAM J. Disc, Math. 7 (1994), 513-530. [8] N. Alon, Z. Galil and V.D. Milman, Better expanders and superconcentrators, J. Algorithms 8 (1987), 337-347. [9] N. Alon and V. D. Milman, >-1 isoperimetric inequalities for graphs and superconcentrators, J. Comb. Theory B 38 (1985), 73-88. [10] N. Alon, Z. Galil and O. Margalit., On the exponent of the all pairs short.est paths prob- lem, 32nd Symposium on Foundations of Computer Science, IEEE Computer Society Press, (1991), 569-575. [11] N. Alon and N. Kahale, Approximating the independence number via the () function, preprint. [12] N. Alon and J.H. Spencer, The Probabilistic Method, John Wiley and Sons, New York 1991. [13] S. Arora and S, Safra, Probabilistic checking of proofs; a new characterization of N P. 33nd Symposium on Foundations of Computer Science, IEEE Computer Societ.y Press, (1992), 2-13. [14] L. Babai and M. Szegedy, Local expansion of symmetrical graphs, Combinatorics, Probability and Computing 1 (1991), 1-12. . [15) L. Babai, Automorphism groups, isomorphism, reconst.ruction, Handbook of Combinatorics (eds. R. L. Graham, Grotschel and L. Lovasz), North-Holland, Amst.erdam, (1996), 1447- 1540. [16] D. Bakry, L'hypercontractivite et son utilisation en theorie des semigroups, In Ecole d' "t" de Saint Fleur 1 992, Springer Lecture Notes 1581. [17J L.A. Bassalygo, Asymptotically optimal switching circuits, Problems Inform. Tmnsmission 17 (1981), 206-21 I. [18] J. Beck, On size Ramsey number of paths, trees and circuits 1., J. Graph Theor'y 7 (1983), 115-129. [19] W. Beckner, Inequalities in Fourier analysis, Annals of Mathematics 102 (1975), 159-182. [20] V.E. Ben<\s, Mathematical Theory of Connecting Networks, Academic Press, New York 1965, [21] J.C. Bermond and B. Bollobas, The diamet.er of graphs - a survey, Congressus Numerantium 32 (1981), 3-27. [22] J.C. Bermond, C. Delorme and G. Farhi, Large graphs with given degree and diamet.er, III, Proc. Coli. Cambridge (1981), Ann. Discr. Math. 13, North Holland, Amsterdam (1982), 23-32. [23] A. J. Berstein, Maximally connected arrays on the n-cube, SIAM J. Appl. Math. 15 (1967), 1485-1489. [24] F. Bien, Constructions of telephone networks by group representations, Notices Amer. Math. Soc. 36 (1989), 5-22. 195 
196 BIBLIOGRAPHY [25J N.L. Biggs, Algebraic Graph Theory, (2nd ed.), Cambridge University Press, Cambridge, 1993. [26J N.L. Biggs and M.H. Hoare, The sextet construction for cubic graphs, Combinatorica 3 (1983), 153-165. [27J N.L. Biggs, E.K. Lloyd and R.J. Wilson, Graph Theory 1736-1936, Clarendon Press, Oxford, 1976. [28] Y. Bishop, S. Fienberg, P. Holland, Discrete Multivariate Analysis, MIT Press, Cambridge, 1975. [29] M. Blum, R.M. Karp, O.Vornberger, C. II. Papadimitriou, and M. Yannakakis, The complex- ity of testing whether a graph is a superconcentrator, Inf. Proc. Letters 13 (1981), 164-167. [30] B. Bollob:\s, Random Graphs, Academic Press, New York (1987). [31] B. Bollob:ls, Extremal Graph Theory, Academic Press, London (1978). [32J B. Bollob:ls and F.R.K. Chung, The diameter of a cycle plus a random matching,SIAM J. on Discrete Mathematics 1 (1988), 328-333. [33) B. Bollob:ls and I. Leader, Edge-isoperimetric inequalities in the grid, Combinatorica 11(1991), 299-314. [34] B. Bollob:ls and I. Leader, An isoperimetric inequality on the discrete torus, SIA M J. Disc. Math. 3 (1990), 32-37. [35J B. Bollob:ls, and A. Thomason, Graphs which contain all small graphs, European J. of Com- binatorics 2 (1981), 13-15. [36J B. Bollob:ls and W.F. de la Vega, The diameter of random graphs, Combinatorica 2 (1982), 125-134. [37J J.A. Bondy and M. Simonovits, Cycles of even length in graphs, J. Combin. Theory Ser. B 16 (1974), 97-105. [38J R.B. Boppana, Eigenvalues and graph bisection: An average-case analysis, 28nd Symposium on Foundations of Computer Science, IEEE Computer Society Press, (1987), 280-285. [39J R. Bott and J.P. Mayberry, Matrices and trees, In Economic Activity Analysis, (0. Morgen- stern, ed.), John Wiley and Sons, New York (1954), 391-340. [40J A. Broder, A. Frieze and E. Upfal, Existence and construction of edge disjoint paths on expander graphs, Proc. Sym. Theo. on Computing, ACM (1992), 140-149. [41) R. Brooks, The spectral geometry of k-regular graphs, Journal d'Analyse Matl",matique, 57 (1991), 120-151. [42] N.G. de Bruijn, A combinatorial problem, Nederl. Akad. Wetensch. Proc. 49 (1946),758-764. [43] D.A. Burgess, On character sums and primitive roots, Proc. London Math. Soc. 12 (1962) 179-192. [44J P. Buser, Cayley graphs and planar isospectral domains, in Geometry and Analysis on Man- ifolds (1'. Sunada, ed.), Springer Lecture Notes 1339 (1988), 64-77. [45] P. Enser, Cubic graphs and the first eigenvalue of a Riemann surface, Math. Z. 162 (1978), 87-99, [46) L. Caccetta, On extremal graphs with given diameter and connectivity, Ann. New York Acad. Sci. 328 (1979), 76-94. [47J A. Cayley, A theorem on trees, Quart. J. Math. 23 (1889), 376-378. [48) J. Cheeger, A lower bound for the smallest eigenvalue of the Laplacian, Problems in Analysis (R. C. Gunning, ed.), Princeton Univ. Press (1970), 195-199. [49] Siu Yuen Cheng, Peter Li and Shing-'IUng Yau, On the upper estimate of the heat kernel of a complete Riemannian manifold, American Journal of Mathematics 103 (1981), 1021-1063. [50] R, Christensen, Log-Linear Models, Springer-Verlag, New York, 1990. [51] F.R.K. Chung, Diameters and eigenvalues, J. of Amer. Math. Soc. 2 (1989), 187-196. [52J F.R.K. Chung, Eigenvalues of graphs and Cheeger inequalities, in Combinatorics, Paul Erdos is Eighty, Volume 2, edited by D. Miklos, V. T. Sos, and T. Szonyi, Janos Bolyai Mathematical Society, Budapest (1996), 157-172. [53J F.R,K. Chung, V. Faber and T. A, Manteuffel, On the diameter of a graph from eigenvalues associated with its Laplacian, SIAM. J. Discrete Math. 7(1994), 443-457, [54] F.R.I<. Chung, A. Grigor'yan, and S.,T. Yau, Upper bounds for eigenvalues of the discrete and continuous Laplace operators, Advances in Mathematics 117 (1996), 165-178. [55] F.R.K. Chung, A. Grigor'yan, and S.-T. Yau, Eigenvalues and diameters for manifolds and graphs, Tsing ]{ua Lectures on Geometry and Analysis, to appear. [56] F.R.K. Chung aud S.-T. Yau, A Harnack inequality for Dirichlet eigenvalues, preprint. BIBLIOGRAPHY 197 [57] [67J [68J F.R.K. Chung and Prasad Tetali, Isoperimetric inequalities for cartesian products of graphs, preprint. F.R,K. Chung and S.-T. Yau, A Harnack inequality for homogeneous graphs and subgraphs, Communications in Analysis and Geometry, 2 (1994), 628-639. F.R.K. Chung and S.-T. Yau, Eigenvalues of graphs and Sobolev inequalities, Combinatorics, Probability and Computing, 4 (1995), 11-26. F.R.K. Chung and S,-T. Yau, Eigenvalue inequalities of graphs and convex subgraphs, Com- munications in Analysis and Geometry, to appear. F.R.K, Chung and S.-T. Yau, Eigenvalues, flows and separators of graphs, preprint.. F.R.K. Chung and S.-T. Yau, Logarithmic Harnack inequalities, preprint. F.R.K. Chung, On concentrators, superconcentrators, generalizers and nonblocking networks, Bell Systems Tech, J. 58 (1978),1765-1777. F.R.K. Chung, A note on constructive methods for Ramsey numbers, J. Graph Th. 5 (1981), 109-113. F.R.K. Chung, Diameters of communications networks, Mathematics of Information Pro- cessing, AMS Short Course Lecture Notes (1984), 1-18. F.R.K. Chung, Diameters of graphs: Old problems and new results, Congressus Numerantium 60 (1987),295-317. F.R.K. Chung, Quasi-random classes of hypergraphs, Random Structures and Algorithms 1 (1990), 363-382. F.R.K. Chung and M.R. Garey, Diameter bounds for altered graphs, J. of Graph The01'y 8 (1984), 511-534. F.R.K. Chung, Constructing random-like graphs, in Probabilistic Combinatorics and Its Ap- plications, (B. Bollobas ed.), Amer. Math. Soc., Providence, (1991) 21-56 F.R.K. Chung and R.L. Graham, Quasi-random hypergraphs, Random Structures and Algo- rithms 1 (1990), 105-124. F.R.K. Chung and R.L. Graham, Qua.i-random tournaments, J. of Graph Theory 15 (1991), 173-198. F,R.K, Chung and R,L. Graham, Maximum cuts and quasi-random graphs, Random Graphs (Alan Frieze and Tomasz Luczak, eds,), John Wiley and Sons, New York (1992), 23-34. F.R.K. Chung and R.L. Graham, On graphs not containing prescribed induced subgraphs, in A Tribute to Paul Erdos, (A. Baker et al. eds.) Cambridge University Press (1990), 111-120. F.R.K. Chung and R.L. Graham, Quasi-random set systems, J. Amer. Math. Soc. 4 (1991), 151-196. F.R.K, Chung and R.L. Graham, Quasi-random subsets of Zn, J. Combin. Th. (A) 61 (1992), 64-86, F.R.K. Chung, R.L. Graham and R.M. Wilson, Quasi-random graphs, Combinatorica 9 (1989),345-362. F .R.K. Chung, The regularity lemma for hypergraphs and quasi-randomness, Random Struc- tures and Algorithms 2 (1991), 241-252. F .R.K. Chung and R.L. Graham, Co homological aspects of hypergraphs, nuns. Amer. Math. Soc. 334 (1992), 365-388 F.R.K. Chung, R.L. Graham and S.-T. Yau, On sampling with Markov chains, Random Structures and Algorithms 9 (1996) 55-78. F.R.K. Chung and R.L. Graham, Random walks on generating sets of groups, preprint. F.R.K. Chung and R.L. Graham, Stratified random walks on an n-cube, preprint. F.R.K. Chung and C.M. Grinstead, A survey of bounds for classical Ramsey numbers, J. Graph Theory 7 (1983), 25-38, F.R,K. Chung and K. Oden, Weighted graph Laplacians and isoperimetric inequalities, preprint. F.R.K. Chung and S. Sternberg, Laplacian and vibrational spectra for homogenous graphs, J. Graph Theory 16 (1992), 605-627. F,R.K. Chung and S, Sternberg, Mathematics and the Buckyball, American Scientist, 81 (1993),56-71. F.R.K. Chung, B. Kostant and S. Sternberg, Groups and the Buckyball, in Lie Theory and Geometry: In honor of Bertram Kostant (Eds. J.-L. Brylinski, R. Brylinski, V. Guillemin and V. Kac) PM 123, Birkhauser, Boston, 1994. F .R.K. Chung, D. Rockmore, S. Sternberg, On the symmetry of the Buckyball, preprint. [58J [59J [60J [61] [62J [63J [64J [65] [66J [69J [70J [71] [72J [73] [74] [75] [76] [77] [78] [79J [80J [81] [82] [83J [84J [85] [86J [87J 
198 BIBLIOGRAPHY BIBLIOGRAPHY 199 [88J F.R.K. Chung and P. Tetali, Communication complexity and quasi-randomness, SlAM .I. Discrete Math. 6 (1993), 110-123. [89] F.R.K. Chung and R.P. Langlands, A combinatorial Laplacian with vertex weight" .I. Comb. Theory (A), 75 (1996), 316-327. [90J D. M. Cvetkovic, M. Doob and II. Sachs, Spectm of Graphs, Theory and Application, Aca- demic Press, 1980. [91) D. M. Cvetkovic, M. Doob, I. Gutman, and A. TorgaSev, Recent results in the Theory of Gmph Spectm, North Holland, Amsterdam 1988. [92J B.B. Davies, Heat kernel bounds, conservation of probability and the Feller property, .I. d'Analyse Math. 58, (1992), 99-119. [93] P.J. Davis, Girculant Matrices, John Wiley and Sons, New York (1979). [94) P. Deligne, La conjecture de Weil I, lnst. lIautes Etudes Sci. Publ. Math 43 (1974) 273-307. [95] E. D'Hoker and D.l1. Phong, On determinants of Laplacians on Riemann surfaces, Comm. Math. Phys. 104 (1986), 537-545. [96] J.-D. Deuschel and D.W. Stroock, Hypercontractivity and spectral gap of symmetric diffu- sions with applications to the stochast.ic Ising models, .T. Funct. Anal. 92 (1990), 30-48. [97] P. Diaconis, Group Representations in Probability and Statistics, Institute of Math. Statistics, lIayward, California, 1988, [9R] P. Diaronis and D.W. Stroock, Gcon1Ctric hounds for eigenvalues of Markov chains, Annals Applied Prob. 1 (1991), 36-61. [99) P. Diaconis and L. Saloff-Coste, Comparison theorems for reversible Markov chains, Annals of Applied Prob. 3 (1993), 696-730. [100] P. Diaconis and L. Saloff-Coste, Comparison techniques for random walks on finite groups Annals of Applied Prob. 4 (1993), 2131-2156. [101] P. Diaconis and L. Saloff-Coste, Logarithmic Sobolev inequalities for finite Markov chains, preprint. [102J P. Diaconis and L, Saloff-Coste, Walks on generating sets of groups, preprint. [103] P. Diaconis and B. Sturmfels, Algebraic algorithms for sampling from conditional distribu- tions, preprint. [104] P. Diaconis, R.L. Graham and J. Morrison, Asymptotic analysis of a random walk on a hypercube with many dimensions, Random Structures and Algorithms 1 (1990), 51-72. [105] P. Diaconis and L. Saloff-Coste, An application of Harnack inequalities to random walk on nilpotent quotients, preprint. [106] M.J. Dinneen, M.R. Fellows and V. Faber, Algebraic constructions of efficient broadcast networks, Lectuf-e Note.. in Comput. Sci., 539, Springer, Berlin, 1991, 152-158. [107J J. Dodziuk and L. Karp, Spectral and function theory for combinatorial Laplacians, in Geometry of Random Motion, Contemp. Math 73, AMS Publication (1988), 25-40. [108] M. Dyer, A, Frieze and R. Kalman, A random polynomial time algorithm for approximating the volume of convex bodies, .TACM 38 (1991), 1-17. [109J M. Eichler, Quaternary quadratic forms and the Riemann hypothesis for congruence zeta functions, Arch. Math. 5 (1954), 355-366. [IIOJ B. Elspas, Topological constraints on interconnection limited logic, Switching Circuit Theory and Logical Design 5 (1964), 133-147. [111] P. Erdos, Some remarks on the theory of graphs, Bull. Amer. Math. Soc. 53 (1947), 292-294. [1I2J P. Erdos, Some remarks on chromatic graphs, Colloquium Mathematicum 16 (1967), 253- 256. [1I3J P, Erdos, S. Fajtlowicz and A.J. Hoffman, Maximum degree in graphs of diameter 2, Net- works 10 (1980), 87-90. [114] P. Erd6s and A. Hajnal, On spanned subgraphs of graphs, Betmge znr Gmphentheorie nnd deren Anwendungen, Kolloq. Oberhof (DDR) (1977), 80-96. [115] P. Erdos and A. Renyi, On a problem in the theory of graphs, Publ. Math. Inst. lIungar. Acad. Sci. 7 (1962),623-641. [116] P. Erdos, A. Renyi and V.T. S6s, On a problem of graph theory, Studia Sci. Math. lIungar. 1 (1966), 215-235. [117J P, Erdos and H. Sachs, Regulare Graphen gegenebener Teil\enweite mit Minimaler Knoten- zahl, Wiss. Z. Univ. Halle - Wittenberg, Math. Nat. R. 12 (1963), 251-258, [118] P. Erdos and V.T. S6s, On Ramsey-Tunin type theorems for hypergraphs, Combinatorica 2 (1982), 289-295. [119J P. Erdos and J. Spencer, lrnbalances in k-colorations, Networks 1 (1972), 379-386. [120] P. Erdos and J. Spencer, Probabilistic Methods in Combinatorics, Academic Press, New York (1974). [121] R.J. Faudree and M. Simonovits, On a claBs of degenerate extremal graph problems, Gom- binatorica 3 (1983), 97-107. [122) U. Feige, Randomized graph products, chromatic numbers, and the Lovasz O-function, l'roc. Sym. Theo. on Computing, ACM (1995), 635-640. [123] U. Feige, S. Goldwasser, L. Lovasz, S. Safra, and M. Szegedy, Approximating clique is al- most NP-complete, 32nd Symposium on Foundations of Computer Science, IEEE Computer Society Press, (1991), 2-12. [124] P. Frankl and V. Radl, Forbidden intersections, Trans. AMS 300 (1987), 259-286, [125] J.A. Fill, Eigenvalue bounds on convergence to stationarity for nonreversible Markov chains, with an application to the exclusion process, Ann. Appl. Prob. 1 (1991) 62-87. [126) M. Friedler, Algebraic connectivity of graphs, Czech. Math. .T. 23 (98) (1973), 298,305. [127] L.R. Ford and D.R. Fulkerson, Flows in Networks, Princeton Univ. Press (1962). [128] P. Frankl, A constructive lower bound for some Ramsey numbers, Ars Combinatoria 3 (1977), 297-302. [129] P. Frankl, V. Radl and R.M. Wilson, The number of submatrices of given type in a lIadamard mat.rix and related result.s, .T. Combinatorial Th. (B) 44 (1988),317,328. [130] P. Frankl and H.,M. Wilson, Intersection theorems with geometric consequences, Combina- torica 1 (1981), 357-368. [131] M. L. Fredman, New bounds on the complexity of the shortest path problem, SlAM .T. Computing 5 (1976), 83-89. [132] Joel Friedman, On the second eigenvalue and random walks in random d-regular graphs, Combinatorica 11 (1991), 331-362. [133] J. Friedman and N. Pippenger, Expanding graphs contain all small trees, Combinatorica 7 (1987), 71-76. (134) G.Frobenius, Uber die Charaktere der alternierenden Gruppe, Sitzungsberichte Preuss. Akad, Wiss, (1901), 303-315. [135] G. Frobenius, Uber Matrizen aus nicht negative Elementen, Sitzber. Akad, Wiss. Berlin (1912), 456-477. [136] Z. Furedi and J. Koml6s, The eigenvalues of random symmetric matrices, Gombinatoriea 1 (1981),233-241. [137J O. Gabber and Z. Galil, Explicit construction of linear sized superconcentrat.ors, .T. Comp"t. System Sci. 22 (1981), 407,420. [138J A, Galtman, Laplacians, t.he Lovasz number, and Delsarte's linear programming bound, preprint. [139] F.R. Gantmacher, The Theory of Matrices, Vol. I, Chelsea Pub. Co., New York (1977). [140] M.R. Garey and D.S. Johnson, Computers and Intmctability, A Guide to the Theory of NP-Completeness, W. H. Freeman and Co., San Francisco, 1979. [14IJ M. Goemans and D. Williamson, Improved approximation algorithms for maximum cut and satisfiability problems using semidefinite programming, J. ACM 42 (1995), 1115,1145. [142] P. Ginsbarg, Applied Conformal Field Theory, les Houches (1988). [143] W. Goddard, private communication. [I44J R.L. Graham and V. Radl, Numbers in Ramsey theory, Surveys in Gombinatorics (1987), (C. Whitehead, ed.) London Math. Soc. Lecture Notes Series 123,111-153. [145] S.W. Graham and C. Ringrose, Lower bounds for least quadratic non-residues, Analytic Number Theory, (edited by B. Berndt, II. lIalberstam, II. Diamond and A. Ilildebrand), Birkhiiuser, Boston 1990. [146] R.L. Graham and J.II. Spencer, A constructive solution to a tournament problem, Canad. Math. Bull. 14 (1971), 45-48. [147] A, Grigor'yan, Integral maximum principle and its applications, Proc. of Edinbur.Qh /loyal Society, t.o appear. [148J M. Gromov, Groups of polynomial growth and expanding maps, Publ. lilES, 53 (1981), 53-78. [149] L. Gross, Logarithmic Sobolev inequalities, Amer. .T. Math. 97 (1976), 1061-1083. [150] L. Gross, Logarithmic Sobolev inequalities and contmctillity propertie.. of ..emi-groups, Springer Lecture Notes 1563. (1993). 
200 BIBLIOGHAPIIY BIBLIOGHAPHY 201 [151] M. Grotschel, L. Lovasz and A. Schrijver, The ellipsoid method and its consequences in combinatorial optimization, Combinatorica 1 (1981), 169-197. [152] M. Grotschel, L. Lovasz and A. Schrijver, Geometric Algorithms and Combinalorial Opti- mization, Springer-Verlag, Berlin, 1988. [153J W. Haemers, Eigenvalue methods in Packing and Covering in Combinatorics, (A. Schrijver ed.), Mathematisch Centrum, Amsterdam (1982), 15-38. [154] M.M. Halldorsson, A still better performance quarantee for approximating graph coloring, Information Processing Letters 45 (1993), 19-23. [155] L. H. Harper, Optimal numberings and isoperimet.ric problems on graphs, J. of Comb. Theory 1 (1966), 385-393. [156] S. Hart, A note on the edges of t.he ,,-cube, Discrete Math. 14 (1976), 157-163. [157J J. Hastad, Clique is hard to approximate within ,,1-', preprinl. [158] J. Haviland and A. Thomason, Pseudo-random hypergraphs, Discrete Math. 75 (1989), 255- 278. [159] W. l\ebisch and L. Saloff-Cost.e, Gaussian estimates for Markov chains and random walks on gronps, preprint. [160] A.J. Hoffman and H.R. Singleton, On Moore graphs with diameter 2 and 3, IBM .1. of Res. Development 4 (1960), 197-501. [161] A. J. Hoffman, Eigenvalues of graphs, in Studies in Graph Theory II (D. R. Fulkerson, ed.), M.A.A. Studies in Math, Washington D.C.,(1975), 225-245. [162] R. A. Horn and C.R. Johnson, Matrix Analysis, Cambridge University Press, New York, 1985. [163] J. Igusa, Fibre systems of Jacobian variet.ies 1\1, American J. of Math. 81 (1959), 453476. [164] W. Imrich, Explicit construction of regular graphs without small cycles, Comblllatorlca 4 (1984),53-59. . [165] K. Ireland and M. Rosen, A Classical Introduction to Modern Number Theory, SprInger- Verlag, New York 1982, [166] M. Jerrum and A. J. Sillclair, Approximating t.he permallent, SIAM J. Computing 18 (1989), 1149-1178. [167J F. Juhasz, On t.he spectrum of a random graph, Colloq. Math. Soc. Janos Bolyai 25, Alge- braic Me/hods in Graphs Theory, Szeged (1978),313-316. [168J N. Kahale, Isoperimetric inequalities and eigenvalues, SIAM J. Discrete Math., to appear. [169] B.S. Kashin and S.V. Konyagin, On systems of vectors in a Hilbert space, Trudy Mat. Inst. imeni V. A. Steklova 157 (1981) 61-67. English translation in Proceedings of the Steklow Institute of Math. AMS (1983), 67-70. [170] N.M, Katz, An estimate for character sums, J. Amer. Math. Soc. 2 (1989),197-200. [171] F. Kirchhoff, Uber die Auflosung der Gleichungen, auf welche man bei der Untersuchung der linearen Verteilung galvanischer Strome gefiihrt wird, Ann. Phys. chem. 72 (1847), 497-508 [172J M. Klawe, Non-existence of one-dimensional expanding graphs, 22nd Symposium on Foun- dations of Computer Science, IEEE Computer Society Press, (1981), 109-113. [173] D. Karger, R. Motwani, and M. Sudan, Approximate graph coloring by semi-definite pro- gramming, 35th Symposium on Foundations of Computer science, IEEE Comput.er Society Press, 1994, 2-13. [174J D.E. Knuth, The Art of Computer Programming, vo!. 3, p. 241, Addison-Wesley, Reading, MA, 1973. [175] n.F,. Knut.h, The sandwich th('orem, Electronic.1. of Combinatorics 1 (1991), AI. [176] Hobert 1'. Langlands alld YvaJl Saint-Anbin, Algebro-geometric aspects of the Bethe equa- tions, preprint. . . [177J F. Lazebnik, V. A. Ustimenko and A. J. Woldar, A new series of dense graphs of hIgh gIrth, Bull. Amer. Math. Soc. 32 (1995), 73-79. [178J F.T, Leighton, Introduction to Parallel Algorithms and Architectures: Arrays, Trees, Hy- percubes, Morgan-Kauffman, San Mateo, CA, 1992. [179] F.T. Leighton and Satish Rao, An approximate max-flow min-cut teorem for uniform mul- ticommodity flow problem with applications to approximation algorIthms, 2gnd SympoSIum on Foundations of Computer Science, 1EEE Computer Society Press, (1988), 422-431. [180J T. Lengauer and R.E. Tarjan, Asymptotically tight bounds on time-space trade-offs in a pebble game, J. Assoc. Comput. Mach. 29 (1982), 1087-1130. [181] H. LeJlstra, personal communicat.ion. [182] G. Lev, Size bounds and parallel algorithms for networks, Ph.D. Thesis, Department of Computer Science, University of Edinburg. [183J W. Li, Character sums and abelian Ramanujan graphs, J. Number Theory 41 (1992), 199- 217. [184J P. Li and S. T. Yau, On the parabolic kernel of the Schrodinger operator, Acta Mathematica 156 (1986), 153-201. [185] P. Li and S. T. Yau, Estimates of eigenvalues of a compact Riemannian manifold, Amer. Math. Soc. Proc. Symp. Pure Math. 36 (1980), 205-240. [186] J.H. Lindsey, Assignment of numbers to vertices, Amer. Math. Monthly 71 (1961), 508-516. [187] R.J. Lipton and R.E. Tarjan, A separator theorem for planar graphs, SIAM J. Appl. Math. 36 (1979), 177-189. [188] L. Lovasz, On the Shannon capacity of a graph, Transactions on Information Theory -1'1'- 25, IEEE Computer Society Press, (1979), 1-7. [189] L. Lovasz, Perfect graphs, in Selected Topics in Graph Theory 2, (eds R. L. Wilson and L.W. Beineke), Academic Press, New York (1983), 55-87. [190] L. Lovasz and M. Simonovits, Random walks in a convex body and an improved volume algorithm, Random Structures and Algorithms 4 (1993),359-112. [191] A, Lubot.zky, n.. Phillips and P. Sarnak, Ramanujan graphs, Combinatorica 8 (1988), 261- 278. [192] G.A. Margulis, Explicit constructions of concentrators, Problemy Peredaci Informacii 9 (1973),71-80 (English trans!. in Problems Inform. Transmission 9 (1975), 325-332. [193] G.A. Margulis, Arithmetic groups and graphs without short cycles, 6th Internat. Symp. on Information Theory, Tashkent (1984) Abstracts 1, 123-125 (in Russian). [194] G.A. Margulis, Some new constructions of low-density parity check codes, 3rd Internat. Seminar on Information Theory, convolution codes and multi-user communication, Sochi (1987), 275-279 (in Russian). [195] G.A. Margulis, Explicit group theoretic constructions of combinatorial schemes and their ap- plicaUons for the const.ruction of expanders alld concent.rators, Problemy Peredaci Informacii (1988) (in Russian). [196J J.C. Maxwell, A Treatise on Electricity and Magnetism I, Oxford, Clarendon Press (1892), 403-410, [I97J B. Mohar, Isoperimetric number of graphs, J. of Comb. Theory (B) 47 (1989), 274-291. [198J R.J. McEliece, E. R. Rodemich, and H.C. Rumsey, Jr., The Lovasz and some generalizations, J. Combinatorics, Inform. Syst. Sci. 3 (1978), 134-152. [199] ILL. Montgomery, Topics in Multiplicative Number Theory, Lecture Notes in Math. 227, Springer-Verlag, New York (1971). [200] J. W. Moon, Counting Labelled Trees, Canadian Mathematical Monographs, Canadian Mathematical Congress, Montreal, 1970. [201J ZS. Nagy, A constructive estimat.ion of the Ramsey numbers, Mat. Lapok 23 (1975), 301-302. [202] A. Nilli, On the second eigenvalue of a graph, Di;crete Math. 91 (1991),207-210. [203] B. Osgood, R. Phillips, and P. Sarnak, Extremals of determinants of Laplacians, J. Funct. Anal. 80 (1988), 148-211. [204J B. Osgood, R. Phillips, and P. Sarnak, Moduli space, heights and isospectral set.s of plane domains, Ann. Math. 129 (1989), 293-362. [205] E.M. Palmer, Graphical Evolution, John Wiley and Sons, New York (19R5). [206] W.J. Paul, R.E. Tarjan and J.n.. Celani, Space bounds for a game on graphs, Math. Soc. Theory 10 (1977), 239- 251. [207] O. Perron, Zur Theorie der Matrizen, Math, Ann. 64 (1907), 248-263. [208] M. Pinsker, On the complexity of a concentrat.or, 7th Internal. Teletraffic ConI., Stockholm, June 1973, 318/1-318/4. [209] N. Pippenger, Superconcentrators, SIAM J. Comput. 6 (1977), 298-304. [210] N. Pippenger, Advances in pebbling, Internat. Collo. On Automation Languages and Pro- gramming 9 (1982), 407-417, [211J G. Polya and S. Szego, Isoperimetric 1nequalities in Mathematical Physics, Annals of Math. Studies, no, 27, Princeton University Press, (1951). [212J A.M. Polyakov, Quantum geometry of bosonic strings, Phys. Letters B 103 (1981), 207-210. [213J P, Sarnak, Some Applications of Modular Forms, Cambridge Universit.y Press, Cambridge, 1990. 
202 BIBLIOGHAI'IIY BlBLlOGItAI'IIY 203 [214] S. Ramanujan, On certain arithmetical functions, 1'rans. Cambridge Philos. Soc. 22 (9) (1916), 159-181. [215J F.P. Ramsey, On a problem of formal logic, Proc. London Math. Soc. 30 (1930), 264-286. [216] D. Ray and I.M. Singer, Analytic torsion for complex manifolds, Ann. Math. 98 (1973), 154. [217] O.K. Ray-Chaudihuri and R.M. Wilson, On t-designs, Osaka J. Math. 12 (1975), 745-744. [218J A. Renyi, On the enumeration of trees, in Combinatorial Structures and their Applications (R. Guy, H. Hanani, N. Sauer, and J. Schonheim, eds.) Gordon and Breach, New York (1970), 355-360. [219] V. Iladl, On the universality of graphs with uniformly distributed edges, Discrete Math. 59 (1986), 125-134. [220J P. Sarnak, Determinants of Laplacians, Comm. Mar.h. Phys. 110 (1987),113-120. [221] A. Schrijver, A comparison of the Delsarte and Lovasz bounds, IEEE 1'ransactions on Information Theory IT-25, (1979),425-429. [222J J.J. Seidel, Graphs and their spectra, Combinatorics and Graph Theory, PWN-Polish Sci- entific Publishers, Warsaw (1989), 147-162. [223] R. Seidel, On the all-pairs-shortest-path problem, Proc. Sym. Theo. on Computing, ACM (1992), 745-749. (224) M. Simonovits and v:r. Sos, Szemeredi partitions and quasi-randomness, Random Struc- tures and Algorithms 2 (1991), 1-10. [225] A.J. Sinclair, Algorithms for Random Generation and Counting, Birkhauser, Boston, 1993. [226J A.J. Sinclair and M.R. Jerrum, Approximate counting, uniform generation, and rapidly mixing markov chains, Information and Computation 82 (1989), 93-133. [227] R. Singleton, On minimal graphs of maximum even girth, J. Combin. Theory 1 (1966), 306-332. [228) J. Spencer, Optimal ranking of tournaments, Networks 1 (1971), 135-138. [229] .I. Spencer, Ramsey's theorem - A new lower bound, J. Combinatorial Theory 18 (1975), 108-115. [2:JO] S. St.ernlH'rg, Gmup The",'y in Physics, Cambridge University Press (1992). [231] n.w. Stroock, Logarithmic Sobolev inequalities for Gibbs states, Springer Lecture Notes 1563, Berlin, (1993). [232] J. J. Sylvester, On the change of systems of independent variables, Quarterly Journal of Mathematics 1 (1857), 42-56. Collected Mathematical Papers, Cambridge 2 (1908), 65-85. [233] R.M. Tanner, Explicit construction of concentrators from generalized N-gons, SIAM J. Al- gebraic Discrete Methods 5 (1984), 287-294. [231] A. Thomason, Random graphs, strongly regular graphs and pseudo-random graphs, in Sur- vey in Combinatorics (1987) (C. Whitehead, ed.), London Math. Soc. [235J A. Thomason, Pseudo-random graphs, Proc. Random Graphs, Poznan (1985) (M. Karonski, ed.), Annals of Discrete Math. 33 (1987), 307-331. [236] A. Thomason, Dense expanders and pseudo-random bipartite graphs, Discrete Math. 75 (1989),381-386. [237] M. Tompa, Time space tradeoITs for computing using connectivity properties of the circuits, J. Comput. System Sci. 10 (1980), 118-132. [238J H.M. Trent, Note on the enumeration and listing of all possible trees in a connected linear graph, Proceedings of the National Academy of Sciences, U.S.A. 40 (1954), 1004-1007. [239] W.T. Tutte, Graph Theory, Addison Wesley, Reading, MA 1984. [210J G.E. Uhlenbeck and G.W. Ford, Lectures in Statistical Mechanics, Providence, American Mathematical Society (1963) [21 I] L. G. Valiant, The complexity of comput.ing the permanent, Theoret. Comput. Sci. 8 (1979), 189-201. [212] L.G. Valiant, Graph theoretic propert.ies in computational complexity, J. Comput. System Sci. 13 (1976), 278-285. [243] L.G. Valiant, A scheme for fast parallel communication, SIAM J. Comput. 11 (1982), 350- 361. [241] N.T. Varopoulos, Isoperimetric inequalities and Markov chains, J. Funct. Anal. 63 (1985), 215-239. [215J K. Vijayan and U .S.Il. Murty, On accessibility in graphs, Sankhya Ser. A. 26 (1964), 299- :102. [246]8O70ang and P. Wang, Discrete isoperimetric problems, SIAM J. Appl. Math. 32 (1977), [247] A. Weil, Sur les courbes algebrique et les varietes qui s'en deduisent Actu r t  S . I d No. 1041 (1948). ' a I oS CI. n. [248] H. S. WiIf, The eigenvalues of a graph and its chromatic number J. Londo M t h S 42 (1967), 330-332. ' n a . oc. [249] R. M. Wilson, Constructions and uses of pairwise balanced designs in Combinatorics (M Hall, Jr:, and. J,H. van. Lint: eds.) Math Centre Tracts 55, Amsterdam (1974), 18-41. . [250J A. WeIss, GIrths of bIpartIte sextet graphs, Combinatorica 4 (1984), 241-245. [251] S.:. Yau an RIchard M. choen, Differential Geometry, Science Publications, Beijing, 1988 (Chmese versIOn); InternatIOnal Press, Cambridge, Massachusetts, 1991 (English version). 
(11';p)-norm, 181 L 2 -norm, 15 x-squared distance, 18 k-access graph, 98 n-cube, 19, 36 p-norm, 40 abelian group, 136 adjacency matrix, 3 adjacent, 3 all distances algorithm, 42 all shortest paths algorithm, 42 almost regular, 78 aperiodicity, 14 automorphism, 19 automorphism group, 110 bipartite, 6, 7 bipartite expander graph, 92 bipartite graph, 92 bond, 118 boundary conditions, 175 boundary expansion property, 137 boundary operator, 3 Buckyball, 118 Buckyball graph, 109 cartesian product, 36, G2 Cayley graph", 1 J 0 chain, 3 Chebyshev polynomial, 44 Cheeger constant, 24, 25, 56, 89, 111 characterization, 32 modified, 34, 35 weighted graphs, 35 Cheeger inequality, 26 chromatic number, 103 Index Chebyshev polynomial, 42 clique, 77, 87, 105 clique number, 105 co-NP-complete, 90 coboundary operator, 3 comparison theorems, 64 complete graph, 5 concentrator, 89 conductance, 90 connected, 6, 7, 24 consistent, 35 contingency table problem, 156 contraction, 12 convex subgraph, 137, 150 coset graph, 94 cycle, 6 degree, 2 deviation, 78 diameter, 7, 41, 102 diameter algorithm, 42 diameter-eigenvalue inequalities, 42 Dirichlet boundary condition, 123, 147, 190 Dirichlet eigenvalues, 123, 128-130, 132, 150 Dirichlet sum, 4 di"crepancy, 71,74,82 distancf', 7, 43 dist.ance tral1Ritivc, 109, 11 <1, 11 () edge boundary, 123 edge expansion, 25 edge generating set, 110, 151 edge transitive, 112 edge boundary, 24 edge-cut, 23 edge-transitive, 110 eigenfunction, 4 
206 harmonic, 4 eigenvalue, 4 entropy function, 101 ergodic, 13 expander coefficient, 89 expander graph, 87-89 expansion factor, 89 explicit construction, 87, 93 flow, 55 Fourier coefficients, 43 girth, 103 graph, 2 weighted undirected, II group representation theory, 117 Hamiltonian path, 55 Hamming balls, 36 Harnack inequality, 135, 138 heat equation, 145 heat kernel, 145 heat kernel eigenvalue inequality, 148 homogenous graphs, 119 Hooke's law, 120 hypercube, 36, 195 independent set, 77 induced subgraph, 123 inner product, 4 intersection graph, 117 invariant, 136 irreducibility, 14 isoperimetric dimension, 163, 179 isoperimptric inequalities, 165 isoperimetric number, 34, 90 isotropy group, 110 Laplace operator, 48, 50, 153 Laplace-Beltrami operator, 4 Laplacian, 2 determinant of , 131 lattice graphs, 151 lazy walk, 15, 17,177 log-Sobolev constant, 177, 183 with Dirichlet boundary condition, 179 with Neumann boundary condition, 179 logarithmic Harnack inequalities, 178 logarithmic Sobolev inequalities, 21, 180 1001',2 rnajor access network, 98 Margulis graph, 95 matching, 99, 102 matrix multiplication, 42 matrix-tree theorem, 129 measure, 4, 24 modprate growth rate, 165 Moore bound, !OI INDEX neighborhood, 70, 89, 90 Neumann boundary condition, 123, 146, 190 Neumann eigenvalues, 123, 126, 150 non-blocking network, 98 normal, 87 NP, 108 NP-complete, 55 stationary distribution, 13 strongly convex subgraph, 136, 190 support, 48 symmetric group, 60 total variation distance, 18 trace, 9 transpose, 3, 17 transposition, 60 odd-even transposition sort, 61 orthonormal labeling, 106 pairing, 63 Paley graph, 77, 93 Paley sum graph, 94 partition function, 131 path, 6 perfect graph, 105 Petersen graph, 117 Plancherel formula, 19 Poincare inequalities, 64 polynomial growth rate, 165 probabilistic method, 87 projection, 145 vertex boundary, 24, 123 vertex expansion, 24 vertex transitive, 109, 110, 113 vertex weight, 4 vertex-cut, 23 vertex-transitive, 110 vertex-transitive graph, 19 vibrational Laplacian, 119 vibrational spectrum, 119 volume, 5 Voronoi region, 154 quasi-random, 69 quaternion group, 97 walk, 13 weight function, 35 weighted cartesian product, 180 weighted graph, 161, 175 Raman spectrum, 121 Ramanujan graph, 42, 96, 103 Ramsey property, 76 random graph, 107 random walk, 13, 58 cartesian product of graphs, 37 ergodic, 13 irreducible, 14 modified, 15 Neumann, 126 reversi ble, 14 Rayleigh quotient, 4 regular, 3 relative pointwise distance 16 161, 177 Riernannian manifold, 4 ' , rooted spanning forest, 129, 132 route covering number, 63 route set, 55 routing, 55 complete bipartite graph, 61 complete graph, 61 hypercube, 61,63 tree, 61 rout.ing assignment, 60 routing nurnber, 60 separator, 23 size, 23 Sobolev constant, 163, 164 Sobolev inequalities, 163 spanning tree, 129 spectrurn, 4 star, 6 INDEX 207