5 \chapter{Minimum Spanning Trees}
9 The problem of finding a minimum spanning tree of a weighted graph is one of the
10 best studied problems in the area of combinatorial optimization since its birth.
11 Its colorful history (see \cite{graham:msthistory} and \cite{nesetril:history} for the full account)
12 begins in~1926 with the pioneering work of Bor\o{u}vka
13 \cite{boruvka:ojistem}\foot{See \cite{nesetril:boruvka} for an English translation with commentary.},
14 who studied primarily an Euclidean version of the problem related to planning
15 of electrical transmission lines (see \cite{boruvka:networks}), but gave an efficient
16 algorithm for the general version of the problem. As it was well before the dawn of graph
17 theory, the language of his paper was complicated, so we will better state the problem
18 in contemporary terminology:
20 \proclaim{Problem}Given an undirected graph~$G$ with weights $w:E(G)\rightarrow {\bb R}$,
21 find its minimum spanning tree, defined as follows:
24 For a given graph~$G$ with weights $w:E(G)\rightarrow {\bb R}$:
26 \:A~subgraph $H\subseteq G$ is called a \df{spanning subgraph} if $V(H)=V(G)$.
27 \:A~\df{spanning tree} of $G$ is any its spanning subgraph which is a tree.
28 \:For any subgraph $H\subseteq G$ we define its \df{weight} $w(H):=\sum_{e\in E(H)} w(e)$.
29 When comparing two weights, we will use the terms \df{lighter} and \df{heavier} in the
31 \:A~\df{minimum spanning tree (MST)} of~$G$ is a spanning tree~$T$ such that its weight $w(T)$
32 is the smallest possible of all the spanning trees of~$G$.
33 \:For a disconnected graph, a \df{(minimum) spanning forest (MSF)} is defined as
34 a union of (minimum) spanning trees of its connected components.
37 Bor\o{u}vka's work was further extended by Jarn\'\i{}k \cite{jarnik:ojistem}, again in
38 mostly geometric setting, giving another efficient algorithm. However, when
39 computer science and graph theory started forming in the 1950's and the
40 spanning tree problem was one of the central topics of the flourishing new
41 disciplines, the previous work was not well known and the algorithms had to be
42 rediscovered several times.
44 Recently, several significantly faster algorithms were discovered, most notably the
45 $\O(m\timesbeta(m,n))$-time algorithm by Fredman and Tarjan \cite{ft:fibonacci} and
46 algorithms with inverse-Ackermann type complexity by Chazelle \cite{chazelle:ackermann}
47 and Pettie \cite{pettie:ackermann}.
49 \FIXME{Write the rest of the history.}
51 This chapter attempts to survery the important algorithms for finding the MST and it
52 also presents several new ones.
54 %--------------------------------------------------------------------------------
56 \section{Basic properties}
58 In this section, we will examine the basic properties of spanning trees and prove
59 several important theorems to base the algorithms upon. We will follow the theory
60 developed by Tarjan in~\cite{tarjan:dsna}.
62 For the whole section, we will fix a graph~$G$ with edge weights~$w$ and all
63 other graphs will be spanning subgraphs of~$G$. We will use the same notation
64 for the subgraphs as for the corresponding sets of edges.
66 First of all, let us show that the weights on edges are not necessary for the
67 definition of the MST. We can formulate an equivalent characterization using
68 an ordering of edges instead.
70 \defnn{Heavy and light edges}\id{heavy}%
71 Let~$T$ be a~spanning tree. Then:
73 \:For vertices $x$ and $y$, let $T[x,y]$ denote the (unique) path in~$T$ joining $x$ and~$y$.
74 \:For an edge $e=xy$ we will call $T[e]:=T[x,y]$ the \df{path covered by~$e$} and
75 the edges of this path \df{edges covered by~$e$}.
76 \:An edge~$e$ is called \df{light with respect to~$T$} (or just \df{$T$-light}) if it covers a heavier edge, i.e., if there
77 is an edge $f\in T[e]$ such that $w(f) > w(e)$.
78 \:An edge~$e$ is called \df{$T$-heavy} if it is not $T$-light.
82 Please note that the above properties also apply to tree edges
83 which by definition cover only themselves and therefore they are always heavy.
85 \lemman{Light edges}\id{lightlemma}%
86 Let $T$ be a spanning tree. If there exists a $T$-light edge, then~$T$
90 If there is a $T$-light edge~$e$, then there exists an edge $e'\in T[e]$ such
91 that $w(e')>w(e)$. Now $T-e'$ is a forest of two trees with endpoints of~$e$
92 located in different components, so adding $e$ to this forest must restore
93 connectivity and $T':=T-e'+e$ is another spanning tree with weight $w(T')
94 = w(T)-w(e')+w(e) < w(T)$. Hence $T$ could not have been minimum.
97 \figure{mst2.eps}{278pt}{An edge exchange as in the proof of Lemma~\ref{lightlemma}}
99 The converse of this lemma is also true and to prove it, we will once again use
100 technique of transforming trees by \df{exchanges} of edges. In the proof of the
101 lemma, we have made use of the fact that whenever we exchange an edge~$e$ of
102 a spanning tree for another edge~$f$ covered by~$e$, the result is again
103 a spanning tree. In fact, it is possible to transform any spanning tree
104 to any other spanning tree by a sequence of exchanges.
106 \lemman{Exchange property for trees}\id{xchglemma}%
107 Let $T$ and $T'$ be spanning trees of a common graph. Then there exists
108 a sequence of edge exchanges which transforms $T$ to~$T'$. More formally,
109 there exists a sequence of spanning trees $T=T_0,T_1,\ldots,T_k=T'$ such that
110 $T_{i+1}=T_i - e_i + e_i^\prime$ where $e_i\in T_i$ and $e_i^\prime\in T'$.
113 By induction on $d(T,T'):=\vert T\symdiff T'\vert$. When $d(T,T')=0$,
114 both trees are identical and no exchanges are needed. Otherwise, the trees are different,
115 but as they are of the same size, there must exist an edge $e'\in T'\setminus T$.
116 The cycle $T[e']+e'$ cannot be wholly contained in~$T'$, so there also must
117 exist an edge $e\in T[e']\setminus T'$. Exchanging $e$ for~$e'$ yields a spanning
118 tree $T^*:=T-e+e'$ such that $d(T^*,T')=d(T,T')-2$ and we can apply the induction
119 hypothesis to $T^*$ and $T'$ to get the rest of the exchange sequence.
122 \figure{mst1.eps}{295pt}{One step of the proof of Lemma~\ref{xchglemma}}
124 \lemman{Monotone exchanges}\id{monoxchg}%
125 Let $T$ be a spanning tree such that there are no $T$-light edges and $T'$
126 be an arbitrary spanning tree. Then there exists a sequence of edge exchanges
127 transforming $T$ to~$T'$ such that the weight does not increase in any step.
130 We improve the argument from the previous proof, refining the induction step.
131 When we exchange $e\in T$ for $e'\in T'\setminus T$ such that $e\in T[e']$,
132 the weight never drops, since $e'$ is not a $T$-light edge and therefore
133 $w(e') \ge w(e)$, so $w(T^*)=w(T)-w(e)+w(e')\ge w(T)$.
135 To keep the induction going, we have to make sure that there are still no light
136 edges with respect to~$T^*$. In fact, it is enough to avoid such edges in
137 $T'\setminus T^*$, since these are the only edges considered by the induction
138 steps. To accomplish that, we replace the so far arbitrary choice of $e'\in T'\setminus T$
139 by picking the lightest such edge.
141 Now consider an edge $f\in T'\setminus T^*$. We want to show that $f$ is not
142 $T^*$-light, i.e., that it is heavier than all edges on $T^*[f]$. The path $T^*[f]$ is
143 either equal to the original path $T[f]$ (if $e\not\in T[f]$) or to $T[f] \symdiff C$,
144 where $C$ is the cycle $T[e']+e'$. The former case is trivial, in the latter one
145 $w(f)\ge w(e')$ due to the choice of $e'$ and all other edges on~$C$ are lighter
146 than~$e'$ as $e'$ was not $T$-light.
149 \thmn{Minimality by order}\id{mstthm}%
150 A~spanning tree~$T$ is minimum iff there is no $T$-light edge.
153 If~$T$ is minimum, then by Lemma~\ref{lightlemma} there are no $T$-light
155 Conversely, when $T$ is a spanning tree without $T$-light edges
156 and $T_{min}$ is an arbitrary minimum spanning tree, then according to the Monotone
157 exchange lemma (\ref{monoxchg}) there exists a non-decreasing sequence
158 of exchanges transforming $T$ to $T_{min}$, so $w(T)\le w(T_{min})$
159 and thus $T$~is also minimum.
162 In general, a single graph can have many minimum spanning trees (for example
163 a complete graph on~$n$ vertices and unit edge weights has $n^{n-2}$
164 minimum spanning trees according to the Cayley's formula \cite{cayley:trees}).
165 However, as the following theorem shows, this is possible only if the weight
166 function is not injective.
168 \thmn{MST uniqueness}%
169 If all edge weights are distinct, then the minimum spanning tree is unique.
172 Consider two minimum spanning trees $T_1$ and~$T_2$. According to the previous
173 theorem, there are no light edges with respect to neither of them, so by the
174 Monotone exchange lemma (\ref{monoxchg}) there exists a sequence of non-decreasing
175 edge exchanges going from $T_1$ to $T_2$. As all edge weights all distinct,
176 these edge exchanges must be in fact strictly increasing. On the other hand,
177 we know that $w(T_1)=w(T_2)$, so the exchange sequence must be empty and indeed
178 $T_1$ and $T_2$ must be identical.
182 To simplify the description of MST algorithms, we will expect that the weights
183 of all edges are distinct and that instead of numeric weights (usually accompanied
184 by problems with representation of real numbers in algorithms) we will be given
185 a comparison oracle, that is a function which answers questions ``$w(e)<w(f)$?'' in
186 constant time. In case the weights are not distinct, we can easily break ties by
187 comparing some unique edge identifiers and according to our characterization of
188 minimum spanning trees, the unique MST of the new graph will still be a MST of the
189 original graph. In the few cases where we need a more concrete input, we will
193 When $G$ is a graph with distinct edge weights, we will use $\mst(G)$ to denote
194 its unique minimum spanning tree.
196 Another useful consequence is that whenever two graphs are isomorphic and the
197 isomorphism preserves weight order, the isomorphism applies to their MST's
201 A~\df{monotone isomorphism} of two weighted graphs $G_1=(V_1,E_1,w_1)$ and
202 $G_2=(V_2,E_2,w_2)$ is a bijection $\pi: V_1\rightarrow V_2$ such that
203 for each $u,v\in V_1: uv\in E_1 \Leftrightarrow \pi(u)\pi(v)\in E_2$ and
204 for each $e,f\in E_1: w_1(e)<w_1(f) \Leftrightarrow w_2(\pi[e]) < w_2(\pi[f])$.
206 \lemman{MST of isomorphic graphs}\id{mstiso}%
207 Let~$G_1$ and $G_2$ be two weighted graphs with unique edge weights and $\pi$
208 their monotone isomorphism. Then $\mst(G_2) = \pi[\mst(G_1)]$.
211 The isomorphism~$\pi$ maps spanning trees onto spanning trees and it preserves
212 the relation of covering. Since it is monotone, it preserves the property of
213 being a light edge (an~edge $e\in E(G_1)$ is $T$-light $\Leftrightarrow$
214 the edge $\pi[e]\in E(G_2)$ is~$f[T]$-light). Therefore by Theorem~\ref{mstthm}, $T$
215 is the MST of~$G_1$ if and only if $\pi[T]$ is the MST of~$G_2$.
218 %--------------------------------------------------------------------------------
220 \section{The Red-Blue meta-algorithm}
222 Most MST algorithms can be described as special cases of the following procedure
223 (again following \cite{tarjan:dsna}):
225 \algn{Red-Blue Meta-Algorithm}\id{rbma}%
227 \algin A~graph $G$ with an edge comparison oracle (see \ref{edgeoracle})
228 \:In the beginning, all edges are colored black.
229 \:Apply rules as long as possible:
230 \::Either pick a cut~$C$ such that its lightest edge is not blue \hfil\break and color this edge blue, \cmt{Blue rule}
231 \::Or pick a cycle~$C$ such that its heaviest edge is not red \hfil\break and color this edge \hphantas{red.}{blue.} \cmt{Red rule}
232 \algout Minimum spanning tree of~$G$ consisting of edges colored blue.
236 This procedure is not a proper algorithm, since it does not specify how to choose
237 the rule to apply. We will however prove that no matter how the rules are applied,
238 the procedure always stops and gives the correct result. Also, it will turn out
239 that each of the classical MST algorithms can be described as a specific way
240 of choosing the rules in this procedure, which justifies the name meta-algorithm.
243 We will denote the unique minimum spanning tree of the input graph by~$T_{min}$.
244 We intend to prove that this is also the output of the procedure.
247 When an edge is colored blue in any step of the procedure, it is contained in the minimum spanning tree.
250 By contradiction. Let $e$ be an edge painted blue as the lightest edge of a cut~$C$.
251 If $e\not\in T_{min}$, then there must exist an edge $e'\in T_{min}$ which is
252 contained in~$C$ (take any pair of vertices separated by~$C$, the path
253 in~$T_{min}$ joining these vertices must cross~$C$ at least once). Exchanging
254 $e$ for $e'$ in $T_{min}$ yields an even lighter spanning tree since
258 When an edge is colored red in any step of the procedure, it is not contained in the minimum spanning tree.
261 Again by contradiction. Suppose that $e$ is an edge painted red as the heaviest edge
262 of a cycle~$C$ and that $e\in T_{min}$. Removing $e$ causes $T_{min}$ to split to two
263 components, let us call them $T_x$ and $T_y$. Some vertices of~$C$ now lie in $T_x$,
264 the others in $T_y$, so there must exist in edge $e'\ne e$ such that its endpoints
265 lie in different components. Since $w(e')<w(e)$, exchanging $e$ for~$e'$ yields
266 a lighter spanning tree than $T_{min}$.
269 \figure{mst-rb.eps}{289pt}{Proof of the Blue (left) and Red (right) lemma}
271 \lemman{Black lemma}%
272 As long as there exists a black edge, at least one rule can be applied.
275 Assume that $e=xy$ be a black edge. Let us denote $M$ the set of vertices
276 reachable from~$x$ using only blue edges. If $y$~lies in~$M$, then $e$ together
277 with some blue path between $x$ and $y$ forms a cycle and it must be the heaviest
278 edge on this cycle. This holds because all blue edges have been already proven
279 to be in $T_{min}$ and there can be no $T_{min}$-light edges (see Theorem~\ref{mstthm}).
280 In this case we can apply the red rule.
282 On the other hand, if $y\not\in M$, then the cut formed by all edges between $M$
283 and $V(G)\setminus M$ contains no blue edges, therefore we can use the blue rule.
286 \figure{mst-bez.eps}{295pt}{Configurations in the proof of the Black lemma}
288 \thmn{Red-Blue correctness}%
289 For any selection of rules, the Red-Blue procedure stops and the blue edges form
290 the minimum spanning tree of the input graph.
293 To prove that the procedure stops, let us notice that no edge is ever recolored,
294 so we must run out of black edges after at most~$m$ steps. Recoloring
295 to the same color is avoided by the conditions built in the rules, recoloring to
296 a different color would mean that the an edge would be both inside and outside~$T_{min}$
297 due to our Red and Blue lemmata.
299 When no further rules can be applied, the Black lemma guarantees that all edges
300 are colored, so by the Blue lemma all blue edges are in~$T_{min}$ and by the Red
301 lemma all other (red) edges are outside~$T_{min}$, so the blue edges are exactly~$T_{min}$.
304 %--------------------------------------------------------------------------------
306 \section{Classical algorithms}
308 The three classical MST algorithms can be easily stated in terms of the Red-Blue meta-algorithm.
309 For each of them, we first show the general version of the algorithm, then we prove that
310 it gives the correct result and finally we discuss the time complexity of various
313 \algn{Bor\o{u}vka \cite{boruvka:ojistem}, Choquet \cite{choquet:mst}, Sollin \cite{sollin:mst} and others}
315 \algin A~graph~$G$ with an edge comparison oracle.
316 \:$T\=$ a forest consisting of vertices of~$G$ and no edges.
317 \:While $T$ is not connected:
318 \::For each component $T_i$ of~$T$, choose the lightest edge $e_i$ from the cut
319 separating $T_i$ from the rest of~$T$.
320 \::Add all $e_i$'s to~$T$.
321 \algout Minimum spanning tree~$T$.
324 \lemma\id{boruvkadrop}%
325 In each iteration of the algorithm, the number of trees in~$T$ drops at least twice.
328 Each tree gets merged with at least one of its neighbors, so each of the new trees
329 contains two or more original trees.
333 The algorithm stops in $\O(\log n)$ iterations.
336 Bor\o{u}vka's algorithm outputs the MST of the input graph.
339 In every iteration of the algorithm, $T$ is a blue subgraph,
340 because every addition of some edge~$e_i$ to~$T$ is a straightforward
341 application of the Blue rule. We stop when the blue subgraph is connected, so
342 we do not need the Red rule to explicitly exclude edges.
344 It remains to show that adding the edges simultaneously does not
345 produce a cycle. Consider the first iteration of the algorithm where $T$ contains a~cycle~$C$. Without
346 loss of generality we can assume that $C=T_1[u_1v_1]\,v_1u_2\,T_2[u_2v_2]\,v_2u_3\,T_3[u_3v_3]\, \ldots \,T_k[u_kv_k]\,v_ku_1$.
347 Each component $T_i$ has chosen its lightest incident edge~$e_i$ as either the edge $v_iu_{i+1}$
348 or $v_{i-1}u_i$ (indexing cyclically). Suppose that $e_1=v_1u_2$ (otherwise we reverse the orientation
349 of the cycle). Then $e_2=v_2u_3$ and $w(e_2)<w(e_1)$ and we can continue in the same way,
350 getting $w(e_1)>w(e_2)>\ldots>w(e_k)>w(e_1)$, which is a contradiction.
351 (Note that distinctness of edge weights was crucial here.)
354 \lemma\id{boruvkaiter}%
355 Each iteration can be carried out in time $\O(m)$.
358 We assign a label to each tree and we keep a mapping from vertices to the
359 labels of the trees they belong to. We scan all edges, map their endpoints
360 to the particular trees and for each tree we maintain the lightest incident edge
361 so far encountered. Instead of merging the trees one by one (which would be too
362 slow), we build an auxilliary graph whose vertices are the labels of the original
363 trees and edges correspond to the chosen lightest inter-tree edges. We find connected
364 components of this graph, these determine how are the original labels translated
369 Bor\o{u}vka's algorithm finds the MST in time $\O(m\log n)$.
372 Follows from the previous lemmata.
375 \algn{Jarn\'\i{}k \cite{jarnik:ojistem}, Prim \cite{prim:mst}, Dijkstra \cite{dijkstra:mst}}\id{jarnik}%
377 \algin A~graph~$G$ with an edge comparison oracle.
378 \:$T\=$ a single-vertex tree containing an~arbitrary vertex of~$G$.
379 \:While there are vertices outside $T$:
380 \::Pick the lightest edge $uv$ such that $u\in V(T)$ and $v\not\in V(T)$.
382 \algout Minimum spanning tree~$T$.
386 Jarn\'\i{}k's algorithm computers the MST of the input graph.
389 If~$G$ is connected, the algorithm always stops. Let us prove that in every step of
390 the algorithm, $T$ is always a blue tree. Step~4 corresponds to applying
391 the Blue rule to the cut $\delta(T)$ separating~$T$ from the rest of the given graph. We need not care about
392 the remaining edges, since for a connected graph the algorithm always stops with the right
393 number of blue edges.
397 The most important part of the algorithm is finding \em{neighboring edges,} i.e., edges
398 of the cut $\delta(T)$. In a~straightforward implementation,
399 searching for the lightest neighboring edge takes $\Theta(m)$ time, so the whole
400 algorithm runs in time $\Theta(mn)$.
402 We can do much better by using a binary
403 heap to hold all neighboring edges. In each iteration, we find and delete the
404 minimum edge from the heap and once we expand the tree, we insert the newly discovered
405 neighboring edges to the heap while deleting the neighboring edges which become
406 internal to the new tree. Since there are always at most~$m$ edges in the heap,
407 each heap operation takes $\O(\log m)=\O(\log n)$ time. For every edge, we perform
408 at most one insertion and at most one deletion, so we spend $\O(m\log n)$ time in total.
409 From this, we can conclude:
412 Jarn\'\i{}k's algorithm finds the MST of a~given graph in time $\O(m\log n)$.
415 We will show several faster implementations in section \ref{fibonacci}.
417 \algn{Kruskal \cite{kruskal:mst}, the Greedy algorithm}
419 \algin A~graph~$G$ with an edge comparison oracle.
420 \:Sort edges of~$G$ by their increasing weight.
421 \:$T\=\emptyset$. \cmt{an empty spanning subgraph}
422 \:For all edges $e$ in their sorted order:
423 \::If $T+e$ is acyclic, add~$e$ to~$T$.
424 \::Otherwise drop~$e$.
425 \algout Minimum spanning tree~$T$.
429 Kruskal's algorithm returns the MST of the input graph.
432 In every step, $T$ is a forest of blue trees. Adding~$e$ to~$T$
433 in step~4 applies the Blue rule on the cut separating some pair of components of~$T$ ($e$ is the lightest,
434 because all other edges of the cut have not been considered yet). Dropping~$e$ in step~5 corresponds
435 to the Red rule on the cycle found ($e$~must be the heaviest, since all other edges of the
436 cycle have been already processed). At the end of the algorithm, all edges are colored,
437 so~$T$ must be the~MST.
441 Except for the initial sorting, which in general takes $\Theta(m\log m)$ time, the only
442 other non-trivial operation is the detection of cycles. What we need is a data structure
443 for maintaining connected components, which supports queries and edge insertion.
444 (This is also known under the name Disjoint Set Union problem, i.e., maintenance
445 of an~equivalence relation on a~set with queries on whether two elements are equivalent
446 and the operation of joining two equivalence classes into one.)
447 The following theorem shows that it can be done with surprising efficiency.
449 \thmn{Incremental connectivity}%
450 When only edge insertions and connectivity queries are allowed, connected components
451 can be maintained in $\O(\alpha(n))$ time amortized per operation.
454 Proven by Tarjan and van Leeuwen in \cite{tarjan:setunion}.
457 \FIXME{Define Ackermann's function. Use $\alpha(m,n)$?}
460 The cost of the operations on components is of course dwarfed by the complexity
461 of sorting, so a much simpler (at least in terms of its analysis) data
462 structure would be sufficient, as long as it has $\O(\log n)$ amortized complexity
463 per operation. For example, we can label vertices with identifiers of the
464 corresponding components and always recolor the smaller of the two components.
467 Kruskal's algorithm finds the MST of a given graph in time $\O(m\log n)$
468 or $\O(m\timesalpha(n))$ if the edges are already sorted by their weights.
471 Follows from the above analysis.
474 %--------------------------------------------------------------------------------
476 \section{Contractive algorithms}\id{contalg}%
478 While the classical algorithms are based on growing suitable trees, they
479 can be also reformulated in terms of edge contraction. Instead of keeping
480 a forest of trees, we can keep each tree contracted to a single vertex.
481 This replaces the relatively complex tree-edge incidencies by simple
482 vertex-edge incidencies, potentially speeding up the calculation at the
483 expense of having to perform the contractions.
485 We will show a contractive version of the Bor\o{u}vka's algorithm
486 in which these costs are carefully balanced, leading for example to
487 a linear-time algorithm for MST in planar graphs.
489 There are two definitions of edge contraction which differ when an edge of a
490 triangle is contracted. Either we unify the other two edges to a single edge
491 or we keep them as two parallel edges, leaving us with a~multigraph. We will
492 use the multigraph version and we will show that we can easily reduce the multigraph
493 to a simple graph later. (See \ref{contract} for the exact definitions.)
495 We only need to be able to map edges of the contracted graph to the original
496 edges, so each edge will carry a unique label $\ell(e)$ that will be preserved by
499 \lemman{Flattening a multigraph}\id{flattening}%
500 Let $G$ be a multigraph and $G'$ its subgraph such that all loops have been
501 removed and each bundle of parallel edges replaced by its lightest edge.
502 Then $G'$~has the same MST as~$G$.
505 Every spanning tree of~$G'$ is a spanning tree of~$G$. In the other direction:
506 Loops can be never contained in a spanning tree. If there is a spanning tree~$T$
507 containing a removed edge~$e$ parallel to an edge~$e'\in G'$, exchaning $e'$
508 for~$e$ makes~$T$ lighter. \qed
510 \rem Removal of the heavier of a pair of parallel edges can be also viewed
511 as an application of the Red rule on a two-edge cycle. And indeed it is, the
512 Red-Blue procedure works on multigraphs as well as on simple graphs and all the
513 classical algorithms also do. We would only have to be more careful in the
514 formulations and proofs, which we preferred to avoid.
516 \algn{Contractive version of Bor\o{u}vka's algorithm}\id{contbor}
518 \algin A~graph~$G$ with an edge comparison oracle.
520 \:$\ell(e)\=e$ for all edges~$e$. \cmt{Initialize the labels.}
522 \::For each vertex $v_i$ of~$G$, let $e_i$ be the lightest edge incident to~$v_i$.
523 \::$T\=T\cup \{ \ell(e_i) \}$. \cmt{Remember labels of all selected edges.}
524 \::Contract $G$ along all edges $e_i$, inheriting labels and weights.\foot{In other words, we ask the comparison oracle for the edge $\ell(e)$ instead of~$e$.}
525 \::Flatten $G$, removing parallel edges and loops.
526 \algout Minimum spanning tree~$T$.
530 Each iteration of the algorithm can be carried out in time~$\O(m)$.
533 The only non-trivial parts are steps 6 and~7. Contractions can be handled similarly
534 to the unions in the original Bor\o{u}vka's algorithm (see \ref{boruvkaiter}):
535 We build an auxillary graph containing only the selected edges~$e_i$, find
536 connected components of this graph and renumber vertices in each component to
537 the identifier of the component. This takes $\O(m)$ time.
539 Flattening is performed by first removing the loops and then bucket-sorting the edges
540 (as ordered pairs of vertex identifiers) lexicographically, which brings parallel
541 edges together. The bucket sort uses two passes with $n$~buckets, so it takes
546 The Contractive Bor\o{u}vka's algorithm finds the MST in time $\O(m\log n)$.
549 As in the original Bor\o{u}vka's algorithm, the number of iterations is $\O(\log n)$.
550 Then apply the previous lemma.
553 \thmn{\cite{mm:mst}}\id{planarbor}%
554 When the input graph is planar, the Contractive Bor\o{u}vka's algorithm runs in
558 Let us denote the graph considered by the algorithm at the beginning of the $i$-th
559 iteration by $G_i$ (starting with $G_0=G$) and its number of vertices and edges
560 by $n_i$ and $m_i$ respectively. As we already know from the previous lemma,
561 the $i$-th iteration takes $\O(m_i)$ time. We are going to prove that the
562 $m_i$'s are decreasing geometrically.
564 The number of trees in the non-contracting version of the algorithm drops
565 at least by a factor of two in each iteration (Lemma \ref{boruvkadrop}) and the
566 same must hold for the number of vertices in the contracting version.
567 Therefore $n_i\le n/2^i$.
569 However, every $G_i$ is planar, because the class of planar graphs is closed
570 under edge deletion and contraction. The~$G_i$ is also simple as we explicitly removed multiple edges and
571 loops at the end of the previous iteration. Hence we can use the standard theorem on
572 the number of edges of planar simple graphs (see for example \cite{diestel:gt}) to get $m_i\le 3n_i \le 3n/2^i$.
573 From this we get that the total time complexity is $\O(\sum_i m_i)=\O(\sum_i n/2^i)=\O(n)$.
577 There are several other possibilities how to find the MST of a planar graph in linear time.
578 For example, Matsui \cite{matsui:planar} has described an algorithm based on simultaneously
579 working on the graph and its topological dual. The advantage of our approach is that we do not need
580 to construct the planar embedding explicitly. We will show one more linear algorithm
581 in section~\ref{minorclosed}.
584 To achieve the linear time complexity, the algorithm needs a very careful implementation,
585 but we defer the technical details to section~\ref{bucketsort}.
588 Graph contractions are indeed a~very powerful tool and they can be used in other MST
589 algorithms as well. The following lemma shows the gist:
591 \lemman{Contraction of MST edges}\id{contlemma}%
592 Let $G$ be a weighted graph, $e$~an arbitrary edge of~$\mst(G)$, $G/e$ the multigraph
593 produced by contracting $G$ along~$e$, and $\pi$ the bijection between edges of~$G-e$ and
594 their counterparts in~$G/e$. Then: $$\mst(G) = \pi^{-1}[\mst(G/e)] + e.$$
597 % We seem not to need this lemma for multigraphs...
598 %If there are any loops or parallel edges in~$G$, we can flatten the graph. According to the
599 %Flattening lemma (\ref{flattening}), the MST stays the same and if we remove a parallel edge
600 %or loop~$f$, then $\pi(f)$ would be removed when flattening~$G/e$, so $f$ never participates
602 The right-hand side of the equality is a spanning tree of~$G$, let us denote it by~$T$ and
603 the MST of $G/e$ by~$T'$. If $T$ were not minimum, there would exist a $T$-light edge~$f$ in~$G$
604 (by Theorem \ref{mstthm}). If the path $T[f]$ covered by~$f$ does not contain~$e$,
605 then $\pi[T[f]]$ is a path covered by~$\pi(f)$ in~$T'$. Otherwise $\pi(T[f]-e)$ is such a path.
606 In both cases, $f$ is $T'$-light, which contradicts the minimality of~$T'$. (We do not have
607 a~multigraph version of the theorem, but the side we need is a~straightforward edge exchange,
608 which obviously works in multigraphs as well.)
612 In the previous algorithm, the role of the mapping~$\pi^{-1}$ is of course played by the edge labels~$\ell$.
614 Finally, we will show a family of graphs where the $\O(m\log n)$ bound on time complexity
615 is tight. The graphs do not have unique weights, but they are constructed in a way that
616 the algorithm never compares two edges with the same weight. Therefore, when two such
617 graphs are monotonely isomorphic (see~\ref{mstiso}), the algorithm processes them in the same way.
620 A~\df{distractor of order~$k$,} denoted by~$D_k$, is a path on $n=2^k$~vertices $v_1,\ldots,v_n$
621 where each edge $v_iv_{i+1}$ has its weight equal to the number of trailing zeroes in the binary
622 representation of the number~$i$. The vertex $v_1$ is called a~\df{base} of the distractor.
625 Alternatively, we can use a recursive definition: $D_0$ is a single vertex, $D_{k+1}$ consists
626 of two disjoint copies of~$D_k$ joined by an edge of weight~$k$.
628 \figure{distractor.eps}{\epsfxsize}{A~distractor $D_3$ and its evolution (bold edges are contracted)}
631 A~single iteration of the contractive algorithm reduces~$D_k$ to a graph isomorphic with~$D_{k-1}$.
634 Each vertex~$v$ of~$D_k$ is incident with a single edge of weight~1. The algorithm therefore
635 selects all weight~1 edges and contracts them. This produces a graph which is
636 exactly $D_{k-1}$ with all weights increased by~1, which does not change the relative order of edges.
640 A~\df{hedgehog}~$H_{a,k}$ is a graph consisting of $a$~distractors $D_k^1,\ldots,D_k^a$ of order~$k$
641 together with edges of a complete graph on the bases of the distractors. These additional edges
642 have arbitrary weights, but heavier than the edges of all distractors.
644 \figure{hedgehog.eps}{\epsfxsize}{A~hedgehog $H_{5,2}$ (quills bent to fit in the picture)}
647 A~single iteration of the contractive algorithm reduces~$H_{a,k}$ to a graph isomorphic with $H_{a,k-1}$.
650 Each vertex is incident with an edge of some distractor, so the algorithm does not select
651 any edge of the complete graph. Contraction therefore reduces each distractor to a smaller
652 distractor (modulo an additive factor in weight) and leaves the complete graph intact.
653 This is monotonely isomorphic to $H_{a,k-1}$.
656 \thmn{Lower bound for Contractive Bor\o{u}vka}%
657 For each $n$ there exists a graph on $\Theta(n)$ vertices and $\Theta(n)$ edges
658 such that the Contractive Bor\o{u}vka's algorithm spends time $\Omega(n\log n)$ on it.
661 Consider the hedgehog $H_{a,k}$ for $a=\lceil\sqrt n\rceil$ and $k=\lceil\log_2 a\rceil$.
662 It has $a\cdot 2^k = \Theta(n)$ vertices and ${a \choose 2} + a\cdot 2^k = \Theta(a^2) + \Theta(a^2) = \Theta(n)$ edges
665 By the previous lemma, the algorithm proceeds through a sequence of hedgehogs $H_{a,k},
666 H_{a,k-1}, \ldots, H_{a,0}$ (up to monotone isomorphism), so it needs a logarithmic number of iterations plus some more
667 to finish on the remaining complete graph. Each iteration runs on a graph with $\Omega(n)$
668 edges as every $H_{a,k}$ contains a complete graph on~$a$ vertices.