bad_roots.html 7.1 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128
  1. <html>
  2. <head>
  3. <meta http-equiv="Content-Type" content="text/html; charset=US-ASCII">
  4. <title>Examples Where Root Finding Goes Wrong</title>
  5. <link rel="stylesheet" href="../math.css" type="text/css">
  6. <meta name="generator" content="DocBook XSL Stylesheets V1.79.1">
  7. <link rel="home" href="../index.html" title="Math Toolkit 2.11.0">
  8. <link rel="up" href="../root_finding.html" title="Chapter&#160;10.&#160;Root Finding &amp; Minimization Algorithms">
  9. <link rel="prev" href="bad_guess.html" title="The Effect of a Poor Initial Guess">
  10. <link rel="next" href="brent_minima.html" title="Locating Function Minima using Brent's algorithm">
  11. </head>
  12. <body bgcolor="white" text="black" link="#0000FF" vlink="#840084" alink="#0000FF">
  13. <table cellpadding="2" width="100%"><tr>
  14. <td valign="top"><img alt="Boost C++ Libraries" width="277" height="86" src="../../../../../boost.png"></td>
  15. <td align="center"><a href="../../../../../index.html">Home</a></td>
  16. <td align="center"><a href="../../../../../libs/libraries.htm">Libraries</a></td>
  17. <td align="center"><a href="http://www.boost.org/users/people.html">People</a></td>
  18. <td align="center"><a href="http://www.boost.org/users/faq.html">FAQ</a></td>
  19. <td align="center"><a href="../../../../../more/index.htm">More</a></td>
  20. </tr></table>
  21. <hr>
  22. <div class="spirit-nav">
  23. <a accesskey="p" href="bad_guess.html"><img src="../../../../../doc/src/images/prev.png" alt="Prev"></a><a accesskey="u" href="../root_finding.html"><img src="../../../../../doc/src/images/up.png" alt="Up"></a><a accesskey="h" href="../index.html"><img src="../../../../../doc/src/images/home.png" alt="Home"></a><a accesskey="n" href="brent_minima.html"><img src="../../../../../doc/src/images/next.png" alt="Next"></a>
  24. </div>
  25. <div class="section">
  26. <div class="titlepage"><div><div><h2 class="title" style="clear: both">
  27. <a name="math_toolkit.bad_roots"></a><a class="link" href="bad_roots.html" title="Examples Where Root Finding Goes Wrong">Examples Where Root Finding Goes
  28. Wrong</a>
  29. </h2></div></div></div>
  30. <p>
  31. There are many reasons why root root finding can fail, here are just a few
  32. of the more common examples:
  33. </p>
  34. <h4>
  35. <a name="math_toolkit.bad_roots.h0"></a>
  36. <span class="phrase"><a name="math_toolkit.bad_roots.local_minima"></a></span><a class="link" href="bad_roots.html#math_toolkit.bad_roots.local_minima">Local
  37. Minima</a>
  38. </h4>
  39. <p>
  40. If you start in the wrong place, such as z<sub>0</sub> here:
  41. </p>
  42. <p>
  43. <span class="inlinemediaobject"><object type="image/svg+xml" data="../../roots/bad_root_1.svg" width="372" height="262"></object></span>
  44. </p>
  45. <p>
  46. Then almost any root-finding algorithm will descend into a local minima rather
  47. than find the root.
  48. </p>
  49. <h4>
  50. <a name="math_toolkit.bad_roots.h1"></a>
  51. <span class="phrase"><a name="math_toolkit.bad_roots.flatlining"></a></span><a class="link" href="bad_roots.html#math_toolkit.bad_roots.flatlining">Flatlining</a>
  52. </h4>
  53. <p>
  54. In this example, we're starting from a location (z<sub>0</sub>) where the first derivative
  55. is essentially zero:
  56. </p>
  57. <p>
  58. <span class="inlinemediaobject"><object type="image/svg+xml" data="../../roots/bad_root_2.svg" width="372" height="262"></object></span>
  59. </p>
  60. <p>
  61. In this situation the next iteration will shoot off to infinity (assuming we're
  62. using derivatives that is). Our code guards against this by insisting that
  63. the root is always bracketed, and then never stepping outside those bounds.
  64. In a case like this, no root finding algorithm can do better than bisecting
  65. until the root is found.
  66. </p>
  67. <p>
  68. Note that there is no scale on the graph, we have seen examples of this situation
  69. occur in practice <span class="emphasis"><em>even when several decimal places of the initial
  70. guess z<sub>0</sub> are correct.</em></span>
  71. </p>
  72. <p>
  73. This is really a special case of a more common situation where root finding
  74. with derivatives is <span class="emphasis"><em>divergent</em></span>. Consider starting at z<sub>0</sub> in
  75. this case:
  76. </p>
  77. <p>
  78. <span class="inlinemediaobject"><object type="image/svg+xml" data="../../roots/bad_root_4.svg" width="372" height="262"></object></span>
  79. </p>
  80. <p>
  81. An initial Newton step would take you further from the root than you started,
  82. as will all subsequent steps.
  83. </p>
  84. <h4>
  85. <a name="math_toolkit.bad_roots.h2"></a>
  86. <span class="phrase"><a name="math_toolkit.bad_roots.micro_stepping_non_convergence"></a></span><a class="link" href="bad_roots.html#math_toolkit.bad_roots.micro_stepping_non_convergence">Micro-stepping
  87. / Non-convergence</a>
  88. </h4>
  89. <p>
  90. Consider starting at z<sub>0</sub> in this situation:
  91. </p>
  92. <p>
  93. <span class="inlinemediaobject"><object type="image/svg+xml" data="../../roots/bad_root_3.svg" width="372" height="262"></object></span>
  94. </p>
  95. <p>
  96. The first derivative is essentially infinite, and the second close to zero
  97. (and so offers no correction if we use it), as a result we take a very small
  98. first step. In the worst case situation, the first step is so small - perhaps
  99. even so small that subtracting from z<sub>0</sub> has no effect at the current working
  100. precision - that our algorithm will assume we are at the root already and terminate.
  101. Otherwise we will take lot's of very small steps which never converge on the
  102. root: our algorithms will protect against that by reverting to bisection.
  103. </p>
  104. <p>
  105. An example of this situation would be trying to find the root of e<sup>-1/z<sup>2</sup></sup> - this
  106. function has a single root at <span class="emphasis"><em>z = 0</em></span>, but for <span class="emphasis"><em>z<sub>0</sub> &lt;
  107. 0</em></span> neither Newton nor Halley steps will ever converge on the root,
  108. and for <span class="emphasis"><em>z<sub>0</sub> &gt; 0</em></span> the steps are actually divergent.
  109. </p>
  110. </div>
  111. <table xmlns:rev="http://www.cs.rpi.edu/~gregod/boost/tools/doc/revision" width="100%"><tr>
  112. <td align="left"></td>
  113. <td align="right"><div class="copyright-footer">Copyright &#169; 2006-2019 Nikhar
  114. Agrawal, Anton Bikineev, Paul A. Bristow, Marco Guazzone, Christopher Kormanyos,
  115. Hubert Holin, Bruno Lalande, John Maddock, Jeremy Murphy, Matthew Pulver, Johan
  116. R&#229;de, Gautam Sewani, Benjamin Sobotta, Nicholas Thompson, Thijs van den Berg,
  117. Daryle Walker and Xiaogang Zhang<p>
  118. Distributed under the Boost Software License, Version 1.0. (See accompanying
  119. file LICENSE_1_0.txt or copy at <a href="http://www.boost.org/LICENSE_1_0.txt" target="_top">http://www.boost.org/LICENSE_1_0.txt</a>)
  120. </p>
  121. </div></td>
  122. </tr></table>
  123. <hr>
  124. <div class="spirit-nav">
  125. <a accesskey="p" href="bad_guess.html"><img src="../../../../../doc/src/images/prev.png" alt="Prev"></a><a accesskey="u" href="../root_finding.html"><img src="../../../../../doc/src/images/up.png" alt="Up"></a><a accesskey="h" href="../index.html"><img src="../../../../../doc/src/images/home.png" alt="Home"></a><a accesskey="n" href="brent_minima.html"><img src="../../../../../doc/src/images/next.png" alt="Next"></a>
  126. </div>
  127. </body>
  128. </html>