Spring til indhold

Bruger:Crudiant/sandkasse8

Fra Wikipedia, den frie encyklopædi
Standard logistic sigmoid function

En logistisk funktion eller logistisk kurve er en almindelig "S" form (sigmoid kurve), med ligningen:

hvor e = den naturlige logaritme base (også kendt som Eulers nummer),

x0 = x-værdien af sigmoid midtpunkt,

L = kurvens maksimale værdi, og

k = stejlheden af kurven.[1]

For værdier af x i området af reelle tal fra −∞ to +∞,S-kurve er vist til højre opnås (med grafen for f approaching L som x tilnærmer sig +∞ og tilnærmer sig nul som x går mod −∞).

Funktionen blev navngivet i 1844-1845 af Pierre François Verhulst, der studerede det i relation til befolkningstilvæksten.[2] Den indledende fase af vækst er omtrent eksponentielt; derefter, som mætning begynder, at væksten bremser, og ved udløb, stopper væksten.

Den logistiske funktion har en anvendelse indenfor en række områder, herunder kunstige neurale netværk, biologi, især økologi, biomatematik, kemi, demografi, økonomi, geovidenskab, matematisk psykologi, lingvistik, sandsynlighed, sociologi, statskundskab og statistik.

Mathematical properties

[redigér | rediger kildetekst]

In practice, due to the nature of the exponential function ex, it is often sufficient to compute x over a small range of real numbers such as a range contained in [−6, +6].

The standard logistic function (k=1, x0=0, L=1) has an easily calculated derivative:

et har også den egenskab, at

Thus, is an odd function.

Logistic differential equation

[redigér | rediger kildetekst]

Standard logistisk funktion er løsningen af den simple første ordens ikke-lineær differentialligning

with boundary condition f(0) = 1/2. This equation is the continuous version of the logistic map.

Den kvalitative adfærd er let at forstå i form af faselederen: derivatet er nul, når funktionen er enhed og derivatet er positive for f mellem 0 og 1, og negativ for f 1 ovenfor eller mindre end 0 (selvom negative populationer generelt ikke overensstemmelse med en fysisk model). Dette giver en ustabil ligevægt ved 0, og en stabil ligevægt ved 1, og dermed for enhver funktion værdi større end nul og mindre end enhed, vokser til enhed.

Man kan let finde den symbolske opløsning til at være

Choosing the constant of integration ex0 = 1 gives the other well-known form of the definition of the logistic curve

More quantitatively, as can be seen from the analytical solution, the logistic curve shows early exponential growth for negative argument, which slows to linear growth of slope 1/4 for an argument near zero, then approaches one with an exponentially decaying gap.

Den logistiske funktion er den inverse af den naturlige logit-funktionen og kan således anvendes til at omdanne logaritmen til odds i en sandsynlighed. I mathematicaly notation den logistiske funktion er undertiden skrevet som expit[3] in the same form as logit. The conversion from the log-likelihood ratio of two alternatives also takes the form of a logistic curve.

The logistic sigmoid function is related to the hyperbolic tangent, A.p. by

eller

Det sidstnævnte forhold fremgår af

In ecology: modeling population growth

[redigér | rediger kildetekst]
Pierre-François Verhulst (1804–1849)

En typisk anvendelse af den logistiske ligning er en fælles model for befolkningstilvæksten, oprindeligt på grund af Pierre-François Verhulst i 1838, hvor antallet af reproduktionen er proportional med både den eksisterende befolkning og mængden af tilgængelige ressourcer, alt andet lige. Den Verhulst ligning blev offentliggjort efter Verhulst havde læst Thomas Malthus 'et essay om princippet om Befolkning. Verhulst afledt sin logistisk ligning til at beskrive selvbegrænsende vækst i en biologisk population. Ligningen blev genopdaget i 1911 af AG McKendrick for væksten af bakterier i bouillon og eksperimentelt afprøvet ved hjælp af en teknik til ikke-lineær parameter estimering.[4] Ligningen er også undertiden kaldes Verhulst-Pearl ligningen efter genopdagelse i 1920 af Raymond Pearl (1879-1940), og Lowell Reed (1888-1966) i Johns Hopkins University.[5] Another scientist, Alfred J. Lotka derived the equation again in 1925, calling it the law of population growth.

Letting P represent population size (N is often used in ecology instead) and t represent time, this model is formalized by the differential equation:

where the constant r defines the growth rate and K is the carrying capacity.

I ligningen, er den tidlige, uhindret vækstrate modelleret af den første periode +rP. The value of the rate r represents the proportional increase of the population P in one unit of time. Later, as the population grows, the modulus of the second term (which multiplied out is −rP2/K) becomes almost as large the first as some members of the population P interfere with each other by competing for some critical resource, such as food or living space. This antagonistic effect is called the bottleneck, and is modeled by the value of the parameter K. The competition diminishes the combined growth rate, until the value of P ceases to grow (this is called maturity of the population). The solution to the equation (with being the initial population) is

where

Which is to say that K is the limiting value of P: the highest value that the population can reach given infinite time (or come close to reaching in finite time). It is important to stress that the carrying capacity is asymptotically reached independently of the initial value P(0) > 0, also in case that P(0) > K.

In ecology, species are sometimes referred to as r-strategist or K-strategist depending upon the selective processes that have shaped their life history strategies. If we choose our variable dimensions so that n measures the population in units of carrying capacity, and τ measures time in units of 1/r, gives the dimensionless differential equation


Time-varying carrying capacity

[redigér | rediger kildetekst]

Since the environmental conditions influence the carrying capacity, as a consequence it can be time-varying: K(t) > 0, leading to the following mathematical model:

A particularly important case is that of carrying capacity that varies periodically with period T:

It can be shown that in such a case, independently from the initial value P(0) > 0, P(t) will tend to a unique periodic solution P*(t), whose period is T.

A typical value of T is one year: In such case K(t) may reflect periodical variations of weather conditions.

Another interesting generalization is to consider that the carrying capacity K(t) is a function of the population at an earlier time, capturing a delay in the way population modifies its environment. This leads to a logistic delay equation,[6] which has a very rich behavior, with bistability in some parameter range, as well as a monotonic decay to zero, smooth exponential growth, punctuated unlimited growth (i.e., multiple S-shapes), punctuated growth or alternation to a stationary level, oscillatory approach to a stationary level, sustainable oscillations, finite-time singularities as well as finite-time death.

In statistics and machine learning

[redigér | rediger kildetekst]

Logistic functions are used in several roles in statistics. For example, they are the cumulative distribution function of the logistic family of distributions, and they are, a bit simplified, used to model the chance a chess player has to beat his opponent in the Elo rating system. More specific examples now follow.

Logistic regression

[redigér | rediger kildetekst]
Hovedartikel: Logistic regression.

Logistic functions are used in logistic regression to model how the probability p of an event may be affected by one or more explanatory variables: an example would be to have the model

where x is the explanatory variable and a and b are model parameters to be fitted.

Logistic regression and other log-linear models are also commonly used in machine learning. A generalisation of the logistic function to multiple inputs is the softmax activation function, used in multinomial logistic regression.

Another of the logistic function is in the Rasch model, used in item response theory. In particular, the Rasch model forms a basis for maximum likelihood estimation of the locations of objects or persons on a continuum, based on collections of categorical data, for example the abilities of persons on a continuum based on responses that have been categorized as correct and incorrect.

Neural networks

[redigér | rediger kildetekst]

Logistic functions are often used in neural networks to introduce nonlinearity in the model and/or to clamp signals to within a specified range. A popular neural net element computes a linear combination of its input signals, and applies a bounded logistic function to the result; this model can be seen as a "smoothed" variant of the classical threshold neuron.

A common choice for the activation or "squashing" functions, used to clip for large magnitudes to keep the response of the neural network bounded[7] is

which is a logistic function. These relationships result in simplified implementations of artificial neural networks with artificial neurons. Practitioners caution that sigmoidal functions which are antisymmetric about the origin (e.g. the hyperbolic tangent) lead to faster convergence when training networks with backpropagation.[8]

The logistic function is itself the derivative of another proposed activation function, the softplus.

In medicine: modeling of growth of tumors

[redigér | rediger kildetekst]

Another application of logistic curve is in medicine, where the logistic differential equation is used to model the growth of tumors. This application can be considered an extension of the above-mentioned use in the framework of ecology (see also the Generalized logistic curve, allowing for more parameters). Denoting with X(t) the size of the tumor at time t, its dynamics are governed by:

which is of the type:

where F(X) is the proliferation rate of the tumor.

If a chemotherapy is started with a log-kill effect, the equation may be revised to be

where c(t) is the therapy-induced death rate. In the idealized case of very long therapy, c(t) can be modeled as a periodic function (of period T) or (in case of continuous infusion therapy) as a constant function, and one has that

i.e. if the average therapy-induced death rate is greater than the baseline proliferation rate then there is the eradication of the disease. Of course, this is an oversimplified model of both the growth and the therapy (e.g. it does not take into account the phenomenon of clonal resistance).

In chemistry: reaction models

[redigér | rediger kildetekst]

The concentration of reactants and products in autocatalytic reactions follow the logistic function.

In physics: Fermi distribution

[redigér | rediger kildetekst]

The logistic function determines the statistical distribution of fermions over the energy states of a system in thermal equilibrium. In particular, it is the distribution of the probabilities that each possible energy level is occupied by a fermion, according to Fermi–Dirac statistics.

In linguistics: language change

[redigér | rediger kildetekst]

In linguistics, the logistic function can be used to model language change:[9] an innovation that is at first marginal begins to spread more quickly with time, and then more slowly as it becomes more universally adopted.

In economics: diffusion of innovations

[redigér | rediger kildetekst]

The logistic function can be used to illustrate the progress of the diffusion of an innovation through its life cycle. Historically, when new products are introduced there is an intense amount of research and development which leads to dramatic improvements in quality and reductions in cost. This leads to a period of rapid industry growth. Some of the more famous examples are: railroads, incandescent light bulbs, electrification, cars and air travel. Eventually, dramatic improvement and cost reduction opportunities are exhausted, the product or process are in widespread use with few remaining potential new customers, and markets become saturated.

Logistic analysis was used in papers by several researchers at the International Institute of Applied Systems Analysis (IIASA). These papers deal with the diffusion of various innovations, infrastructures and energy source substitutions and the role of work in the economy as well as with the long economic cycle. Long economic cycles were investigated by Robert Ayres (1989).[10] Cesare Marchetti published on long economic cycles and on diffusion of innovations.[11][12] Arnulf Grübler’s book (1990) gives a detailed account of the diffusion of infrastructures including canals, railroads, highways and airlines, showing that their diffusion followed logistic shaped curves.[13]

Carlota Perez used a logistic curve to illustrate the long (Kondratiev) business cycle with the following labels: beginning of a technological era as irruption, the ascent as frenzy, the rapid build out as synergy and the completion as maturity.[14]

  1. ^ Verhulst, Pierre-François (1838). "Notice sur la loi que la population poursuit dans son accroissement" (PDF). Correspondance mathématique et physique. 10: 113-121. Hentet 3 december 2014.{{cite journal}}: CS1-vedligeholdelse: Dato automatisk oversat (link)
  2. ^ Verhulst, Pierre-François (1845). "Recherches mathématiques sur la loi d'accroissement de la population" [Mathematical Researches into the Law of Population Growth Increase]. Nouveaux Mémoires de l'Académie Royale des Sciences et Belles-Lettres de Bruxelles. 18: 1-42. Hentet 2013-02-18. {{cite journal}}: Ukendt parameter |trans_title= ignoreret (|trans-title= foreslået) (hjælp)
  3. ^ expit documentation for R's clusterPower package
  4. ^ A. G. McKendricka; M. Kesava Paia1 (januar 1912). "XLV.—The Rate of Multiplication of Micro-organisms: A Mathematical Study". Proceedings of the Royal Society of Edinburgh. 31: 649-653. doi:10.1017/S0370164600025426.{{cite journal}}: CS1-vedligeholdelse: Dato automatisk oversat (link) CS1-vedligeholdelse: Flere navne: authors list (link)
  5. ^ Skabelon:Cite article
  6. ^ Yukalov, V. I.; Yukalova, E. P.; Sornette, D. (2009). "Punctuated evolution due to delayed carrying capacity". Physica D: Nonlinear Phenomena. 238 (17): 1752. doi:10.1016/j.physd.2009.05.011.
  7. ^ Gershenfeld 1999, p.150
  8. ^ LeCun, Y.; Bottou, L.; Orr, G.; Muller, K. (1998). Orr, G.; Muller, K. (red.). Efficient BackProp (PDF). Neural Networks: Tricks of the trade. Springer. ISBN 3-540-65311-2.
  9. ^ Bod, Hay, Jennedy (eds.) 2003, pp. 147–156
  10. ^ Ayres, Robert (1989). "Technological Transformations and Long Waves" (PDF). {{cite journal}}: Cite journal kræver |journal= (hjælp)
  11. ^ Marchetti, Cesare (1996). "Pervasive Long Waves: Is Society Cyclotymic" (PDF). {{cite journal}}: Cite journal kræver |journal= (hjælp)
  12. ^ Marchetti, Cesare (1988). "Kondratiev Revisited-After One Cycle" (PDF). {{cite journal}}: Cite journal kræver |journal= (hjælp)
  13. ^ Grübler, Arnulf (1990). The Rise and Fall of Infrastructures: Dynamics of Evolution and Technological Change in Transport (PDF). Heidelberg and New York: Physica-Verlag.
  14. ^ Perez, Carlota (2002). Technological Revolutions and Financial Capital: The Dynamics of Bubbles and Golden Ages. UK: Edward Elgar Publishing Limited. ISBN 1-84376-331-1. {{cite book}}: Cite har en ukendt tom parameter: |coauthors= (hjælp)

Skabelon:Ref begin

  • Jannedy, Stefanie; Bod, Rens; Hay, Jennifer (2003). Probabilistic Linguistics. Cambridge, Massachusetts: MIT Press. ISBN 0-262-52338-8.{{cite book}}: CS1-vedligeholdelse: Flere navne: authors list (link)
  • Gershenfeld, Neil A. (1999). The Nature of Mathematical Modeling. Cambridge, UK: Cambridge University Press. ISBN 978-0-521-57095-4.
  • Kingsland, Sharon E. (1995). Modeling nature: episodes in the history of population ecology. Chicago: University of Chicago Press. ISBN 0-226-43728-0.
  • Skabelon:MathWorld

Skabelon:Ref end

[redigér | rediger kildetekst]