Jeff Hughes
Royal Melbourne Institute of Technology
The basis of modern Chaos theory is the search for underlying order in apparent randomness. The common idea of chaos is that of a system without any apparent pattern or order - out of control. This seems to imply that a system behaving this way has no underlying rules governing its behaviour. There is also a common belief that complicated behaviour is associated with complicated systems of controlling rules, while simple sets of rules lead to simple behaviour.
The modern theory of Chaos has shown both these ideas to be flawed. Model systems based on a few basic rules can show extremely complex behaviour. This behaviour may have no obvious pattern yet is not random since the system is driven by a set of rules and is hence predictable (Note 1) (but only if the initial conditions can precisely be specified).
Chaos is thus more correctly referred to as Deterministic Chaos (an apparent contradiction in terms!). Chaotic behaviour of this type is referred to as aperiodic, in contrast to random. The problem is then for the experimenter to decide whether a dynamic system, behaving without apparent order or pattern, is behaving randomly (unpredictably) or chaotically (there are underlying rules governing the motions).
Hasn't the Weather Been Strange Lately?The study of the lower few kilometres of the fluid that envelops the earth occupies some of the world's largest computers for many hours of computational time. Despite this computational effort, we cannot predict the weather accurately more than about a week ahead at best (and sometimes not even tomorrow's weather can be accurately forecast). The models used for these predictions are very complex. However, should we expect that, given a model of the atmosphere which reasonably approximates the way the atmosphere behaves, we can make accurate predictions well into the future?The meteorologist, Edward Lorenz, showed in 1963 that this optimism is ill-founded (Note 2). Lorenz simplified his model to the stage it only contained three variables:
dx/dt = a(x-y) ...................(1)dy/dt = r*x - y - x*z ..........(2)
dz/dt = b*z + x*y .............(3)
It need not concern us at this stage what x, y and z refer to. In fact, they are composite variables, combining the real variables of the system such as temperature, pressure etc. How x, y and z change with time will be reflected in changes in the real system variables.
This is a system of differential equations - they reflect how x, y and z will change with time. It is a very simple set of equations, but the set has two important characteristics:
How can we then study the behaviour of such a system? Fortunately there are approximate (or numeric) methods which can help us. With the help of a computer - a PC is quite adequate (Note 3)- the way x, y and z change with time can be studied. such plots are called time series (see figure 1a). Typical results for x, y and z show that they undergo oscillations in a fairly regular fashion, until the onset of chaotic or aperiodic oscillations.
The modern PC is, however, far in advance of the primitive computer available to Lorenz in 1963. Even the printing out of numbers was a slow process so, to save time, he only printed their the first 4 decimal places. This round-off error turned out to be fortunate, as it led to an accidental discovery of the crucial feature of this system.
Lorenz's computer did not have a graphics screen - just a line printer, to print out lists of numbers. One day he decided to check the results of a run, so he re-entered a set of values of the variables from part-way through a run. At first, the numbers produced were the same as his first run, but gradually started to differ until the two sets of numbers became quite different (see figure 1b). Why? Lorenz realised that the values of x,y and z he re-entered were not exactly the same as the first run, but only correct to 4 decimal places. Because of this rounding-off error the true value of x was slightly different. Thus the key element of chaotic systems is demonstrated - sensitivity to initial conditions.
Can a Cockroach Crawling up a Wall in Melbourne Cause a Cyclone in Cairns?The answer is to change the way we look at the data. Observing how the variables change with time as in figure 1, called a time series, is not the best way to detect underlying order. Supposing instead of time series we plot a series of points (x,y,z) at successive times. The plot is called a phase portrait. For the Lorenz model a characteristic shapes emerges. In figure 2 the projection of this 3-D image onto a 2-D surface is shown. The shape basically consists of two lobes (the Lorenz 'butterfly'), but the line never crosses itself. The shape is arrived at regardless of initial values of (x,y,z). The unpredictability comes from the fact that two adjacent tracks can at some future stage diverge onto different lobes. These tracks, or 'orbits', can be infinitesimally close, but never cross. Consider then two points on nearby tracks (corresponding to two initial sets of values, differing by very small amounts). At first the paths followed by each point will be closely aligned but at some future time one track can branch off into the other lobe (Note 4).
These shapes traced out by the (x,y,z) values in phase space are called attractors (so named because the system seems drawn or attracted to this region of phase space). If the attractor is not a point or a closed loop it is strange. For truly random data there will not be any distinguishing pattern in phase space. Thus, the existence of a strange attractor is a pointer to the existence of some underlying order to the system. Despite apparent erratic behaviour the motion is 'attracted' towards a regulating order by a set of rules. The experimenter can then look for a model, or set of mathematical equations, to study the system. In our example of weather models, the climate may be thought of as a weather attractor. If such an attractor does exist, then it is most likely to be strange.
Is There Any Strangeness in Chemistry?
The reason that the Lorenz model was chosen to introduce chaos is that the 3 equations used in the model have direct relevance to chemistry. If we let x, y and z represent concentrations of chemical species in a reaction then the study of the rate of change of these variables is what we are studying in Chemical Kinetics. The 3 Lorenz equations could be sets of equations describing a chemical mechanism, and the dx/dt, dy/dt and dz/dt are the rates of reaction with respect to each of these variables. The vast majority of chemical reactions do not behave like the Lorenz model (fortunately!). They are not sensitive to initial conditions - imagine how difficult life would be if changing the amount of reactant by a microgram changed the likely course of a reaction! The 'attractor' for chemical reactions is a single point - the equilibrium point (see figure 3a).
Is it possible, then, for a chemical system to have a different kind of attractor, or even behave chaotically? Theoretical models have been proposed which have non-linear elements similar to the Lorenz equations (Note 5) and when the equations for these systems are integrated they show oscillatory behaviour (see figure 3b). The attractor for an oscillatory or periodic system is a closed loop.
Examples of chemical reactions which can oscillate have been known from 1828. A reaction in an electrochemical cell which produced an oscillating current was described by Fechner. Several other examples of oscillations in heterogeneous systems were reported during the nineteenth century, but the first report of oscillations in a closed homogeneous system was reported by Bray in 1920, the same time that the theoretical Lotka mechanism was reported (Note 5). Not much notice was taken of these reported reactions because they appeared to violate the Second Law of Thermodynamics. However what the Second Law really forbids is oscillations around the point of equilibrium - like the damped oscillations of a spring. A chemical system can oscillate providing the system is far from equilibrium. It is now recognised that there are three requirements for chemical oscillations to occur:
Oscillations in such systems as the BZ and Bray reactions can be studied in a number of ways. Oscillations in colour can be followed by monitoring the absorbance of the solution in a spectrophotometer. Oscillations in chemical concentrations can be followed by monitoring the chemical potential of the solution, using an inert electrode (Pt, graphite) and a reference electrode. In either case, regular oscillations are observed.
Does Chaos Develop From Order?To avoid this depletion the reactions were studied in a Continuous Stirred Tank Reactor (CSTR). Reagents are pumped in through three or four lines using a single peristaltic pump. The vessel has a fixed volume, and excess mixture is allowed to overflow. Rather than try and monitor the effect of changing initial concentrations of the several reactants the system is studied for sensitivity to only one parameter - the average residence time the solution is in the cell. This can be controlled by the pumping rate. Such systems are then quite sensitive to residence times and can exhibit periodic or aperiodic behaviour, depending on the pumping rate.
In the Lorenz system, evidence of chaotic behaviour was seen in the existence of a strange attractor in, phase space. The problem with the BZ reaction study is that generally the change of only one variable with time is studied (eg. absorbance, cell potential etc.). To obtain another variable for plotting in phase space the value of the variable is measured after a fixed time delay. This gives a series of points (Xt, Xt + T) where T is the fixed time delay. The choice of T is somewhat arbitrary, but there does appear to be an optimum delay of about one tenth to half the average period of oscillation. When data from aperiodic regions of the BZ reaction in a CSTR are plotted in this way, a strange attractor similar to figure 3(c) is observed. Thus the oscillations observed can truly be described as chaotic and not just random.
The question still remains as to the origins of this chaos. Does it arise from the chemical reactions themselves or is it a product of some inhomogeneity in the system such as non-uniform mixing, temperature fluctuations etc? The full mechanism proposed for the BZ reaction by Field, Koros and Noyes (FKN mechanism) contains 18 steps and 21 independent species. A much simpler model, called the Oregonator (Note 8), can be constructed from the FKN model by combining variables and making certain assumptions. This model also contains the nonlinear elements and autocatalytic steps required for oscillating reactions and Chaos.
Although the Oregonator model appears quite simple, mathematical treatment of it is not. If integration of the equations by simple methods such as the Euler method (see Note 1) is attempted the variables do oscillate but at rapidly increasing amplitude until the 'out of bounds' message is seen on the computer. This is clearly not realistic results from the huge difference in the magnitude of the rate constants (varying from 10-10 to 109 in some versions of the model). Such equations are known as stiff equations and require special techniques to integrate. Merely taking smaller time intervals does not get round the problem.
Using these special techniques initial reports did describe aperiodic behaviour and the existence of strange attractors. Later reports have claimed that the aperiodicity is a numerical artefact, and by modifying the techniques used only strict periodic behaviour is observed.
An alternative approach to model the observed chaotic behaviour was taken by Rossler. Rather than try and model the chemical reactions taking place he set up a series of equations motivated by the fluid dynamics governing the chemical reactions in a CSTR (Note 9). These equations are much simpler to integrate, and exhibit oscillatory behaviour and a strange attractor similar to the attractor observed for the experimental data. The position can thus be summarised as that Chaos has undoubtedly been observed experimentally but the jury is still out on whether the 'chemical' or 'physical' interpretation of this Chaos is the correct one.
The BZ reaction, and similar reactions are by far the most-studied examples of Chaos in Chemistry but there are other examples (Note 10). Some gas-phase reactions are autocatalytic and have the potential for chaotic behaviour. A simple example is the reaction between hydrogen and oxygen in a CSTR. Other examples involve heterogeneous systems, such as the catalytic oxidation of carbon monoxide on platinum and the dissolving of metals such as copper and nickel in solution when an electric potential is applied. Examples in Biochemistry include the interconversion of adenosine triphosphate (ATP) and adenosine diphosphate (ADP) via glycolysis. In view of the way that enzymes are recycled efficiently in biochemical reactions it seems likely that many more examples of oscillatory mechanisms in Biochemistry will appear. An example of chaotic behaviour in this context is the occurrence of Chaos in heartbeats, or fibrillation. The question arises as to whether other examples of a 'breakdown' in a biological function might be due to a transition from periodicity to chaos.
NotesChaos:
About the Author
Jeff Hughes obtained his PhD in inorganic chemistry from Latrobe University in 1975. Following a period of research work at Melbourne University, he has taught chemistry at RMIT in Melbourne and Capricornia Institute in Rockhampton. Currently he lectures in physical and environmental chemistry at RMIT. His current research interests are in the applications of numerical methods of studies of problems in solution chemistry and studies of the behaviour of aluminium in treated water.
By accepting you will be accessing a service provided by a third-party external to https://racichemedcentral.com.au/