We have been working hard to put causal discovery on a more firm footing. Causal discovery, unraveling cause and effect in complex systems, is a rapidly developing field, especially in its application to the natural and earth sciences, such as atmospheric science.
The information theoretic approach has proved very useful for causal network discovery in this field filled with nonlinear relationships. Current calculations using this approach return values that are difficult to interpret physically, and existing causal discovery methods either do not incorporate the possibility that processes combine inseparably to influence another process, or the specific form of the nonlinear interaction has to be specified.
This is slightly surprising as inseparable interaction terms are a fundamental aspect of the dynamics of the atmosphere and the specific form is often unknown.
We proposed a new causal discovery framework that attempts to overcome these issues by first renormalizing all variables to have equal variance in order to remove all human-imposed scaling and to have a single reference process with which we compare the amount of information of maximal entropy and infinite variance.
Then the method determines what we call the latent information content of the transformed variable as well as contributions to total information in the form of mutual information with other (lagged) known processes.,Furthermore, the framework accounts for inseparable causation of multiple processes on a single process, ie. terms such as xn+1=ynzn+…, or even more complicated terms.
Allowing for inseparable interaction of unknown form is crucial, and our new framework explicitly incorporates this, further advancing our ability to unravel cause and effect in the complex atmospheric system.
We are in the process of testing the merit of the new framework in highly nonlinear and inseparable systems that have atmospheric relevance. Since the computational effort grows exponentially with the number of processes in the network special attention will be given to efficient numerical implementation of the framework.