Bi-variate estimators
Classical methods
Classical estimators of connectivity are correlation and coherence. The above measures provide information on the directionality of interactions in terms of delay (correlation) or coherence (Non-linear methods
The most frequently used nonlinear estimators of connectivity areBivariate versus multivariate estimators
Comparison of performance of bivariate and multivariate estimators of connectivity may be found in, where it was demonstrated that in case of interrelated system of channels, greater than two, bivariate methods supply misleading information, even reversal of true propagation may be found. Consider the very common situation that the activity from a given source is measured at electrodes positioned at different distances, hence different delays between the recorded signals. When a bivariate measure is applied, propagation is always obtained when there is a delay between channels., which results in a lot of spurious flows. When we have two or three sources acting simultaneously, which is a common situation, we shall get dense and disorganized structure of connections, similar to random structure (at best some "small world" structure may be identified). This kind of pattern is usually obtained in case of application of bivariate measures. In fact, effective connectivity patterns yielded by EEG or LFP measurements are far from randomness, when proper multivariate measures are applied, as we shall demonstrate below.Multivariate methods based on Granger causality
The testable definition of causality was introduced byMultivariate Autoregressive Model
The AR model assumes that ''X''(''t'')—a sample of data at a time ''t''—can be expressed as a sum of ''p'' previous values of the samples from the set of ''k''-signals weighted by model coefficients ''A'' plus a random value ''E''(''t''): The ''p'' is called the model order. For a ''k''-channel process ''X''(''t'') and ''E''(''t'') are vectors of size ''k'' and the coefficients ''A'' are ''k''×''k''-sized matrices. The model order may be determined by means of criteria developed in the framework of information theory and the coefficients of the model are found by means of the minimalization of the residual noise. In the procedure correlation matrix between signals is calculated. By the transformation to the frequency domain we get: ''H''(''f'') is a transfer matrix of the system, it contains information about the relationships between signals and their spectral characteristics. ''H''(''f'') is non-symmetric, so it allows for finding causal dependencies. Model order may be found by means of criteria developed in the framework of information theory, e.g. AIC criterion.Granger Causality Index
Directed Transfer Function
Directed Transfer Function (DTF) was introduced by Kaminski and Blinowska in the form: Where ''Hij''(''f'') is an element of a transfer matrix of MVAR model. DTF describes causal influence of channel ''j'' on channel ''i'' at frequency ''f''. The above equation () defines a normalized version of DTF, which takes values from 0 to 1 producing a ratio between the inflow from channel ''j'' to channel ''i'' to all the inflows to channel ''i''. The non-normalized DTF which is directly related to the coupling strength is defined as: DTF shows not only direct, but also cascade flows, namely in case of propagation 1→2→3 it shows also propagation 1→3. In order to distinguish direct from indirect flows direct Directed Transfer Function (dDTF) was introduced. The dDTF is defined as a multiplication of a modified DTF by partial coherence. The modification of DTF concerned normalization of the function in such a way as to make the denominator independent of frequency. The dDTF''j''→''i'' showing direct propagation from channel ''j'' to ''i'' is defined as: Where ''Cij''(''f'') is partial coherence. The dDTF''j''→''i'' has a nonzero value when both functions ''Fij''(''f'') and ''Cij''(''f'') are non-zero, in that case there exists a direct causal relation between channels ''j''→''i''. Distinguishing direct from indirect transmission is essential in case of signals from implanted electrodes, for EEG signals recorded by scalp electrodes it is not really important. DTF may be used for estimation of propagation in case of point processes e.g. spike trains or for the estimation of causal relations between spike trains and Local Field Potentials.Partial Directed Coherence
The partial directed coherence (PDC) was defined by Baccala and Sameshima in the following form: In the above equation ''Aij''(''f'') is an element of ''A''(''f'')—a Fourier transform of MVAR model coefficients ''A''(''t''), where a''j''(''f'') is ''j''-th column of ''A''(''f'') and the asterisk denotes the transpose and complex conjugate operation. Although it is a function operating in the frequency domain, the dependence of ''A''(''f'') on the frequency has not a direct correspondence to the power spectrum. From normalization condition it follows that PDC takes values from the interval ,1 PDC shows only direct flows between channels. Unlike DTF, PDC is normalized to show a ratio between the outflow from channel ''j'' to channel ''i'' to all the outflows from the source channel ''j'', so it emphasizes rather the sinks, not the sources. The normalization of PDC affects the detected intensities of flow as was pointed out in. Namely, adding further variables that are influenced by a source variable decreases PDC, although the relationship between source and target processes remains unchanged. In other words: the flow emitted in one direction will be enhanced in comparison to the flows of the same intensity emitted from a given source in several directions.Time-varying estimators of effective connectivity
In order to account for the dynamic changes of propagation, the method of adaptive filtering or the method based on the sliding window may be applied to estimators of connectivity. Both methods require multiple repetition of the experiment to obtain statistically satisfactory results and they produce similar results. The adaptive methods, e.g. Kalman filtering, are more computationally demanding, therefore methods based on sliding window may be recommended. In the case of parametric model the number of data points ''kNT'' (''k''—number of channels, ''NT''—number of points in the data window) has to be bigger (preferably by order of magnitude) than the number of parameters, which in case of MVAR is equal to ''k''2''p'' (''p''—model order). In order to evaluate dynamics of the process, a short data window has to be applied, which requires an increase of the number of the data points, which may be achieved by means of a repetition of the experiment. A non-stationary recording may be divided into shorter time windows, short enough to treat the data within a window as quasi-stationary. Estimation of MVAR coefficients is based on calculation of the correlation matrix between channels ''Rij'' of ''k'' signals ''Xi'' from multivariate set, separately for each trial. The resulting model coefficients are based on the correlation matrix averaged over trials. The correlation matrix has the form: The averaging concerns correlation matrices (model is fitted independently for each short data window); the data are not averaged in the process. The choice of window size is always a compromise between quality of the fit and time resolution. The errors of the SDTF may be evaluated by means of bootstrap method. This procedure corresponds to simulations of other realizations of the experiment. The variance of the function value is obtained by repeated calculation of the results for a randomly selected (with repetitions) pool of the original data trials.Applications
The estimation of brain connectivity has found numerous and notable applications, namely when investigating brain changes associated with the treatment of psychopathology like schizophrenia and depression, or following structural damage like in hemorrhage or tumor. The methods applied benefit from a parcellation approach, where regions of the brain are defined from atlases or DWI data, with connectivity metrics then extracted to compare changes within standardized regions. Specifically, DTF found multiple applications, the early ones involved: localization of epileptic foci, estimation of EEG propagation in different sleep stages and wakefulness, determination of transmission between brain structures of an animal during a behavioral test. One may observe the shifting of sources toward the front in transition from wakefulness to the deeper sleep stages. In the deep sleep the source is overConclusions
The existence of well defined sources of brain activity connected with particular experimental conditions are well established in fMRI experiments, by means of inverse solution methods and intracortical measurements. This kind of deterministic structure of brain activity should affect functional connectivity, so reported in some works random or barely distinguished from random connectivity structure may be considered as a surprising phenomenon. This kind of results may be explained by methodological errors: 1) unrobust methods of connectivity estimation and, even more important, 2) application of bivariate methods. When multivariate robust measures of connectivity are applied for EEG analysis a clear picture of functional connectivity emerges.References
{{Reflist, refs= {{Cite journal, title=Brain connectivity, journal=Scholarpedia, volume=2, issue=10, pages=4695, doi=10.4249/scholarpedia.4695, year=2007, last1=Sporns, first1=Olaf, bibcode=2007SchpJ...2.4695S, doi-access=free {{cite book , last1= Blinowska, first1=K. J. , last2=Żygierewicz , first2= J. , title=Practical Biomedical Signal Analysis Using Matlab , publisher=CRC Press, Boca Raton , year=2012, bibcode=2011pbsa.book.....Z {{Cite journal, title=Review of Advanced Techniques for the estimation of Brain Connectivity measured with EEG/MEG , first=V. , last=Sakkalis , journal=Comput Biol Med, volume=41, issue=12, year=2011, pages=1110–1117, doi=10.1016/j.compbiomed.2011.06.020, pmid=21794851 {{Cite journal, title=Review of the methods of determination of directed connectivity from multichannel data , first=K. J. , last=Blinowska , journal=Medical & Biological Engineering & Computing, volume=49, issue=5, year=2011, pages=521–529, doi=10.1007/s11517-011-0739-x, pmid=21298355 , pmc=3097342 {{Cite journal, title=Causal Influence: Advances in Neurosignal Analysis, first1=M., last1=Kaminski, first2=H., last2=Liang, s2cid=27601014, journal=Critical Reviews in Biomedical Engineering, volume=33, issue=4, year=2005, pages=347–430, doi=10.1615/CritRevBiomedEng.v33.i4.20, pmid=15982186 {{Cite journal, title=Causal Influence: Nonlinear multivariate analysis of neurophysical signals, first1=E., last1=Pereda, first2=R. Q., last2=Quiroga, first3=J., last3=Bhattacharya, journal=Prog Neurobiol, volume=77, year=2005, pages=1–37, doi=10.1016/j.pneurobio.2005.10.003, pmid=16289760, issue=1–2, arxiv=nlin/0510077, s2cid=9529656 {{Cite journal, title=Structurally constrained brain connectivity, first1=A., last1=Crimi, first2=et , last2=al., journal=NeuroImage, volume=289, year=2021, doi=10.1016/j.neuroimage.2021.118288, issue=1, page=118288, pmid=34147631, s2cid=235468119 {{Cite book, title=Handbook of Time Series Analysis, first1=I., last1=Netoff, last2=Caroll, first2=T. L., first3=L. M., last3=Pecora, first4=S. J., last4=Schiff , publisher=Wiley-B.W., year=2006, chapter=Detecting coupling in the presence of noise and nonlinearity, editor1-last=Schelter, editor1-first=J., editor2-last=Winterhalder, editor2-first=W., editor3-last=Timmer {{Cite journal, title=Synchronization likelihood: an unbiased measure of generalized synchronization in multivariate data sets, first1=C. J., last1=Stam, first2=B. W., last2=Van Dijk, journal=Physica D, volume=163, year=2002, pages=236–251, bibcode=2002PhyD..163..236S, doi=10.1016/S0167-2789(01)00386-4, issue=3–4 {{Cite journal, title=Dynamics of the human alpha rhythm: evidence for non-linearity?, first1=C. J., last1=Stam, first2=P., last2=Suffczynski, first3=F. H., last3=Lopes da Silva, journal=Clin. Neurophysiol., volume=110, year=1999, pages=1801–1813, doi=10.1016/S1388-2457(99)00099-1, pmid=10574295, last4=Lopes Da Silva, first4=FH, issue=10, s2cid=32554820 {{Cite journal, last1=Achermann , first1=P. , last2=Hartmann , first2=R. , last3=Gunzinger , first3=A. , last4=Guggenbühl , first4=W. , last5=Borbély , first5=A. A. , year=1994 , title=All night sleep and artificial stochastic control signals have similar correlation dimension , journal=Electroencephalogr. Clin. Neurophysiol., volume=90, pages=384–387, doi=10.1016/0013-4694(94)90054-X, pmid=7514985 , issue=5 {{Cite journal, last1=Blinowska, first1=K. J., last2=Malinowski, first2=M., year=1991, title=Non-linear and linear forecasting of the EEG time series, journal=Biol Cybern., volume=66, pages=159–165, doi=10.1007/BF00243291, pmid=1768720, issue=2, s2cid=19441303 {{Cite journal, last1=Winterhalder , first1=M. , last2=Schelter , first2=B. , last3=Hesse , first3=W. , last4=Schwab , first4=K. , last5=Leistritz , first5=L. , last6=Klan , first6=D. , last7=Bauer , first7=R. , last8=Timmer , first8=J. , author9=Witte, H., year=2005, title=Comparison of linear signal processing techniques to infer directed interactions in multivariate neural systems, journal=Signal Process, volume=85, pages=2137–2160, doi=10.1016/j.sigpro.2005.07.011, issue=11, citeseerx=10.1.1.123.2234 {{Cite journal , author1=Blinowska, K. J. , author2=Kuś, R. , author3=Kamiński, M. , year=2004, title=Granger causality and information flow in multivariate processes, journal=Phys. Rev. E, volume=70, page=050902 (also in ''Virt J Biol Phys Res 8(11)''), bibcode=2004PhRvE..70e0902B , doi=10.1103/PhysRevE.70.050902, pmid=15600583 , issue=5 {{Cite journal, author1=Kuś, R., author2=Kamiński, M., author3=Blinowska, K. J., year=2004, title=Determination of EEG activity propagation: pair-wise versus multichannel estimate, journal=IEEE Trans Biomed Eng, volume=51, pages=1501–1510, doi=10.1109/TBME.2004.827929, pmid=15376498, issue=9, s2cid=25213886 {{Cite journal, author=Granger, C. W. J., year=1969, title=Investigating causal relations in by econometric models and cross-spectral methods, journal=Econometrica, volume=37, doi=10.2307/1912791, issue=3, pages=424–438, jstor=1912791 {{Cite journal, author=Granger, C. W. J., year=1980, title=Testing for causality: a personal viewpoint, journal=J Econ Dyn Control, volume=2, pages=329–352, doi=10.1016/0165-1889(80)90069-X {{Cite book, title=Handbook of Time Series Analysis, first1=K. J., last1=Blinowska, first2=M., last2=Kaminski , publisher=Wiley-VCH Verlag, year=2006, chapter=Multivariate Signal Analysis by Parametric Models, editor1-last=Schelter, editor1-first=B., editor2-last=Winterhalder, editor2-first=W., editor3-last=Timmer, editor3-first=J. {{Cite journal, author=Geweke, J., year=1982, title=Measurement of linear dependence and feedback between multiple time series, journal=Journal of the American Statistical Association, volume=77, issue=378, pages=304–324, doi=10.1080/01621459.1982.10477803 {{Cite journal, title=Propagation of EEG activity in beta and gamma band during movement imagery in human, author1=Ginter Jr., J., author2=Blinowska, K. J., author3=Kaminski, M., author4=Durka, P. J., author5=Pfurtscheller, G., author6=Neuper, C., journal=Methods Inf. Med., volume=44, year=2005, pages=106–113, pmid=15778801, issue=1, doi=10.1055/s-0038-1633932 {{Cite journal, title=A new method of the description of the information flow in brain structures, author2=Blinowska, K. J., author1=Kaminski, M., journal=Biol Cybern., volume=65, year=1991, pages=203–210, doi=10.1007/BF00198091, pmid=1912013, issue=3, s2cid=20924487 {{Cite journal, title=Evaluating causal relations in neural systems: Granger causality, directed transfer function and statistical assessment of significance, author2=Ding, M., author1=Kaminski, M., author3=Truccolo, W., author4=Bressler, S., journal=Biol Cybern., volume=85, year=2001, pages=145–157, doi=10.1007/s004220000235, pmid=11508777, issue=2, s2cid=11318476 {{Cite journal, title=Determination of information flow direction among brain structures by a modified Directed Transfer Function method (dDTF), author2=Mańczak, M., author1=Korzeniewska, A., author3=Kaminski, M., author4=Blinowska, K. J., author5=Kasicki, S., journal=J Neurosci Methods, volume=125, year=2003, pages=195–207, doi=10.1016/S0165-0270(03)00052-9, pmid=12763246, issue=1–2, s2cid=38538879 {{Cite journal, title=Dynamic changes in the direction of the theta rhythmic drive between Supramammillary Nucleus and the Septohippocampal system, author2=Kaminski, M., author1=Kocsis, B., journal=Hippocampus, volume=16, year=2006, pages=531–540, doi=10.1002/hipo.20180, pmid=16598710, issue=6, s2cid=36676205 {{Cite journal, title=Partial directed coherence: A new conception in neural structure determination, author1=Baccala, L. A., author2=Sameshima, K., journal=Biol Cybern., volume=84, year=2001, pages=463–474, doi=10.1007/PL00007990, pmid=11417058, issue=6, s2cid=30435970 {{Cite journal, title=Assessing the strength of directed influences among neural signals using renormalized partial directed coherence, author1=Schelter, B., author2=Timmer, J., author3=Eichler, M., journal=J. Neurosci. Methods, volume=179, year=2009, pages=121–130, doi=10.1016/j.jneumeth.2009.01.006, pmid=19428518, issue=1, s2cid=11631344 {{Cite journal, title=Bootstrap methods: another look at the jackknife, author=Efron, B., journal=Ann. Stat., volume=7, year=1979, pages=1–6, doi=10.1214/aos/1176344552, doi-access=free {{Cite conference, author1=Kaminski, M., author2=Szerling, P., author3=Blinowska, K., title=Comparison of methods for estimation of time-varying transmission in multichannel data, year=2010, location=Nov 2-5, 2010, Corfu, Greece, book-title=Proc. 10th IEEE International Conference on Information Technology and Applications in Biomedicine {{Cite journal, title=Analysis of mesial temporal seizure onset and propagation using the directed transfer function method, author1=Franaszczuk, P. J., author2=Bergey, G. J., author3=Kaminski, M., journal=Electroencephalogr. Clin. Neurophysiol., volume=91, year=1994, pages=413–427, doi=10.1016/0013-4694(94)90163-5, pmid=7529681, issue=6 {{Cite journal, title=Topographic analysis of coherence and propagation of EEG activity during sleep and wakefulness, author3=Szelenberger, W., author2=Blinowska, K. J., author1=Kaminski, M., journal=Electroencephalogr. Clin. Neurophysiol., volume=102, year=1997, pages=216–227, doi=10.1016/S0013-4694(96)95721-5, pmid=9129577, issue=3 {{Cite journal, title=Information flow between hippocampus and related structures during various types of rat's behavior, author1=Korzeniewska, A., author2=Kasicki, S., author3=Kaminski, M., author4=Blinowska, K. J., journal=J Neurosci Methods, volume=73, year=1997, pages=49–60, doi=10.1016/S0165-0270(96)02212-1, pmid=9130678, issue=1, s2cid=37590742 {{Cite journal, title=Phase and amplitude analysis in time-frequency space-application to voluntary finger movement, author1=Ginter Jr, J., author4=Durka, P. J., author3=Kaminski, M., author2=Blinowska, K. J., journal=J Neurosci Methods, volume=110, year=2001, pages=113–124, doi=10.1016/S0165-0270(01)00424-1, pmid=11564531, issue=1–2, s2cid=8328455 {{Cite journal, title=Propagation of EEG activity during finger movement and its imagination, author2=Ginter Jr, J., author1=Kus, R., author3=Blinowska, K. J., journal= Acta Neurobiol Exp, volume=66, issue=3, year=2006, pages=195–206 {{Cite journal, title=Transmission of information during Continuous Attention Test, author3=Kaminski, M., author2=Kus, R., author1=Blinowska, K. J., author4=Janiszewska, J., journal=Brain Topography, volume=23, year=2010, pages=205–213, doi=10.1007/s10548-010-0137-y, pmid=20191316, issue=2, s2cid=8579316 {{Cite journal, title=Information transfer during transitive reasoning task, author2=Kaminski, M., author3=Kaminski, J., author4=Blinowska, K. J., author1=Brzezicka, A., journal=Brain Topography, volume=24, year=2011, pages=1–8, doi=10.1007/s10548-010-0158-6, pmid=20686832, issue=1, pmc=3036833 {{Cite conference, author2=Kaminski, M., author3=Kaminski, J., author1=Blinowska, K. J., author4=Brzezicka, A., title=Information processing in brain and dynamic patterns of transmission, year=2010, location=Buenos Aires, Argentina, book-title=Proc. of IEEE EMBS Conference, pages=1722–1726 {{Cite journal, title=Dynamics of event-related causality (ERC) in brain electrical activity, author1=Korzeniewska, A., author3=Kus, R., author2=Crainiceanu, C., author4=Franaszczuk, P. J., author5=Crone, N. E., journal=Hum. Brain Mapp., volume=29, year=2008, pages=1170–1192, doi=10.1002/hbm.20458, pmid=17712784, issue=10, pmc=6870676 {{cite book , author1=Pfurtscheller, G., title=Event-Related Desynchronization , publisher=Elsevier , year=1999, chapter=Quantification of ERD and ERS in the time domain {{Cite journal, title=Volume conduction influences scalp-based connectivity estimates, author1=Brunner, C., author2=Billinger, M., author3=Seeber, M., author4=Mullen, T. R., author5=Makeig, S., journal=Front Comput Neurosci, doi=10.3389/fncom.2016.00121, pmid=27920674, pmc=5119053, volume=10, pages=121, year=2016, doi-access=free {{Cite journal, title=Directed Transfer Function is not influenced by volume conduction - inexpedient pre-processing should be avoided, author1=Kaminski, M., author2=Blinowska, K. J., journal=Front Comput Neurosci, doi=10.3389/fncom.2014.00061, pmid=24959136, pmc=4050361, volume=8, pages=61, year=2014, doi-access=free {{Cite journal, title=HERMES: towards an integrated toolbox to characterize functional and effective brain connectivity, author1=Niso, G., author2=Bruña, R., author3= Pereda, E., journal=Neuroinformatics, doi=10.1007/s12021-013-9186-1, pmid=23812847, volume=11, issue=4, pages=405–434, arxiv=1305.2550, year=2013, bibcode=2013arXiv1305.2550N, s2cid=1043710 {{Cite journal, title=The Influence of Volume Conduction on DTF Estimate and the Problem of Its Mitigation, author1=Kaminski, M., author2=Blinowska, K., journal=Front Comput Neurosci, volume=11, pages=36, year=2017, doi=10.3389/fncom.2017.00036, pmid=28553220, pmc=5427064, doi-access=free {{Cite journal, title=Critical Comments on EEG Sensor Space Dynamical Connectivity Analysis, author1=Van De Steen, F., author2=Faes, L., author3=Karahan, E., author4=Songsiri, J., author5=Valdes-Sosa, P. A., author6=Marinazzo, D., journal=Brain Topogr, volume=32, issue=4, pages=643–654, year=2016, doi=10.1007/s10548-016-0538-7, pmid=27905073, arxiv=1607.03687, bibcode=2016arXiv160703687V, s2cid=11095444External links
See also
*