Exponential random graph models

Exponential family random graph models (ERGMs) are a family of statistical models for analyzing data from social and other networks. Examples of networks examined using ERGM include knowledge networks, organizational networks, colleague networks, social media networks, networks of scientific development, and others.

Background

Many metrics exist to describe the structural features of an observed network such as the density, centrality, or assortativity. However, these metrics describe the observed network which is only one instance of a large number of possible alternative networks. This set of alternative networks may have similar or dissimilar structural features. To support statistical inference on the processes influencing the formation of network structure, a statistical model should consider the set of all possible alternative networks weighted on their similarity to an observed network. However because network data is inherently relational, it violates the assumptions of independence and identical distribution of standard statistical models like linear regression. Alternative statistical models should reflect the uncertainty associated with a given observation, permit inference about the relative frequency about network substructures of theoretical interest, disambiguating the influence of confounding processes, efficiently representing complex structures, and linking local-level processes to global-level properties. Degree-preserving randomization, for example, is a specific way in which an observed network could be considered in terms of multiple alternative networks.

Definition

The Exponential family is a broad family of models for covering many types of data, not just networks. An ERGM is a model from this family which describes networks.

Formally a random graph $Y \in \mathcal$ consists of a set of $n$ nodes and $m$ dyads (edges) $\$ where $Y_=1$ if the nodes $(i,j)$ are connected and $Y_=0$ otherwise.

The basic assumption of these models is that the structure in an observed graph $y$ can be explained by a given vector of sufficient statistics $s(y)$ which are a function of the observed network and, in some cases, nodal attributes. This way, it is possible to describe any kind of dependence between the undyadic variables:

$P(Y = y , \theta) = \frac,\quad\forall y\in\mathcal$

where $\theta$ is a vector of model parameters associated with $s(y)$ and $c(\theta) = \sum_\exp(\theta^ s(y'))$ is a normalising constant.

These models represent a probability distribution on each possible network on $n$ nodes. However, the size of the set of possible networks for an undirected network (simple graph) of size $n$ is $2^$. Because the number of possible networks in the set vastly outnumbers the number of parameters which can constrain the model, the ideal probability distribution is the one which maximizes the Gibbs entropy.

References

Further reading

*
*
*
*
*
*
*Harris, Jenine K (2014). An introduction to exponential random graph modeling. Sage.
*
*
*
*
*
*
*
*
*
*
*
*
*
*
*
*{{cite journal, last1=van Duijn , first1=M. A. J. , last2=Gile , first2=K. J. , author2-link = Krista Gile , last3=Handcock , first3=M. S. , year=2009 , title=A framework for the comparison of maximum pseudo-likelihood and maximum likelihood estimation of exponential family random graph models , journal=Social Networks , volume=31 , issue=1 , pages=52–62 , doi=10.1016/j.socnet.2008.10.003, pmid=23170041 , pmc=3500576

Network theory