Dense structural expectation maximisation with parallelisation for efficient large-network structural inference

Christopher Fogelberg, Vasile Palade

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

Research on networks is increasingly popular in a wide range of machine learning fields, and structural inference of networks is a key problem. Unfortunately, network structural inference is time consuming and there is an increasing need to infer the structure of ever-larger networks. This article presents the Dense Structural Expectation Maximisation (DSEM) algorithm, a novel extension of the well-known SEM algorithm. DSEM increases the efficiency of structural inference by using the time-expensive calculations required in each SEM iteration more efficiently, and can be O(N) times faster than SEM, where N is the size of the network. The article has also combined DSEM with parallelisation and evaluated the impact of these improvements over SEM, individually and combined. The possibility of combining these novel approaches with other research on structural inference is also considered. The contributions also appear to be usable for all kinds of structural inference, and may greatly improve the range, variety and size of problems which can be tractably addressed. Code is freely available online at: http://syntilect.com/ cgf/pubs:software.

Original languageEnglish
Article number1350011
Number of pages20
JournalInternational Journal on Artificial Intelligence Tools
Volume22
Issue number3
DOIs
Publication statusPublished - Jun 2013
Externally publishedYes

Fingerprint

Scanning electron microscopy
Learning systems

Keywords

  • Bayesian networks
  • large networks
  • parallelisation
  • SEM
  • structural inference

ASJC Scopus subject areas

  • Artificial Intelligence

Cite this

@article{11a6b5c1c70a4b42ad230673e7bd1d65,
title = "Dense structural expectation maximisation with parallelisation for efficient large-network structural inference",
abstract = "Research on networks is increasingly popular in a wide range of machine learning fields, and structural inference of networks is a key problem. Unfortunately, network structural inference is time consuming and there is an increasing need to infer the structure of ever-larger networks. This article presents the Dense Structural Expectation Maximisation (DSEM) algorithm, a novel extension of the well-known SEM algorithm. DSEM increases the efficiency of structural inference by using the time-expensive calculations required in each SEM iteration more efficiently, and can be O(N) times faster than SEM, where N is the size of the network. The article has also combined DSEM with parallelisation and evaluated the impact of these improvements over SEM, individually and combined. The possibility of combining these novel approaches with other research on structural inference is also considered. The contributions also appear to be usable for all kinds of structural inference, and may greatly improve the range, variety and size of problems which can be tractably addressed. Code is freely available online at: http://syntilect.com/ cgf/pubs:software.",
keywords = "Bayesian networks, large networks, parallelisation, SEM, structural inference",
author = "Christopher Fogelberg and Vasile Palade",
year = "2013",
month = "6",
doi = "10.1142/S0218213013500115",
language = "English",
volume = "22",
journal = "International Journal on Artificial Intelligence Tools",
issn = "0218-2130",
publisher = "World Scientific",
number = "3",

}

TY - JOUR

T1 - Dense structural expectation maximisation with parallelisation for efficient large-network structural inference

AU - Fogelberg, Christopher

AU - Palade, Vasile

PY - 2013/6

Y1 - 2013/6

N2 - Research on networks is increasingly popular in a wide range of machine learning fields, and structural inference of networks is a key problem. Unfortunately, network structural inference is time consuming and there is an increasing need to infer the structure of ever-larger networks. This article presents the Dense Structural Expectation Maximisation (DSEM) algorithm, a novel extension of the well-known SEM algorithm. DSEM increases the efficiency of structural inference by using the time-expensive calculations required in each SEM iteration more efficiently, and can be O(N) times faster than SEM, where N is the size of the network. The article has also combined DSEM with parallelisation and evaluated the impact of these improvements over SEM, individually and combined. The possibility of combining these novel approaches with other research on structural inference is also considered. The contributions also appear to be usable for all kinds of structural inference, and may greatly improve the range, variety and size of problems which can be tractably addressed. Code is freely available online at: http://syntilect.com/ cgf/pubs:software.

AB - Research on networks is increasingly popular in a wide range of machine learning fields, and structural inference of networks is a key problem. Unfortunately, network structural inference is time consuming and there is an increasing need to infer the structure of ever-larger networks. This article presents the Dense Structural Expectation Maximisation (DSEM) algorithm, a novel extension of the well-known SEM algorithm. DSEM increases the efficiency of structural inference by using the time-expensive calculations required in each SEM iteration more efficiently, and can be O(N) times faster than SEM, where N is the size of the network. The article has also combined DSEM with parallelisation and evaluated the impact of these improvements over SEM, individually and combined. The possibility of combining these novel approaches with other research on structural inference is also considered. The contributions also appear to be usable for all kinds of structural inference, and may greatly improve the range, variety and size of problems which can be tractably addressed. Code is freely available online at: http://syntilect.com/ cgf/pubs:software.

KW - Bayesian networks

KW - large networks

KW - parallelisation

KW - SEM

KW - structural inference

U2 - 10.1142/S0218213013500115

DO - 10.1142/S0218213013500115

M3 - Article

VL - 22

JO - International Journal on Artificial Intelligence Tools

JF - International Journal on Artificial Intelligence Tools

SN - 0218-2130

IS - 3

M1 - 1350011

ER -