Large-scale distributed computing for accelerated structure solution

K. Shankland, T.A.N. Griffin, J. van de Streek, Jared H. Cole, N. Shankland, A.J. Florence, W.I.F. David

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

Improvements in SDPD methodology have meant that ever more complex structures are being tackled using global optimisation methods. As a very general rule of thumb, the more complex the structure, the more difficult it is to locate the global minimum in the real-space search. This difficulty can, to some extent, be circumvented by running many instances of the search; for stochastic search methods such as simulated annealing, each instance can be run independently of any other. Such search methods are therefore ideally suited to disposition on a distributed grid-type system that makes use of existing networked compute resources. At the Rutherford Appleton Laboratory, the DASH structure solution code has been adapted to run on a Univa UD GridMP system in order to distribute simulated annealing runs across hundreds of computers simultaneously with excellent scaling. The principles outlined are applicable to other structure solution codes and to other grid-type systems, such as the widely used and freely available CONDOR system.
LanguageEnglish
Pages227-232
Number of pages5
JournalZeitschrift fur Kristallografie
Volume30
DOIs
Publication statusPublished - 2009

Fingerprint

simulated annealing
Distributed computer systems
Simulated annealing
grids
Global optimization
resources
methodology
scaling
optimization

Keywords

  • structure determination
  • powder diffraction
  • distributed computing
  • global optimisation
  • stochastic search

Cite this

Shankland, K., Griffin, T. A. N., van de Streek, J., Cole, J. H., Shankland, N., Florence, A. J., & David, W. I. F. (2009). Large-scale distributed computing for accelerated structure solution. Zeitschrift fur Kristallografie, 30, 227-232. https://doi.org/10.1524/zksu.2009.0033
Shankland, K. ; Griffin, T.A.N. ; van de Streek, J. ; Cole, Jared H. ; Shankland, N. ; Florence, A.J. ; David, W.I.F. / Large-scale distributed computing for accelerated structure solution. In: Zeitschrift fur Kristallografie. 2009 ; Vol. 30. pp. 227-232.
@article{73dbbc0bcccd468694048bd9cf4abb49,
title = "Large-scale distributed computing for accelerated structure solution",
abstract = "Improvements in SDPD methodology have meant that ever more complex structures are being tackled using global optimisation methods. As a very general rule of thumb, the more complex the structure, the more difficult it is to locate the global minimum in the real-space search. This difficulty can, to some extent, be circumvented by running many instances of the search; for stochastic search methods such as simulated annealing, each instance can be run independently of any other. Such search methods are therefore ideally suited to disposition on a distributed grid-type system that makes use of existing networked compute resources. At the Rutherford Appleton Laboratory, the DASH structure solution code has been adapted to run on a Univa UD GridMP system in order to distribute simulated annealing runs across hundreds of computers simultaneously with excellent scaling. The principles outlined are applicable to other structure solution codes and to other grid-type systems, such as the widely used and freely available CONDOR system.",
keywords = "structure determination, powder diffraction, distributed computing, global optimisation, stochastic search",
author = "K. Shankland and T.A.N. Griffin and {van de Streek}, J. and Cole, {Jared H.} and N. Shankland and A.J. Florence and W.I.F. David",
year = "2009",
doi = "10.1524/zksu.2009.0033",
language = "English",
volume = "30",
pages = "227--232",
journal = "Zeitschrift fur Kristallografie",
issn = "0044-2968",

}

Shankland, K, Griffin, TAN, van de Streek, J, Cole, JH, Shankland, N, Florence, AJ & David, WIF 2009, 'Large-scale distributed computing for accelerated structure solution' Zeitschrift fur Kristallografie, vol. 30, pp. 227-232. https://doi.org/10.1524/zksu.2009.0033

Large-scale distributed computing for accelerated structure solution. / Shankland, K.; Griffin, T.A.N.; van de Streek, J.; Cole, Jared H.; Shankland, N.; Florence, A.J.; David, W.I.F.

In: Zeitschrift fur Kristallografie, Vol. 30, 2009, p. 227-232.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Large-scale distributed computing for accelerated structure solution

AU - Shankland, K.

AU - Griffin, T.A.N.

AU - van de Streek, J.

AU - Cole, Jared H.

AU - Shankland, N.

AU - Florence, A.J.

AU - David, W.I.F.

PY - 2009

Y1 - 2009

N2 - Improvements in SDPD methodology have meant that ever more complex structures are being tackled using global optimisation methods. As a very general rule of thumb, the more complex the structure, the more difficult it is to locate the global minimum in the real-space search. This difficulty can, to some extent, be circumvented by running many instances of the search; for stochastic search methods such as simulated annealing, each instance can be run independently of any other. Such search methods are therefore ideally suited to disposition on a distributed grid-type system that makes use of existing networked compute resources. At the Rutherford Appleton Laboratory, the DASH structure solution code has been adapted to run on a Univa UD GridMP system in order to distribute simulated annealing runs across hundreds of computers simultaneously with excellent scaling. The principles outlined are applicable to other structure solution codes and to other grid-type systems, such as the widely used and freely available CONDOR system.

AB - Improvements in SDPD methodology have meant that ever more complex structures are being tackled using global optimisation methods. As a very general rule of thumb, the more complex the structure, the more difficult it is to locate the global minimum in the real-space search. This difficulty can, to some extent, be circumvented by running many instances of the search; for stochastic search methods such as simulated annealing, each instance can be run independently of any other. Such search methods are therefore ideally suited to disposition on a distributed grid-type system that makes use of existing networked compute resources. At the Rutherford Appleton Laboratory, the DASH structure solution code has been adapted to run on a Univa UD GridMP system in order to distribute simulated annealing runs across hundreds of computers simultaneously with excellent scaling. The principles outlined are applicable to other structure solution codes and to other grid-type systems, such as the widely used and freely available CONDOR system.

KW - structure determination

KW - powder diffraction

KW - distributed computing

KW - global optimisation

KW - stochastic search

U2 - 10.1524/zksu.2009.0033

DO - 10.1524/zksu.2009.0033

M3 - Article

VL - 30

SP - 227

EP - 232

JO - Zeitschrift fur Kristallografie

T2 - Zeitschrift fur Kristallografie

JF - Zeitschrift fur Kristallografie

SN - 0044-2968

ER -