Combinatorial optimization with physics-inspired graph neural networks
Abstract
Combinatorial optimization problems are pervasive across science and industry. Modern deep learning tools are poised to solve these problems at unprecedented scales, but a unifying framework that incorporates insights from statistical physics is still outstanding. Here we demonstrate how graph neural networks can be used to solve combinatorial optimization problems. Our approach is broadly applicable to canonical NP-hard problems in the form of quadratic unconstrained binary optimization problems, such as maximum cut, minimum vertex cover, maximum independent set, as well as Ising spin glasses and higher-order generalizations thereof in the form of polynomial unconstrained binary optimization problems. We apply a relaxation strategy to the problem Hamiltonian to generate a differentiable loss function with which we train the graph neural network and apply a simple projection to integer variables once the unsupervised training process has completed. We showcase our approach with numerical results for the canonical maximum cut and maximum independent set problems. We find that the graph neural network optimizer performs on par or outperforms existing solvers, with the ability to scale beyond the state of the art to problems with millions of variables.
Additional Information
© 2022 Nature Publishing Group. Received 09 July 2021; Accepted 21 February 2022; Published 21 April 2022. We thank F. Brandao, G. Karypis, M. Kastoryano, E. Kessler, T. Mullenbach, N. Pancotti, M. Resende, S. Roy, G. Salton, S. Severini, A. Urweisse and J. Zhu for fruitful discussions. Data availability: The data necessary to reproduce our numerical benchmark results are publicly available at https://web.stanford.edu/~yyye/yyye/Gset/. Random d-regular graphs have been generated using the open-source networkx library (https://networkx.org). Code availability: An end-to-end open source demo version of the code implementing our approach has been made publicly available at https://github.com/amazon-research/co-with-gnns-example. Contributions: All authors contributed to the ideation and design of the research. M.J.A.S. and J.K.B. developed and ran the computational experiments and also wrote the initial draft of the the manuscript. H.G.K. supervised this work and revised the manuscript. Competing interests: M.J.A.S., J.K.B. and H.G.K. are listed as inventors on a US provisional patent application (no. 7924-38500) on combinatorial optimization with graph neural networks. Peer review information: Nature Machine Intelligence thanks Thomas Vandal and Estelle Inack for their contribution to the peer review of this work.Attached Files
Accepted Version - 2107.01188.pdf
Supplemental Material - 42256_2022_468_MOESM1_ESM.pdf
Files
Name | Size | Download all |
---|---|---|
md5:82358986eb2e1439be072468e0c5349a
|
702.6 kB | Preview Download |
md5:f91d44f137a104a9ea3c54f22945d2aa
|
2.7 MB | Preview Download |
Additional details
- Eprint ID
- 114595
- Resolver ID
- CaltechAUTHORS:20220505-181556200
- Created
-
2022-05-05Created from EPrint's datestamp field
- Updated
-
2022-05-05Created from EPrint's last_modified field
- Caltech groups
- AWS Center for Quantum Computing