• Open Access

Quantum Adaptive Agents with Efficient Long-Term Memories

Thomas J. Elliott, Mile Gu, Andrew J. P. Garner, and Jayne Thompson
Phys. Rev. X 12, 011007 – Published 11 January 2022

Abstract

Central to the success of adaptive systems is their ability to interpret signals from their environment and respond accordingly—they act as agents interacting with their surroundings. Such agents typically perform better when able to execute increasingly complex strategies. This comes with a cost: the more information the agent must recall from its past experiences, the more memory it will need. Here we investigate the power of agents capable of quantum information processing. We uncover the most general form a quantum agent need adopt to maximize memory compression advantages and provide a systematic means of encoding their memory states. We show these encodings can exhibit extremely favorable scaling advantages relative to memory-minimal classical agents, particularly when information must be retained about events increasingly far into the past.

  • Figure
  • Figure
  • Figure
  • Figure
  • Received 21 August 2020
  • Revised 5 October 2021
  • Accepted 2 November 2021

DOI:https://doi.org/10.1103/PhysRevX.12.011007

Published by the American Physical Society under the terms of the Creative Commons Attribution 4.0 International license. Further distribution of this work must maintain attribution to the author(s) and the published article’s title, journal citation, and DOI.

Published by the American Physical Society

Physics Subject Headings (PhySH)

Quantum Information, Science & TechnologyStatistical Physics & Thermodynamics

Authors & Affiliations

Thomas J. Elliott1,2,3,*, Mile Gu3,2,4,†, Andrew J. P. Garner5,3, and Jayne Thompson4,6,‡

  • 1Department of Mathematics, Imperial College London, London SW7 2AZ, United Kingdom
  • 2Complexity Institute, Nanyang Technological University, Singapore 637335
  • 3Nanyang Quantum Hub, School of Physical and Mathematical Sciences, Nanyang Technological University, Singapore 637371
  • 4Centre for Quantum Technologies, National University of Singapore, 3 Science Drive 2, Singapore 117543
  • 5Institute for Quantum Optics and Quantum Information, Austrian Academy of Sciences, Boltzmanngasse 3, Vienna 1090, Austria
  • 6Horizon Quantum Computing, 05-22 Alice@Mediapolis, 29 Media Circle, Singapore 138565

  • *physics@tjelliott.net
  • mgu@quantumcomplexity.org
  • thompson.jayne2@gmail.com

Popular Summary

To thrive in ever-changing environments, systems must be able to adapt their actions to respond appropriately to the stimuli they receive. These adaptive systems, or agents, exist at all scales, from microscopic bacteria to self-driving vehicles. Common to all is that they interact and compete with other agents, mounting a drive to develop and deploy increasingly complex strategies. This requires the agent to track ever more information about past and present events, imposing a performance bottleneck and making tools for efficient distillation of relevant information essential. We show that quantum processing can provide a competitive edge, by allowing agents to execute considerably more complex strategies than classical counterparts with access to the same memory capacity.

We pinpoint precisely which quantum effects are behind these advantages and what structures an agent should adopt to maximize efficiency, allowing them to execute more complex strategies with a smaller memory. We provide a systematic means of encoding strategies for quantum agents that harness these advantages. Moreover, we show that the quantum enhancement in efficiency can scale without bound.

The utility of these findings extends beyond the agents themselves. Agent-based modeling and adaptive systems permeate the quantitative sciences; our work highlights the beneficial role quantum technologies can play in these endeavors.

Key Image

Article Text

Click to Expand

References

Click to Expand
Issue

Vol. 12, Iss. 1 — January - March 2022

Subject Areas
Reuse & Permissions
Author publication services for translation and copyediting assistance advertisement

Authorization Required


×
×

Images

×

Sign up to receive regular email alerts from Physical Review X

Reuse & Permissions

It is not necessary to obtain permission to reuse this article or its components as it is available under the terms of the Creative Commons Attribution 4.0 International license. This license permits unrestricted use, distribution, and reproduction in any medium, provided attribution to the author(s) and the published article's title, journal citation, and DOI are maintained. Please note that some figures may have been included with permission from other third parties. It is your responsibility to obtain the proper permission from the rights holder directly for these figures.

×

Log In

Cancel
×

Search


Article Lookup

Paste a citation or DOI

Enter a citation
×