Electromagnetic metamaterial agent
Abstract Metamaterials have revolutionized wave control; in the last two decades, they evolved from passive devices via programmable devices to sensor-endowed self-adaptive devices realizing a user-specified functionality. Although deep-learning techniques play an increasingly important role in meta...
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Nature Publishing Group
2025-01-01
|
| Series: | Light: Science & Applications |
| Online Access: | https://doi.org/10.1038/s41377-024-01678-w |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841559109899386880 |
|---|---|
| author | Shengguo Hu Mingyi Li Jiawen Xu Hongrui Zhang Shanghang Zhang Tie Jun Cui Philipp del Hougne Lianlin Li |
| author_facet | Shengguo Hu Mingyi Li Jiawen Xu Hongrui Zhang Shanghang Zhang Tie Jun Cui Philipp del Hougne Lianlin Li |
| author_sort | Shengguo Hu |
| collection | DOAJ |
| description | Abstract Metamaterials have revolutionized wave control; in the last two decades, they evolved from passive devices via programmable devices to sensor-endowed self-adaptive devices realizing a user-specified functionality. Although deep-learning techniques play an increasingly important role in metamaterial inverse design, measurement post-processing and end-to-end optimization, their role is ultimately still limited to approximating specific mathematical relations; the metamaterial is still limited to serving as proxy of a human operator, realizing a predefined functionality. Here, we propose and experimentally prototype a paradigm shift toward a metamaterial agent (coined metaAgent) endowed with reasoning and cognitive capabilities enabling the autonomous planning and successful execution of diverse long-horizon tasks, including electromagnetic (EM) field manipulations and interactions with robots and humans. Leveraging recently released foundation models, metaAgent reasons in high-level natural language, acting upon diverse prompts from an evolving complex environment. Specifically, metaAgent’s cerebrum performs high-level task planning in natural language via a multi-agent discussion mechanism, where agents are domain experts in sensing, planning, grounding, and coding. In response to live environmental feedback within a real-world setting emulating an ambient-assisted living context (including human requests in natural language), our metaAgent prototype self-organizes a hierarchy of EM manipulation tasks in conjunction with commanding a robot. metaAgent masters foundational EM manipulation skills related to wireless communications and sensing, and it memorizes and learns from past experience based on human feedback. |
| format | Article |
| id | doaj-art-f9511614c76b427291dcbe82c5a2463e |
| institution | Kabale University |
| issn | 2047-7538 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | Nature Publishing Group |
| record_format | Article |
| series | Light: Science & Applications |
| spelling | doaj-art-f9511614c76b427291dcbe82c5a2463e2025-01-05T12:46:52ZengNature Publishing GroupLight: Science & Applications2047-75382025-01-0114111310.1038/s41377-024-01678-wElectromagnetic metamaterial agentShengguo Hu0Mingyi Li1Jiawen Xu2Hongrui Zhang3Shanghang Zhang4Tie Jun Cui5Philipp del Hougne6Lianlin Li7State Key Laboratory of Advanced Optical Communication Systems and Networks, School of Electronics, Peking UniversityState Key Laboratory of Advanced Optical Communication Systems and Networks, School of Electronics, Peking UniversityState Key Laboratory of Advanced Optical Communication Systems and Networks, School of Electronics, Peking UniversityState Key Laboratory of Advanced Optical Communication Systems and Networks, School of Electronics, Peking UniversityNational Key Laboratory for Multimedia Information Processing, School of Computer Science, Peking UniversityState Key Laboratory of Millimeter Waves, Southeast UniversityUniv Rennes, CNRS, IETR - UMR 6164State Key Laboratory of Advanced Optical Communication Systems and Networks, School of Electronics, Peking UniversityAbstract Metamaterials have revolutionized wave control; in the last two decades, they evolved from passive devices via programmable devices to sensor-endowed self-adaptive devices realizing a user-specified functionality. Although deep-learning techniques play an increasingly important role in metamaterial inverse design, measurement post-processing and end-to-end optimization, their role is ultimately still limited to approximating specific mathematical relations; the metamaterial is still limited to serving as proxy of a human operator, realizing a predefined functionality. Here, we propose and experimentally prototype a paradigm shift toward a metamaterial agent (coined metaAgent) endowed with reasoning and cognitive capabilities enabling the autonomous planning and successful execution of diverse long-horizon tasks, including electromagnetic (EM) field manipulations and interactions with robots and humans. Leveraging recently released foundation models, metaAgent reasons in high-level natural language, acting upon diverse prompts from an evolving complex environment. Specifically, metaAgent’s cerebrum performs high-level task planning in natural language via a multi-agent discussion mechanism, where agents are domain experts in sensing, planning, grounding, and coding. In response to live environmental feedback within a real-world setting emulating an ambient-assisted living context (including human requests in natural language), our metaAgent prototype self-organizes a hierarchy of EM manipulation tasks in conjunction with commanding a robot. metaAgent masters foundational EM manipulation skills related to wireless communications and sensing, and it memorizes and learns from past experience based on human feedback.https://doi.org/10.1038/s41377-024-01678-w |
| spellingShingle | Shengguo Hu Mingyi Li Jiawen Xu Hongrui Zhang Shanghang Zhang Tie Jun Cui Philipp del Hougne Lianlin Li Electromagnetic metamaterial agent Light: Science & Applications |
| title | Electromagnetic metamaterial agent |
| title_full | Electromagnetic metamaterial agent |
| title_fullStr | Electromagnetic metamaterial agent |
| title_full_unstemmed | Electromagnetic metamaterial agent |
| title_short | Electromagnetic metamaterial agent |
| title_sort | electromagnetic metamaterial agent |
| url | https://doi.org/10.1038/s41377-024-01678-w |
| work_keys_str_mv | AT shengguohu electromagneticmetamaterialagent AT mingyili electromagneticmetamaterialagent AT jiawenxu electromagneticmetamaterialagent AT hongruizhang electromagneticmetamaterialagent AT shanghangzhang electromagneticmetamaterialagent AT tiejuncui electromagneticmetamaterialagent AT philippdelhougne electromagneticmetamaterialagent AT lianlinli electromagneticmetamaterialagent |