Polarization-sensitive in-sensor computing in chiral organic integrated 2D p-n heterostructures for mixed-multimodal image processing
Abstract Sensor-based computing minimizes latency and energy consumption by processing data at the capture point, thereby eliminating extensive data transfer and enabling real-time decision-making. Here, we present a breakthrough in in-sensor computing via circularly polarized light detectors that i...
Saved in:
| Main Authors: | , , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Nature Portfolio
2025-05-01
|
| Series: | Nature Communications |
| Online Access: | https://doi.org/10.1038/s41467-025-59935-4 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850140571775008768 |
|---|---|
| author | Je-Jun Lee Seong-Jun Han Changsoon Choi Chaewon Seo Seungkwon Hwang Jihyun Kim Jung Pyo Hong Jisu Jang Jihoon Kyhm Jung Woo Kim Byoung-Soo Yu Jung Ah Lim Gunuk Wang Joohoon Kang Yonghun Kim Suk-kyun Ahn Jongtae Ahn Do Kyung Hwang |
| author_facet | Je-Jun Lee Seong-Jun Han Changsoon Choi Chaewon Seo Seungkwon Hwang Jihyun Kim Jung Pyo Hong Jisu Jang Jihoon Kyhm Jung Woo Kim Byoung-Soo Yu Jung Ah Lim Gunuk Wang Joohoon Kang Yonghun Kim Suk-kyun Ahn Jongtae Ahn Do Kyung Hwang |
| author_sort | Je-Jun Lee |
| collection | DOAJ |
| description | Abstract Sensor-based computing minimizes latency and energy consumption by processing data at the capture point, thereby eliminating extensive data transfer and enabling real-time decision-making. Here, we present a breakthrough in in-sensor computing via circularly polarized light detectors that integrate cholesteric liquid crystal reflectors with two-dimensional van der Waals p-n heterostructures. Our device exhibits a high dissymmetry factor (1.90), allowing effective separation of mixed circularly polarized images, along with a rapid photoresponse (4 μs) and wide linear dynamic range (up to 114.1 dB), suitable for analog multiply-and-accumulate operations in convolution-based in-sensor computing. Harnessing these detectors, we propose mixed-multimodal in-sensor computing using the chiral state of circularly polarized light to dynamically control responsivity, which enables the blending of two arbitrary image processing modes within a single, non-reconfigurable circuit. By effectively integrating polarization-sensitive detectors into the in-sensor computing framework, the proposed architecture preserves kernel optimization capabilities while simplifying circuit complexity. |
| format | Article |
| id | doaj-art-d9ea154c0faa4bf59a79b0d92356e696 |
| institution | OA Journals |
| issn | 2041-1723 |
| language | English |
| publishDate | 2025-05-01 |
| publisher | Nature Portfolio |
| record_format | Article |
| series | Nature Communications |
| spelling | doaj-art-d9ea154c0faa4bf59a79b0d92356e6962025-08-20T02:29:45ZengNature PortfolioNature Communications2041-17232025-05-0116111110.1038/s41467-025-59935-4Polarization-sensitive in-sensor computing in chiral organic integrated 2D p-n heterostructures for mixed-multimodal image processingJe-Jun Lee0Seong-Jun Han1Changsoon Choi2Chaewon Seo3Seungkwon Hwang4Jihyun Kim5Jung Pyo Hong6Jisu Jang7Jihoon Kyhm8Jung Woo Kim9Byoung-Soo Yu10Jung Ah Lim11Gunuk Wang12Joohoon Kang13Yonghun Kim14Suk-kyun Ahn15Jongtae Ahn16Do Kyung Hwang17Center of Quantum Technology, Post-Silicon Semiconductor Institute, Korea Institute of Science and Technology (KIST)Center of Quantum Technology, Post-Silicon Semiconductor Institute, Korea Institute of Science and Technology (KIST)Center of Quantum Technology, Post-Silicon Semiconductor Institute, Korea Institute of Science and Technology (KIST)School of Chemical Engineering, Pusan National UniversityEnergy and Environment Materials Research Division, Korea Institute of materials Science (KIMS)Department of Chemical and Biomolecular Engineering, Yonsei UniversityCenter of Quantum Technology, Post-Silicon Semiconductor Institute, Korea Institute of Science and Technology (KIST)Center of Quantum Technology, Post-Silicon Semiconductor Institute, Korea Institute of Science and Technology (KIST)Technology Support Center, Research Resources Division, Korea Institute of Science and Technology (KIST)Center of Quantum Technology, Post-Silicon Semiconductor Institute, Korea Institute of Science and Technology (KIST)Center of Quantum Technology, Post-Silicon Semiconductor Institute, Korea Institute of Science and Technology (KIST)Division of Nanoscience & Technology, KIST School, University of Science and Technology (UST)KU-KIST Graduate School of Converging Science and Technology, Korea UniversityDepartment of Chemical and Biomolecular Engineering, Yonsei UniversityEnergy and Environment Materials Research Division, Korea Institute of materials Science (KIMS)School of Chemical Engineering, Pusan National UniversityDepartment of Physics, Changwon National UniversityCenter of Quantum Technology, Post-Silicon Semiconductor Institute, Korea Institute of Science and Technology (KIST)Abstract Sensor-based computing minimizes latency and energy consumption by processing data at the capture point, thereby eliminating extensive data transfer and enabling real-time decision-making. Here, we present a breakthrough in in-sensor computing via circularly polarized light detectors that integrate cholesteric liquid crystal reflectors with two-dimensional van der Waals p-n heterostructures. Our device exhibits a high dissymmetry factor (1.90), allowing effective separation of mixed circularly polarized images, along with a rapid photoresponse (4 μs) and wide linear dynamic range (up to 114.1 dB), suitable for analog multiply-and-accumulate operations in convolution-based in-sensor computing. Harnessing these detectors, we propose mixed-multimodal in-sensor computing using the chiral state of circularly polarized light to dynamically control responsivity, which enables the blending of two arbitrary image processing modes within a single, non-reconfigurable circuit. By effectively integrating polarization-sensitive detectors into the in-sensor computing framework, the proposed architecture preserves kernel optimization capabilities while simplifying circuit complexity.https://doi.org/10.1038/s41467-025-59935-4 |
| spellingShingle | Je-Jun Lee Seong-Jun Han Changsoon Choi Chaewon Seo Seungkwon Hwang Jihyun Kim Jung Pyo Hong Jisu Jang Jihoon Kyhm Jung Woo Kim Byoung-Soo Yu Jung Ah Lim Gunuk Wang Joohoon Kang Yonghun Kim Suk-kyun Ahn Jongtae Ahn Do Kyung Hwang Polarization-sensitive in-sensor computing in chiral organic integrated 2D p-n heterostructures for mixed-multimodal image processing Nature Communications |
| title | Polarization-sensitive in-sensor computing in chiral organic integrated 2D p-n heterostructures for mixed-multimodal image processing |
| title_full | Polarization-sensitive in-sensor computing in chiral organic integrated 2D p-n heterostructures for mixed-multimodal image processing |
| title_fullStr | Polarization-sensitive in-sensor computing in chiral organic integrated 2D p-n heterostructures for mixed-multimodal image processing |
| title_full_unstemmed | Polarization-sensitive in-sensor computing in chiral organic integrated 2D p-n heterostructures for mixed-multimodal image processing |
| title_short | Polarization-sensitive in-sensor computing in chiral organic integrated 2D p-n heterostructures for mixed-multimodal image processing |
| title_sort | polarization sensitive in sensor computing in chiral organic integrated 2d p n heterostructures for mixed multimodal image processing |
| url | https://doi.org/10.1038/s41467-025-59935-4 |
| work_keys_str_mv | AT jejunlee polarizationsensitiveinsensorcomputinginchiralorganicintegrated2dpnheterostructuresformixedmultimodalimageprocessing AT seongjunhan polarizationsensitiveinsensorcomputinginchiralorganicintegrated2dpnheterostructuresformixedmultimodalimageprocessing AT changsoonchoi polarizationsensitiveinsensorcomputinginchiralorganicintegrated2dpnheterostructuresformixedmultimodalimageprocessing AT chaewonseo polarizationsensitiveinsensorcomputinginchiralorganicintegrated2dpnheterostructuresformixedmultimodalimageprocessing AT seungkwonhwang polarizationsensitiveinsensorcomputinginchiralorganicintegrated2dpnheterostructuresformixedmultimodalimageprocessing AT jihyunkim polarizationsensitiveinsensorcomputinginchiralorganicintegrated2dpnheterostructuresformixedmultimodalimageprocessing AT jungpyohong polarizationsensitiveinsensorcomputinginchiralorganicintegrated2dpnheterostructuresformixedmultimodalimageprocessing AT jisujang polarizationsensitiveinsensorcomputinginchiralorganicintegrated2dpnheterostructuresformixedmultimodalimageprocessing AT jihoonkyhm polarizationsensitiveinsensorcomputinginchiralorganicintegrated2dpnheterostructuresformixedmultimodalimageprocessing AT jungwookim polarizationsensitiveinsensorcomputinginchiralorganicintegrated2dpnheterostructuresformixedmultimodalimageprocessing AT byoungsooyu polarizationsensitiveinsensorcomputinginchiralorganicintegrated2dpnheterostructuresformixedmultimodalimageprocessing AT jungahlim polarizationsensitiveinsensorcomputinginchiralorganicintegrated2dpnheterostructuresformixedmultimodalimageprocessing AT gunukwang polarizationsensitiveinsensorcomputinginchiralorganicintegrated2dpnheterostructuresformixedmultimodalimageprocessing AT joohoonkang polarizationsensitiveinsensorcomputinginchiralorganicintegrated2dpnheterostructuresformixedmultimodalimageprocessing AT yonghunkim polarizationsensitiveinsensorcomputinginchiralorganicintegrated2dpnheterostructuresformixedmultimodalimageprocessing AT sukkyunahn polarizationsensitiveinsensorcomputinginchiralorganicintegrated2dpnheterostructuresformixedmultimodalimageprocessing AT jongtaeahn polarizationsensitiveinsensorcomputinginchiralorganicintegrated2dpnheterostructuresformixedmultimodalimageprocessing AT dokyunghwang polarizationsensitiveinsensorcomputinginchiralorganicintegrated2dpnheterostructuresformixedmultimodalimageprocessing |