Recovering a sequence of clear frames from a single motion-blurred image using correlation image sensor and temporal progressive learning strategy
Motion-blurred images are the result of an integration process, where instant light intensity is accumulated over the exposure time. Unfortunately, reversing this process is nontrivial. Firstly, integration destroys the temporal ordering of motion, resulting in ambiguity in the motion direction with...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Taylor & Francis Group
2025-12-01
|
| Series: | SICE Journal of Control, Measurement, and System Integration |
| Subjects: | |
| Online Access: | http://dx.doi.org/10.1080/18824889.2025.2466294 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850229680401022976 |
|---|---|
| author | Pan Wang Toru Kurihara |
| author_facet | Pan Wang Toru Kurihara |
| author_sort | Pan Wang |
| collection | DOAJ |
| description | Motion-blurred images are the result of an integration process, where instant light intensity is accumulated over the exposure time. Unfortunately, reversing this process is nontrivial. Firstly, integration destroys the temporal ordering of motion, resulting in ambiguity in the motion direction within a single motion-blurred image. Secondly, unlike conventional single-image deblurring, restoring a sequence of frames can divert the neural network's attention to each individual frame, which results in a decrease in the overall restoration quality of the entire sequence. To address the first problem, we leverage a crucial clue: the correlation image, generated by the three-phase correlation image sensor (3PCIS). This image effectively expresses motion information over the exposure time, which is essential for determining the motion direction of moving objects. We design a two-stream network to restore a sequence of sharp frames from a pair of motion-blurred images and their corresponding correlation images. For the second problem, we propose a temporal progressive learning (TPL) strategy that mitigates the performance degradation caused by network distraction by gradually increasing the number of restored clear frames during training. Experimental results demonstrate that our proposed method surpasses previous state-of-the-art methods on the GoPro public dataset and in real scenes. |
| format | Article |
| id | doaj-art-0db56c7f1b9d430ba8ef1b065d36c2c6 |
| institution | OA Journals |
| issn | 1884-9970 |
| language | English |
| publishDate | 2025-12-01 |
| publisher | Taylor & Francis Group |
| record_format | Article |
| series | SICE Journal of Control, Measurement, and System Integration |
| spelling | doaj-art-0db56c7f1b9d430ba8ef1b065d36c2c62025-08-20T02:04:07ZengTaylor & Francis GroupSICE Journal of Control, Measurement, and System Integration1884-99702025-12-0118110.1080/18824889.2025.24662942466294Recovering a sequence of clear frames from a single motion-blurred image using correlation image sensor and temporal progressive learning strategyPan Wang0Toru Kurihara1Kochi University of TechnologyKochi University of TechnologyMotion-blurred images are the result of an integration process, where instant light intensity is accumulated over the exposure time. Unfortunately, reversing this process is nontrivial. Firstly, integration destroys the temporal ordering of motion, resulting in ambiguity in the motion direction within a single motion-blurred image. Secondly, unlike conventional single-image deblurring, restoring a sequence of frames can divert the neural network's attention to each individual frame, which results in a decrease in the overall restoration quality of the entire sequence. To address the first problem, we leverage a crucial clue: the correlation image, generated by the three-phase correlation image sensor (3PCIS). This image effectively expresses motion information over the exposure time, which is essential for determining the motion direction of moving objects. We design a two-stream network to restore a sequence of sharp frames from a pair of motion-blurred images and their corresponding correlation images. For the second problem, we propose a temporal progressive learning (TPL) strategy that mitigates the performance degradation caused by network distraction by gradually increasing the number of restored clear frames during training. Experimental results demonstrate that our proposed method surpasses previous state-of-the-art methods on the GoPro public dataset and in real scenes.http://dx.doi.org/10.1080/18824889.2025.2466294correlation image sensormotion blurtemporal super-resolutiontwo-stream networkprogressive learning |
| spellingShingle | Pan Wang Toru Kurihara Recovering a sequence of clear frames from a single motion-blurred image using correlation image sensor and temporal progressive learning strategy SICE Journal of Control, Measurement, and System Integration correlation image sensor motion blur temporal super-resolution two-stream network progressive learning |
| title | Recovering a sequence of clear frames from a single motion-blurred image using correlation image sensor and temporal progressive learning strategy |
| title_full | Recovering a sequence of clear frames from a single motion-blurred image using correlation image sensor and temporal progressive learning strategy |
| title_fullStr | Recovering a sequence of clear frames from a single motion-blurred image using correlation image sensor and temporal progressive learning strategy |
| title_full_unstemmed | Recovering a sequence of clear frames from a single motion-blurred image using correlation image sensor and temporal progressive learning strategy |
| title_short | Recovering a sequence of clear frames from a single motion-blurred image using correlation image sensor and temporal progressive learning strategy |
| title_sort | recovering a sequence of clear frames from a single motion blurred image using correlation image sensor and temporal progressive learning strategy |
| topic | correlation image sensor motion blur temporal super-resolution two-stream network progressive learning |
| url | http://dx.doi.org/10.1080/18824889.2025.2466294 |
| work_keys_str_mv | AT panwang recoveringasequenceofclearframesfromasinglemotionblurredimageusingcorrelationimagesensorandtemporalprogressivelearningstrategy AT torukurihara recoveringasequenceofclearframesfromasinglemotionblurredimageusingcorrelationimagesensorandtemporalprogressivelearningstrategy |