iCVTEAM.github.io/See-NeRF.html at master · iCVTEAM/iCVTEAM.github.io · GitHub

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
<!DOCTYPE html>
<html>
  <head>
    <meta charset="utf-8">
    <title>See-NeRF</title>
    <link rel="stylesheet" type="text/css" href="assets/scripts/bulma.min.css">
    <link rel="stylesheet" type="text/css" href="assets/scripts/theme.css">
    <link rel="stylesheet" type="text/css" href="https://cdn.bootcdn.net/ajax/libs/font-awesome/4.7.0/css/font-awesome.min.css">
  </head>
  <body>
    <section class="hero is-light" style="">
      <div class="hero-body" style="padding-top: 50px;">
        <div class="container" style="text-align: center;margin-bottom:5px;">
          <h1 class="title">
           <br> Seeing through Light and Darkness: Sensor-Physics Grounded Deblurring HDR<br>
            NeRF from Single-Exposure Images and Events </p>
          </h1>
          <div class="author"><p  style="font-size: 22px">
            Yunshan Qi<sup>1</sup> &nbsp&nbsp&nbsp&nbsp&nbsp Lin Zhu<sup>2 *</sup> &nbsp&nbsp&nbsp&nbsp&nbsp Nan Bao<sup>1</sup> &nbsp&nbsp&nbsp&nbsp&nbsp Yifan Zhao<sup>1</sup> &nbsp&nbsp&nbsp&nbsp&nbsp Jia Li<sup>1 *</sup></p></div>
          <div class="aff">
            <p style="font-size: 20px"><sup>1</sup>Beihang University &nbsp&nbsp&nbsp&nbsp&nbsp <sup>2</sup>Beijing Normal University
            <p> </p>
          </div>
          <div class="group"><p  style="font-size: 22px"><a href="http://cvteam.buaa.edu.cn/"><sup>*</sup>CVTEAM</a></p></div>
          <div class="con">
            <p  style="font-size: 24px; margin-top:5px; margin-bottom: 15px;">
            <b>Accepted by Conference on Computer Vision and Pattern Recognition (<span style="color: red;">CVPR Highlight</span>) 2026</b>
            </p>
          </div>
          <div class="columns">
            <div class="column"></div>
            <div class="column"></div>
            <!--div class="column">
              <a href="assets/E2NeRF/Papers.pdf" target="_blank">
                <p class="link"  style="font-size: 24px; margin-top:5px; margin-bottom: 15px;">[Paper]</p>
              </a>
            </-->
            <div class="column">
              <a href="https://arxiv.org/abs/2601.15475" target="_blank">
                <p class="link"  style="font-size: 24px; margin-top:5px; margin-bottom: 15px;">[Arxiv]</p>
              </a>
            </div>
            <div class="column">
              <a href="https://github.com/iCVTEAM/See-NeRF" target="_blank">
                <p class="link"  style="font-size: 24px; margin-top:5px; margin-bottom: 15px;">[Code]</p>
              </a>
            </div>
            <div class="column">
              <a href="https://github.com/iCVTEAM/See-NeRF" target="_blank">
                <p class="link"  style="font-size: 24px; margin-top:5px; margin-bottom: 15px;">[Dataset]</p>
              </a>
            </div>
            <div class="column"></div>
            <div class="column"></div>
          </div>
        </div>
      </div>
    </section>

    <div style="text-align: center;">
      <div class="head_cap">
        <p style="font-size: 22px">
          <b>The Framework of See-NeRF</b>
        </p>
      </div>
      <div class="container" style="max-width:850px">
        <div style="text-align: center;">
          <img src="./assets/See-NeRF/method.png" class="centerImage">
        </div>
      </div>
    </div>

        <div style="text-align: center;">
      <div class="head_cap">
        <p style="font-size: 22px">
          <b>The Results of See-NeRF</b>
        </p>
      </div>
      <div class="container" style="max-width:850px">
        <div style="text-align: center;">
          <img src="./assets/See-NeRF/gif.gif" class="centerImage">
        </div>
      </div>
    </div>

    <section class="hero">
      <div class="hero-body">
        <div class="container" style="max-width: 850px" >
          <h1 style="">Abstract</h1>
          <p  style="text-align: justify; font-size: 16px;">
            Novel view synthesis from low dynamic range (LDR) blurry images, which are common in the wild, struggles to recover high dynamic range (HDR) and sharp 3D representations in extreme lighting conditions.
            Although existing methods employ event data to address this issue, they ignore the sensor-physics mismatches between the camera output and physical world radiance, resulting in suboptimal HDR and deblurring results.
            To cope with this problem, we propose a unified sensor-physics grounded NeRF framework for sharp HDR novel view synthesis from single-exposure blurry LDR images and corresponding events.
            We employ NeRF to directly represent the actual radiance of the 3D scene in the HDR domain and model raw HDR scene rays hitting the sensor pixels as in the physical world.
            A 2D pixel-wise RGB CRF model is introduced to align the NeRF rendered pixel values with the sensor-recorded LDR pixel values of the input images.
            A novel event CRF model is also designed to bridge the gap between physical scene dynamics and event sensor output.
            The two models are jointly optimized with the NeRF network, leveraging the spatial and temporal dynamic information in events to enhance the sharp HDR 3D representation learning.
            Experiments on the collected and public datasets demonstrate that our method achieves state-of-the-art HDR and deblurring novel view synthesis results with single-exposure blurry LDR images and corresponding events.
          </p>
        </div>
      </div>
    </section>


    <section class="hero">
      <div class="hero-body">
        <div class="container" style="max-width:850px;margin-bottom:10px;" >
          <h1 style="">Supplementary Video</h1>
        </div>

        <div class="container" style="max-width:850px">
          <div style="text-align: center;">
            <iframe width="800" height="450" src="https://www.youtube.com/embed/F4NJzti-JqU?si=DhDit6NhCt1WFxzK" title="YouTube video player" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" referrerpolicy="strict-origin-when-cross-origin" allowfullscreen></iframe>
          </div>
        </div>

    </section>


    <section class="hero is-light" style="background-color:#FFFFFF;">
      <div class="hero-body">

        <div class="container" style="max-width:850px;margin-bottom:10px;">
          <h1>
            The Motivation of See-NeRF
          </h1>
        </div>
        <div class="container" style="max-width:850px">
          <div style="text-align: center;">
            <img src="./assets/See-NeRF/motivation.png" class="centerImage">
          </div>
        </div>

        <div class="container" style="max-width:850px;margin-bottom:10px;">
          <h1>
            Qualitative Comparison on the HDR NVS Task
          </h1>
        </div>
        <div class="container" style="max-width:850px">
          <div style="text-align: center;">
            <img src="./assets/See-NeRF/hdr.png" class="centerImage">
          </div>
        </div>

        <div class="container" style="max-width:850px;margin-bottom:10px;">
          <h1>
            Qualitative Comparison on the Novel Exposure NVS Task
          </h1>
        </div>
        <div class="container" style="max-width:850px">
          <div style="text-align: center;">
            <img src="./assets/See-NeRF/novel_exposure.png" class="centerImage">
          </div>
        </div>

        <div class="container" style="max-width:850px;margin-bottom:10px;">
          <h1>
            Qualitative Comparison on the Deblurring NVS Task
          </h1>
        </div>
        <div class="container" style="max-width:850px">
          <div style="text-align: center;">
            <img src="./assets/See-NeRF/deblurring.png" class="centerImage">
          </div>
        </div>

      </div>
    </section>

    <section class="hero" style="padding-top:0px;">
      <div class="hero-body">
        <div class="container" style="max-width:850px;">
      <div class="card"-->
      <!--header class="card-header">
        <p class="card-header-title">
          BibTex Citation
        </p>
        <a class="card-header-icon button-clipboard" style="border:0px; background: inherit;" data-clipboard-target="#bibtex-info" >
          <i class="fa fa-copy" height="20px"></i>
        </a>
      </header>
      <div class="card-content">
        <pre style="background-color:inherit;padding: 0px;" id="bibtex-info">@article{Ma_Xia_Li_2021,
          title={Pyramidal Feature Shrinking for Salient Object Detection},
          volume={35},
          url={https://ojs.aaai.org/index.php/AAAI/article/view/16331},
          number={3},
          journal={Proceedings of the AAAI Conference on Artificial Intelligence},
          author={Ma, Mingcan and Xia, Changqun and Li, Jia},
          year={2021},
          month={May},
          pages={2311-2318}
        }</pre-->
      </div>
    </section>
    <script type="text/javascript" src="assets/scripts/clipboard.min.js"></script>
    <script>
      new ClipboardJS('.button-clipboard');
    </script>
  </body>
</html>