|
4647 | 4647 | of Radiance Fields'
|
4648 | 4648 | authors: Mihnea-Bogdan Jurca, Remco Royen, Ion Giosan, Adrian Munteanu
|
4649 | 4649 | year: '2024'
|
4650 |
| - abstract: Gaussian Splatting has revolutionized the world of novel view synthesis |
| 4650 | + abstract: 'Gaussian Splatting has revolutionized the world of novel view synthesis |
4651 | 4651 | by achieving high rendering performance in real-time. Recently, studies have focused
|
4652 | 4652 | on enriching these 3D representations with semantic information for downstream
|
4653 | 4653 | tasks. In this paper, we introduce RT-GS2, the first generalizable semantic segmentation
|
|
4657 | 4657 | 3D Gaussian features in a self-supervised manner, followed by a novel View-Dependent
|
4658 | 4658 | / View-Independent (VDVI) feature fusion to enhance semantic consistency over
|
4659 | 4659 | different views. Extensive experimentation on three different datasets showcases
|
4660 |
| - RT-GS2's superiority over the state-of-the-art methods in semantic segmentation |
| 4660 | + RT-GS2''s superiority over the state-of-the-art methods in semantic segmentation |
4661 | 4661 | quality, exemplified by a 8.01% increase in mIoU on the Replica dataset. Moreover,
|
4662 | 4662 | our method achieves real-time performance of 27.03 FPS, marking an astonishing
|
4663 | 4663 | 901 times speedup compared to existing approaches. This work represents a significant
|
4664 | 4664 | advancement in the field by introducing, to the best of our knowledge, the first
|
4665 | 4665 | real-time generalizable semantic segmentation method for 3D Gaussian representations
|
4666 |
| - of radiance fields. The project page and implementation can be found at https://mbjurca.github.io/rt-gs2/. |
| 4666 | + of radiance fields. |
| 4667 | + |
| 4668 | + ' |
4667 | 4669 | project_page: https://mbjurca.github.io/rt-gs2/
|
4668 | 4670 | paper: https://arxiv.org/pdf/2405.18033.pdf
|
4669 | 4671 | code: https://github.com/mbjurca/RT_GS2
|
|
0 commit comments