Svoboda | Graniru | BBC Russia | Golosameriki | Facebook

Software Rasterization of 2 Billion Points in Real Time

Authors:

Markus Schütz,

Bernhard Kerbl,

Michael WimmerAuthors Info & Claims

Proceedings of the ACM on Computer Graphics and Interactive Techniques, Volume 5, Issue 3

Article No.: 24, Pages 1 - 17

https://doi.org/10.1145/3543863

Published: 27 July 2022 Publication History

Abstract

The accelerated collection of detailed real-world 3D data in the form of ever-larger point clouds is sparking a demand for novel visualization techniques that are capable of rendering billions of point primitives in real-time. We propose a software rasterization pipeline for point clouds that is capable of rendering up to two billion points in real-time (60 FPS) on commodity hardware. Improvements over the state of the art are achieved by batching points, enabling a number of batch-level optimizations before rasterizing them within the same rendering pass. These optimizations include frustum culling, level-of-detail (LOD) rendering, and choosing the appropriate coordinate precision for a given batch of points directly within a compute workgroup. Adaptive coordinate precision, in conjunction with visibility buffers, reduces the required data for the majority of points to just four bytes, making our approach several times faster than the bandwidth-limited state of the art. Furthermore, support for LOD rendering makes our software rasterization approach suitable for rendering arbitrarily large point clouds, and to meet the elevated performance demands of virtual reality applications.

References

[1]

Pascal Bormann and Michel Krämer. 2020. A System for Fast and Scalable Point Cloud Indexing Using Task Parallelism. In Smart Tools and Apps for Graphics - Eurographics Italian Chapter Conference, Silvia Biasotti, Ruggero Pintus, and Stefano Berretti (Eds.). The Eurographics Association. https://doi.org/10.2312/stag.20201250

[2]

Mario Botsch, Andreas Wiratanaya, and Leif Kobbelt. 2002. Efficient High Quality Rendering of Point Sampled Geometry. In Proceedings of the 13th Eurographics Workshop on Rendering (Pisa, Italy) (EGRW '02). Eurographics Association, Goslar, DEU, 53--64.

Digital Library

[3]

Christopher A. Burns and Warren A. Hunt. 2013. The Visibility Buffer: A Cache-Friendly Approach to Deferred Shading. Journal of Computer Graphics Techniques (JCGT) 2, 2 (2013), 55--69. http://jcgt.org/published/0002/02/04/

[4]

Carsten Dachsbacher, Christian Vogelgsang, and Marc Stamminger. 2003. Sequential Point Trees. ACM Trans. Graph. 22, 3 (2003), 657--662. https://doi.org/10.1145/882262.882321

Digital Library

[5]

Michael Deering. 1995. Geometry compression. In Proceedings of the 22nd annual conference on Computer graphics and interactive techniques. 13--20.

Digital Library

[6]

Jan Elseberg, Dorit Borrmann, and Andreas Nüchter. 2013. One billion points in the cloud - an octree for efficient processing of 3D laser scans. ISPRS Journal of Photogrammetry and Remote Sensing 76 (2013), 76 - 88. https://doi.org/10.1016/j.isprsjprs.2012.10.004 Terrestrial 3D modelling.

[7]

Alex Evans. 2015. Learning from failure: A Survey of Promising, Unconventional and Mostly Abandoned Renderers for 'Dreams PS4', a Geometrically Dense, Painterly UGC Game. In ACM SIGGRAPH 2015 Courses, Advances in Real-Time Rendering in Games. http://media.lolrus.mediamolecule.com/AlexEvans_SIGGRAPH-2015.pdf [Accessed 7-June-2022].

[8]

V. A. Frolov, V. A. Galaktionov, and B. H. Barladyan. 2020. Comparative study of high performance software rasterization techniques. Mathematica Montisnigri 47 (2020), 152--175. https://doi.org/10.20948/mathmontis-2020-47-13

[9]

Enrico Gobbetti and Fabio Marton. 2004. Layered Point Clouds: A Simple and Efficient Multiresolution Structure for Distributing and Rendering Gigantic Point-sampled Models. Comput. Graph. 28, 6 (2004), 815--826.

Digital Library

[10]

P. Goswami, Y. Zhang, R. Pajarola, and E. Gobbetti. 2010. High Quality Interactive Rendering of Massive Point Models Using Multi-way kd-Trees. In 2010 18th Pacific Conference on Computer Graphics and Applications. 93--100.

[11]

Jeffrey P Grossman and William J Dally. 1998. Point sample rendering. In Eurographics Workshop on Rendering Techniques. Springer, 181--192.

[12]

Christian Günther, Thomas Kanzok, Lars Linsen, and Paul Rosenthal. 2013. A GPGPU-based Pipeline for Accelerated Rendering of Point Clouds. J. WSCG 21 (2013), 153--161.

[13]

U. Herbig, L. Stampfer, D. Grandits, I. Mayer, M. Pöchtrager, Ikaputra, and A. Setyastuti. 2019. DEVELOPING A MONITORING WORKFLOW FOR THE TEMPLES OF JAVA. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences XLII-2/W15 (2019), 555--562. https://doi.org/10.5194/isprs-archives-XLII-2-W15-555-2019

[14]

Matthias Hollander, Tobias Ritschel, Elmar Eisemann, and Tamy Boubekeur. 2011. ManyLoDs: Parallel Many-View Level-of-Detail Selection for Real-Time Global Illumination. Computer Graphics Forum 30, 4 (2011), 1233--1240. https://doi.org/10.1111/j.1467-8659.2011.01982.x arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1111/j.1467-8659.2011.01982.x

Digital Library

[15]

Martin Isenburg. 2013. LASzip: lossless compression of LiDAR data. Photogrammetric Engineering & Remote Sensing 79 (2013). https://doi.org/10.14358/PERS.79.2.209

[16]

M. Isenburg and P. Lindstrom. 2005. Streaming meshes. In VIS 05. IEEE Visualization, 2005. 231--238.

[17]

Lai Kang, Jie Jiang, Yingmei Wei, and Yuxiang Xie. 2019. Efficient Randomized Hierarchy Construction for Interactive Visualization of Large Scale Point Clouds. In 2019 IEEE Fourth International Conference on Data Science in Cyberspace (DSC). 593--597.

[18]

Brian Karis, Rune Stubbe, and Graham Wihlidal. 2021. A Deep Dive into Nanite Virtualized Geometry. In ACM SIGGRAPH 2021 Courses, Advances in Real-Time Rendering in Games, Part 1. https://advances.realtimerendering.com/s2021/index.html [Accessed 10-September-2021].

[19]

Michael Kenzel, Bernhard Kerbl, Dieter Schmalstieg, and Markus Steinberger. 2018. A High-performance Software Graphics Pipeline Architecture for the GPU. ACM Trans. Graph. 37, 4, Article 140 (2018), 15 pages.

Digital Library

[20]

Mingyu Kim and Nakhoon Baek. 2021. A 3D graphics rendering pipeline implementation based on the openCL massively parallel processing. The Journal of Supercomputing 77, 7 (2021), 7351--7367. https://doi.org/10.1007/s11227-020-03581-8

Digital Library

[21]

Petrus E.J. Kivi, Markku J. Mäkitalo, Jakub Zadnik, Julius Ikkala, Vinod Kumar Malamal Vadakital, and Pekka O. Jaaskelainen. 2022. Real-Time Rendering of Point Clouds with Photorealistic Effects: A Survey. IEEE Access 10 (26 Jan. 2022), 13151--13173. https://doi.org/10.1109/ACCESS.2022.3146768 Publisher Copyright: Author.

[22]

Samuli Laine and Tero Karras. 2011. High-Performance Software Rasterization on GPUs (HPG '11). Association for Computing Machinery, New York, NY, USA, 79--88. https://doi.org/10.1145/2018323.2018337

[23]

J. K. Lawder and P. J. H. King. 2000. Using Space-Filling Curves for Multi-dimensional Indexing. In Advances in Databases, Brian Lings and Keith Jeffery (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 20--35.

[24]

Fang Liu, Meng-Cheng Huang, Xue-Hui Liu, and En-Hua Wu. 2010. FreePipe: A Programmable Parallel Rendering Architecture for Efficient Multi-Fragment Effects (I3D '10). Association for Computing Machinery, New York, NY, USA, 75--82. https://doi.org/10.1145/1730804.1730817

[25]

Haicheng Liu, Peter van Oosterom, Martijn Meijers, Xuefeng Guan, Edward Verbree, and Mike Horhammer. 2020. HistSFC: Optimization for nD massive spatial points querying. International Journal of Database Management Systems (IJDMS) 12, 3 (2020), 7--28. https://doi.org/10.5121/ijdms.2020.12302

[26]

Alfonso López, Juan Manuel Jurado, Emilio José Padrón, Carlos Javier Ogayar, and Francisco Ramón Feito. 2021. Comparison of GPU-based Methods for Handling Point Cloud Occlusion. In Spanish Computer Graphics Conference (CEIG), Lidia M. Ortega and Antonio Chica (Eds.). The Eurographics Association. https://doi.org/10.2312/ceig.20211364

[27]

Adam Marrs, Benjamin Watson, and Christopher Healey. 2018. View-warped Multi-view Soft Shadows for Local Area Lights. Journal of Computer Graphics Techniques (JCGT) 7, 3 (2018), 1--28.

[28]

Oscar Martinez-Rubi, Stefan Verhoeven, M. van Meersbergen, Markus Schütz, Peter van Oosterom, Romulo Goncalves, and T. P. M. Tijssen. 2015. Taming the beast: Free and open-source massive point cloud web visualization. https://doi.org/10.13140/RG.2.1.1731.4326/1 Capturing Reality Forum 2015, Salzburg, Austria.

[29]

J. A. Orenstein and T. H. Merrett. 1984. A Class of Data Structures for Associative Searching. In Proceedings of the 3rd ACM SIGACT-SIGMOD Symposium on Principles of Database Systems (Waterloo, Ontario, Canada) (PODS '84). Association for Computing Machinery, New York, NY, USA, 181--190. https://doi.org/10.1145/588011.588037

[30]

Pacific Gas & Electric Company. 2013. PG&E Diablo Canyon Power Plant (DCPP): San Simeon and Cambria Faults, CA, Airborne Lidar survey. https://doi.org/10.5069/G9CN71V5 Distributed by OpenTopography.

[31]

Anjul Patney, Stanley Tzeng, Kerry A. Seitz, and John D. Owens. 2015. Piko: A Framework for Authoring Programmable Graphics Pipelines. ACM Trans. Graph. 34, 4, Article 147 (2015), 13 pages. https://doi.org/10.1145/2766973

Digital Library

[32]

Ruggero Pintus, Enrico Gobbetti, and Marco Agus. 2011. Real-Time Rendering of Massive Unstructured Raw Point Clouds Using Screen-Space Operators. In Proceedings of the 12th International Conference on Virtual Reality, Archaeology and Cultural Heritage (Prato, Italy) (VAST'11). Eurographics Association, Goslar, DEU, 105--112.

Digital Library

[33]

Paul Rosenthal and Lars Linsen. 2008. Image-space point cloud rendering. In Proceedings of Computer Graphics International. 136--143.

[34]

Szymon Rusinkiewicz and Marc Levoy. 2000. QSplat: A Multiresolution Point Rendering System for Large Meshes. In Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '00). ACM Press/Addison-Wesley Publishing Co., USA, 343--352. https://doi.org/10.1145/344779.344940

Digital Library

[35]

Darius Rückert, Linus Franke, and Marc Stamminger. 2022. Adop: Approximate differentiable one-pixel point rendering. To appear in ACM Transactions on Graphics 41, 4 (jul 2022).

Digital Library

[36]

Claus Scheiblauer and Michael Wimmer. 2011. Out-of-Core Selection and Editing of Huge Point Clouds. Computers & Graphics 35, 2 (2011), 342--351.

Digital Library

[37]

Kersten Schuster, Philip Trettner, Patric Schmitz, Julian Schakib, and Leif Kobbelt. 2021. Compression and Rendering of Textured Point Clouds via Sparse Coding. In High-Performance Graphics - Symposium Papers, Nikolaus Binder and Tobias Ritschel (Eds.). The Eurographics Association. https://doi.org/10.2312/hpg.20211284

[38]

Markus Schütz, Bernhard Kerbl, and Michael Wimmer. 2021. Rendering Point Clouds with Compute Shaders and Vertex Order Optimization. Computer Graphics Forum 40, 4 (2021), 115--126. https://doi.org/10.1111/cgf.14345

[39]

Markus Schütz, Katharina Krösl, and Michael Wimmer. 2019. Real-Time Continuous Level of Detail Rendering of Point Clouds. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (Osaka, Japan). IEEE, 103--110.

[40]

Alex Vlachos. 2015. Advanced VR Rendering. Game Developers Conference, industry talk. https://www.gdcvault.com/play/1021771/Advanced-VR Accessed 2018.11.20.

[41]

Michael Wand, Alexander Berner, Martin Bokeloh, Philipp Jenke, Arno Fleck, Mark Hoffmann, Benjamin Maier, Dirk Staneker, Andreas Schilling, and Hans-Peter Seidel. 2008. Processing and interactive editing of huge point clouds from 3D scanners. Computers & Graphics 32, 2 (2008), 204 - 220. https://doi.org/10.1016/j.cag.2008.01.010

Digital Library

[42]

Hank Weghorst, Gary Hooper, and Donald P. Greenberg. 1984. Improved Computational Methods for Ray Tracing. ACM Trans. Graph. 3, 1 (1984), 52--69. https://doi.org/10.1145/357332.357335

Digital Library

Cited By

Goel RSchütz MNarayanan PKerbl B(2024)Real-Time Decompression and Rasterization of Massive Point CloudsProceedings of the ACM on Computer Graphics and Interactive Techniques10.1145/36753737:3(1-15)Online publication date: 9-Aug-2024
https://dl.acm.org/doi/10.1145/3675373
Schütz MHerzberger LWimmer M(2024)SimLOD: Simultaneous LOD Generation and Rendering for Point CloudsProceedings of the ACM on Computer Graphics and Interactive Techniques10.1145/36512877:1(1-20)Online publication date: 13-May-2024
https://dl.acm.org/doi/10.1145/3651287
Li R(2023)View-dependent Adaptive HLOD: real-time interactive rendering of multi-resolution modelsProceedings of the 20th ACM SIGGRAPH European Conference on Visual Media Production10.1145/3626495.3626507(1-10)Online publication date: 30-Nov-2023
https://dl.acm.org/doi/10.1145/3626495.3626507
Show More Cited By

Index Terms

Software Rasterization of 2 Billion Points in Real Time
1. Computing methodologies
  1. Computer graphics
    1. Rendering
      1. Rasterization

Recommendations

Towards multi-perspective rasterization

We present a novel framework for real-time multi-perspective rendering. While most existing approaches are based on ray-tracing, we present an alternative approach by emulating multi-perspective rasterization on the classical perspective graphics ...
Real-time multiply recursive reflections and refractions using hybrid rendering

We present a new method for real-time rendering of multiple recursions of reflections and refractions. The method uses the strengths of real-time ray tracing for objects close to the camera, by storing them in a per-frame constructed bounding volume ...
Ray tracing via GPU rasterization

Ray tracing is a dominant method for generating a wide variety of global illumination effects, such as reflections/refractions, shadows, etc. In this paper, we propose an efficient technique to perform nearly accurate ray tracing using the programmable ...

Comments

Information & Contributors

Information

Published In

Proceedings of the ACM on Computer Graphics and Interactive Techniques Volume 5, Issue 3

July 2022

198 pages

EISSN:2577-6193

DOI:10.1145/3552302

Issue’s Table of Contents

Copyright © 2022 Owner/Author.

This work is licensed under a Creative Commons Attribution-NonCommercial International 4.0 License.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 July 2022

Published in PACMCGIT Volume 5, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
2,093
Total Downloads

Downloads (Last 12 months)1,561
Downloads (Last 6 weeks)125

Reflects downloads up to 24 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Goel RSchütz MNarayanan PKerbl B(2024)Real-Time Decompression and Rasterization of Massive Point CloudsProceedings of the ACM on Computer Graphics and Interactive Techniques10.1145/36753737:3(1-15)Online publication date: 9-Aug-2024
https://dl.acm.org/doi/10.1145/3675373
Schütz MHerzberger LWimmer M(2024)SimLOD: Simultaneous LOD Generation and Rendering for Point CloudsProceedings of the ACM on Computer Graphics and Interactive Techniques10.1145/36512877:1(1-20)Online publication date: 13-May-2024
https://dl.acm.org/doi/10.1145/3651287
Li R(2023)View-dependent Adaptive HLOD: real-time interactive rendering of multi-resolution modelsProceedings of the 20th ACM SIGGRAPH European Conference on Visual Media Production10.1145/3626495.3626507(1-10)Online publication date: 30-Nov-2023
https://dl.acm.org/doi/10.1145/3626495.3626507
Yu ZZeidler DVictor VMcginity M(2023)Dynascape : Immersive Authoring of Real-World Dynamic Scenes with Spatially Tracked RGB-D VideosProceedings of the 29th ACM Symposium on Virtual Reality Software and Technology10.1145/3611659.3615718(1-12)Online publication date: 9-Oct-2023
https://dl.acm.org/doi/10.1145/3611659.3615718
Harrer MFranke LFink LStamminger MWeyrich T(2023)Inovis: Instant Novel-View SynthesisSIGGRAPH Asia 2023 Conference Papers10.1145/3610548.3618216(1-12)Online publication date: 10-Dec-2023
https://dl.acm.org/doi/10.1145/3610548.3618216
Kerbl BKopanas GLeimkuehler TDrettakis G(2023)3D Gaussian Splatting for Real-Time Radiance Field RenderingACM Transactions on Graphics10.1145/359243342:4(1-14)Online publication date: 26-Jul-2023
https://dl.acm.org/doi/10.1145/3592433
López AOgayar CJurado JFeito F(2023)Efficient generation of occlusion-aware multispectral and thermographic point cloudsComputers and Electronics in Agriculture10.1016/j.compag.2023.107712207:COnline publication date: 1-Apr-2023
https://dl.acm.org/doi/10.1016/j.compag.2023.107712

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Media

Figures

Other

Tables

View Issue’s Table of Contents