Synthetic Photogrammetric Survey Dateset

This dataset contains a set of synthetic images, used to simulate a photogrammetric survey of everyday and cultural heritage objects. This dataset has been used to study the influence of specular reflections on the photgrammetric reconstruction process, and to train a neural model to remove specular highlights from photos, to improve the photogrammetric reconstruction.   The 3D assets have been prepared to have a coherent position orientation, scale, materials, naming, and stored in individual blender files. For each asset, another blender file was created, with a configurable camera and lighting rig, to simulate camera placement and ligthing used in a photogrammetric survey. Rendering was configured to produce simultaneously 3 images: a complete rendering, a diffuse-only rendering, and a specular-only rendering.  In this way, for each asset, it was possible to generate renderings compatible in terms of framing, resolution, lighting and appearance, to real-world photogrammetric surveys. The image triples were used to train a neural network to remove specular highlights from photos.    This dataset comprises 24 assets, 144 rendered images per asset (3456 in total).   This dataset has been prepared by the Visual Computing Lab, CNR-ISTI (https://vcg.isti.cnr.it) Authors: Marco Callieri, Daniela Giorgi, Massimiliano Corsini, Marco Sorrenti. For more info: callieri@isti.cnr.it   ---------------------------------------------------------------- DATASET CONTENT:   The dataset contains two main folders, plus readme info file.   --IMAGES The rendered images, simulating the photogrammetric survey.    One folder per asset, folder is named as the asset.  For each asset, 48 views, 3 render per view:   ASSETNAME_CXXX   combined rendering image   ASSETNAME_DXXX   diffuse-only image   ASSETNAME_SXXX   specular-only image In total, 144 images per folder, 2000x2000 resolution. PNG format, with transparency channel as mask.     --SCENES_ASSETS The 3D assets and Blender scenes.   00_BASE.blend is the basic empty scene file, used for the inital setup of the rendering process and the lighting/camera rigs.   For each asset there is a blender file, named as the asset, containing the camera/lighting setup and rendering configuration to produce the combined/diffuse/specular images. Each of these blender files references its relative 3D asset from another Blender file from one of the subfolders.      The prepared 3D assets are stored in the subfolders named as the asset. Each asset subfolder contains the original 3D model and texture, plus a Blender scene containing the ready-to-use asset with a standardized position, orientation, scale, naming, material and settings.   ---------------------------------------------------------------- The 3D models included in this dataset have been sourced from Sketchfab (https://sketchfab.com/) and a private repository (https://vcg.isti.cnr.it). All objects had an open license, and were marked as "usable for AI applications".   adidas "Scanned Adidas Sports Shoe" (https://skfb.ly/QZo9) by 3Digify is licensed under Creative Commons Attribution (http://creativecommons.org/licenses/by/4.0/)   baby "Baby Waiting For Birth" (https://skfb.ly/6WBwn) by Tore Lysebo is licensed under Creative Commons Attribution (http://creativecommons.org/licenses/by/4.0/)ù   bfvase "Black-Figure Neck Amphora, c. 540 BCE" (https://skfb.ly/oOysJ) by Minneapolis Institute of Art is licensed under Creative Commons Attribution-ShareAlike (http://creativecommons.org/licenses/by-sa/4.0/)   birdvase "Vessel in the Form of a Bird, 100 BCE - 600 CE" (https://skfb.ly/oOzUH) by Minneapolis Institute of Art is licensed under Creative Commons Attribution-ShareAlike (http://creativecommons.org/licenses/by-sa/4.0/)   boot1 "Caterpillar Work Boot" (https://skfb.ly/o8KnO) by inciprocal is licensed under Creative Commons Attribution (http://creativecommons.org/licenses/by/4.0/)   brezel "Laugenbrezel" (https://skfb.ly/o99yz) by svnfbgr is licensed under Creative Commons Attribution (http://creativecommons.org/licenses/by/4.0/)   cabbage "Cabbage" (https://skfb.ly/6Z6EK) by Meerschaum Digital is licensed under Creative Commons Attribution (http://creativecommons.org/licenses/by/4.0/)   conga "African Drum (raw scan)" (https://skfb.ly/6VwHK) by Piotr Lezanski is licensed under Creative Commons Attribution (http://creativecommons.org/licenses/by/4.0/)   dwarf Visual Computing Lab, ISTI-CNR (https://vcg.isti.cnr.it), under Creative Commons Attribution (http://creativecommons.org/licenses/by/4.0/)   elephant "Wooden Elephant Scan | Game-ready asset" (https://skfb.ly/6XvpQ) by Photogrammetry Guy is licensed under Creative Commons Attribution (http://creativecommons.org/licenses/by/4.0/)   gator "Crocodile dog toy 3D scan" (https://skfb.ly/otSAq) by LukaszRyz is licensed under Creative Commons Attribution (http://creativecommons.org/licenses/by/4.0/)   grinder "Angle_grinder DeWalt D28136" (https://skfb.ly/oOFvv) by Den.Prodan is licensed under Creative Commons Attribution (http://creativecommons.org/licenses/by/4.0/)   guardian "Bishamonten, Guardian of the North, 13th C CE" (https://skfb.ly/oLBnS) by Minneapolis Institute of Art is licensed under Creative Commons Attribution-ShareAlike (http://creativecommons.org/licenses/by-sa/4.0/)   gun "Antique Pistol PBR Scan" (https://skfb.ly/oII8o) by Per's Scan Collection is licensed under Creative Commons Attribution (http://creativecommons.org/licenses/by/4.0/)   helmet1 "Leather Helmet" (https://skfb.ly/6SzZs) by Connections XR is licensed under Creative Commons Attribution (http://creativecommons.org/licenses/by/4.0/)   kvase Kalong Vase, 14th-16th C CE. Minneapolis Institute of Art, CC0 Public Domain https://sketchfab.com/3d-models/kalong-vase-14th-16th-c-ce-0797e6f0be7b4045ade19cd5d8db1e4a   owlvase Owl 'Zun' wine vessel, 13th-12th century BCE. Minneapolis Institute of Art, CC0 Public Domain https://sketchfab.com/3d-models/owl-zun-wine-vessel-13th-12th-century-bce-ca77ae1351ca4b1c9a7d403e09e1c4af   pomegranate "Pomegranate Fruit" (https://skfb.ly/oqYA7) by YuriyF is licensed under Creative Commons Attribution (http://creativecommons.org/licenses/by/4.0/)   ridingboot "Coraline Riding Boot" (https://skfb.ly/opZtn) by inciprocal is licensed under Creative Commons Attribution (http://creativecommons.org/licenses/by/4.0/)   spiderman "Spiderman toy" (https://skfb.ly/EoZ7) by gaelkerchy is licensed under Creative Commons Attribution-NonCommercial (http://creativecommons.org/licenses/by-nc/4.0/)   teapot "Scanned Brass Teapot" (https://skfb.ly/CKDA) by 3Digify is licensed under Creative Commons Attribution (http://creativecommons.org/licenses/by/4.0/)   toydog "Plastic Toy Dog -RAWscan" (https://skfb.ly/6WNro) by Andrea Spognetta (Spogna) is licensed under Creative Commons Attribution-NonCommercial (http://creativecommons.org/licenses/by-nc/4.0/)   tractor "Wooden Toy Tractor (High-Poly)" (https://skfb.ly/ovrXK) by Karl Hõbelaid is licensed under Creative Commons Attribution (http://creativecommons.org/licenses/by/4.0/)   violin "Violin" (https://skfb.ly/ovNu9) by spaceparmesan is licensed under Creative Commons Attribution (http://creativecommons.org/licenses/by/4.0/)   ---------------------------------------------------------------- Acknowledgements:   This work has received financial support by the Horizon Europe Research & Innovation Programme under Grant agreement N. 101092612 (Social and hUman ceNtered XR - SUN project). Views and opinions expressed in this work are those of the author(s) only and do not necessarily reflect those of the European Union. Neither the European Union nor the European Commission can be held responsible for them.