3 research outputs found
On-edge 2D-to-3D generative pipeline for seamless instance transformation
Get PDFDespite ongoing challenges with fragmented workflows, latency in device imports, and the main issue of limitations in object reconstruction functionality, relying on imperfect extraction networks remains an impractical solution for scalable object generation. To deal with these constraints, we proposed an end-to-end pipeline that leverages a re-designed self-consistency mechanism—aimed at reducing discrimination, along with the beneficial enhancement from level-set projection and gradient-surface orthogonality. In addition, our approach designs dynamic 3D object creation with minimal manual effort by unifying surface topology and optimizing data loading, enabling a streamlined reconstruction process and more flexible object projection. Our method supports rapid, resource-efficient mesh reconstruction and consistently demonstrates performance improvements across multiple instance benchmarks, covering virtual projection tasks. Improvements in mesh topology reconstruction, as measured by the L1 Chamfer distance (CD) metric, are consistently higher, while the system also achieves significant transmission speedups—up to 56.5×—near-instant importing—along with lowering latency in practical rendering on virtual reality (VR) devices. This result highlights that refining mesh binding improves re-creation fidelity. Our approach to scalability leads to faster user engagement and allows automated deployment without requiring human intervention during importing
Towards Digital Twins of 3D Reconstructed Apparel Models with an End-to-End Mobile Visualization
No full textDigital twin technologies are still developing and are being increasingly leveraged to facilitate daily life activities. This study presents a novel approach for leveraging the capability of mobile devices for photo collection, cloud processing, and deep learning-based 3D generation, with seamless display in virtual reality (VR) wearables. The purpose of our study is to provide a system that makes use of cloud computing resources to offload the resource-intensive activities of 3D reconstruction and deep-learning-based scene interpretation. We establish an end-to-end pipeline from 2D to 3D reconstruction, which automatically builds accurate 3D models from collected photographs using sophisticated deep-learning techniques. These models are then converted to a VR-compatible format, allowing for immersive and interactive experiences on wearable devices. Our findings attest to the completion of 3D entities regenerated by the CAP–UDF model using ShapeNetCars and Deep Fashion 3D datasets with a discrepancy in L2 Chamfer distance of only 0.089 and 0.129, respectively. Furthermore, the demonstration of the end-to-end process from 2D capture to 3D visualization on VR occurs continuously
