Skip to content

Evaluation Data: TRELLIS vs. TRELLIS.2-4B geometry metrics in 2,307-model census #363

Description

@alza123123

Hi TRELLIS team,

I executed an automated geometry quality evaluation across 2,307 assets from 23 generators (sampled from the 3D Arena dataset).

Comparing both TRELLIS generations in the dataset yielded the following metrics:

  • TRELLIS (n=100): 60.0% non-watertight | 0.0% non-manifold | 4.0% > 30k tris
  • TRELLIS.2-4B (n=101): 91.1% non-watertight | 14.9% non-manifold | 100% > 30k tris

The higher face density in TRELLIS.2-4B accounts for the triangle budget, but the non-manifold edge rise from 0% to 14.9% stood out during automated QA.

The evaluation runner, manifest files, and raw aggregate reports are published and reproducible via pip install 3dqa:
https://github.com/alza123123/3dqa-benchmark

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions