Instructions

Please login or register to submit your results.

Submission Policy

Classification results will be evaluated automatically and made visible only to you. You will be able to make them public at any time.

Important: The evaluation server is not to be used for training. To discourage this, you will have to wait 72 hours (3 days) before you can re-submit your results. If you want to present results of your method with various settings (e.g. different features, inference method, etc.), please use the training set for this purpose and submit only one result to the test server!

File Format

Please submit your results as a single .zip file. The results for each point cloud must be stored in a separate .txt file in the archive's root folder. The file name must be exactly like the point cloud name (case sensitive).

The file format should be the same as the ground truth file, which is an text-file containing one class label per line. Each line must contain exactly 1 value and corresponds to the point in the same line of the .pts point cloud file:

<label>

We provide both per class intersection union and the full confusion matrix. The former one is used for official ranking while the latter one can be used to compute your own metrics. Here is an example:

classified.labels

  1
  3
  7
  5
  5
  ...

Archive Structure

The content of the .zip archive should contain

semantic-8

./stgallencathedral1.labels 
./stgallencathedral3.labels 
./stgallencathedral6.labels 
./marketsquarefeldkirch1.labels 
./marketsquarefeldkirch4.labels 
./marketsquarefeldkirch7.labels 
./birdfountain1.labels 
./castleblatten1.labels 
./castleblatten5.labels 
./sg27_3.labels 
./sg27_6.labels 
./sg27_8.labels 
./sg27_10.labels 
./sg28_2.labels 
./sg28_5.labels

reduced-8

./marketsquarefeldkirch4-reduced.labels 
./stgallencathedral6-reduced.labels 
./sg27_10-reduced.labels 
./sg28_2-reduced.labels



Contact