Documentation

Getting Started

Dataset installation, benchmark repositories, released checkpoints, and commands for training and test-set evaluation.

Download and extract

For the semantic segmentation benchmark, download the point cloud archive only. RGB images are optional and can be downloaded by sequence.

4TU.ResearchData dataset record · File formats

RGB image archives by sequence

Image archive manifest

Training (37 sequences)

4TU sequence IDArchiveSize
04train/04.tar1.72 GB
05train/05.tar1.63 GB
06train/06.tar2.51 GB
07train/07.tar1.67 GB
08train/08.tar1.82 GB
09train/09.tar2.13 GB
11train/11.tar1.09 GB
12train/12.tar1.06 GB
13train/13.tar2.32 GB
15train/15.tar2.40 GB
16train/16.tar2.49 GB
22train/22.tar1.71 GB
23train/23.tar1.68 GB
24train/24.tar2.03 GB
25train/25.tar2.02 GB
26train/26.tar1.19 GB
27train/27.tar1.82 GB
28train/28.tar2.50 GB
29train/29.tar2.49 GB
31train/31.tar3.46 GB
32train/32.tar2.63 GB
33train/33.tar2.60 GB
34train/34.tar1.43 GB
35train/35.tar3.16 GB
36train/36.tar5.45 GB
37train/37.tar2.64 GB
38train/38.tar2.40 GB
39train/39.tar4.66 GB
40train/40.tar7.22 GB
41train/41.tar7.94 GB
42train/42.tar6.38 GB
43train/43.tar7.76 GB
44train/44.tar6.79 GB
45train/45.tar10.04 GB
46train/46.tar8.66 GB
48train/48.tar6.35 GB
50train/50.tar4.06 GB

Validation (5 sequences)

4TU sequence IDArchiveSize
10val/10.tar2.89 GB
14val/14.tar2.39 GB
30val/30.tar2.56 GB
51val/51.tar5.31 GB
52val/52.tar4.45 GB

Test (10 sequences)

4TU sequence IDArchiveSize
01test/01.tar1.54 GB
02test/02.tar1.23 GB
03test/03.tar1.46 GB
17test/17.tar2.07 GB
18test/18.tar2.32 GB
19test/19.tar2.65 GB
20test/20.tar1.66 GB
21test/21.tar1.87 GB
47test/47.tar8.21 GB
49test/49.tar7.23 GB

Verify the point cloud archive

Download SHA256SUMS.txt to the same directory as the point cloud archive.

sha256sum -c SHA256SUMS.txt

Extract point clouds

mkdir -p Semantic-ITC
tar -xf Semantic-ITC_raw-local.tar -C Semantic-ITC

Dataset structure

The dataset contains 52 public sequence IDs, with 37 training, 5 validation, and 10 test sequences.

Semantic-ITC/
└── point_clouds_local_bin/
    ├── train/<sequence_id>/<timestamp>.bin
    ├── val/<sequence_id>/<timestamp>.bin
    ├── test/<sequence_id>/<timestamp>.bin
    └── splits/{train,val,test}.txt

Point clouds use original per-frame LiDAR sensor coordinates (raw-local).

Sequence ID mapping (Appendix B to 4TU)

Appendix B and the 4TU release use different sequence IDs, with identical train, validation, and test splits.

Paper ID4TU IDSplitScene typeFrames
121testClassroom950
219testClassroom1240
317testClassroom971
447testCorridor3456
501testMeeting room620
602testMeeting room497
703testMeeting room582
820testOffice664
918testOffice1017
1049testStudy area3340
1125trainClassroom979
1224trainClassroom946
1323trainClassroom841
1422trainClassroom864
1508trainClassroom778
1607trainClassroom759
1706trainClassroom1130
1809trainClassroom871
1910valClassroom1156
2048trainCorridor2776
2139trainCorridor1968
2226trainMeeting room529
2305trainMeeting room651
2404trainMeeting room693
2511trainMeeting room435
2612trainMeeting room427
2751valStudy area2332
2850trainStudy area1672
2927trainClassroom824
3031trainClassroom1582
3152valCorridor1845
3240trainCorridor3190
3341trainCorridor3513
3414valMeeting room951
3513trainMeeting room935
3629trainOffice1019
3728trainOffice1062
3830valOffice1016
3944trainStudy area3758
4045trainStudy area4768
4132trainClassroom1183
4233trainClassroom1186
4342trainCorridor2904
4443trainCorridor3490
4534trainMeeting room575
4616trainMeeting room973
4715trainMeeting room960
4835trainOffice1304
4938trainOffice989
5036trainOffice2278
5137trainOffice1101
5246trainStudy area4558

Point format

Each little-endian binary point record occupies 14 bytes without padding.

FieldTypeBytesRange
xfloat324LiDAR coordinate
yfloat324LiDAR coordinate
zfloat324LiDAR coordinate
intensityuint810–255
labeluint810–15

Python reader

import numpy as np

dtype = np.dtype([
    ("x", "<f4"), ("y", "<f4"), ("z", "<f4"),
    ("intensity", "u1"), ("label", "u1"),
], align=False)

points = np.fromfile("frame.bin", dtype=dtype)
xyz = np.stack([points["x"], points["y"], points["z"]], axis=1)
intensity = points["intensity"]
labels = points["label"]

Semantic labels

0 wall, 1 floor, 2 ceiling, 3 column, 4 beam, 5 door, 6 stair, 7 table, 8 chair, 9 sofa, 10 cabinet/shelf, 11 display, 12 light, 13 vegetation, 14 board, 15 other.

Benchmark results

MethodmIoUmAccOA
WaffleIron79.2787.3892.99
PTv378.1988.1093.26
HARP-NeXt75.2084.7192.65
SalsaNext69.8086.8889.64
Cylinder3D69.2977.8191.97

Test-set results in percent.

Benchmark checkpoints

MethodCodeFilenameDownload
WaffleIronGitHubwaffleiron_raw_local_best_val_miou.ptDownload
PTv3GitHubptv3_raw_local_best_val_miou.ptDownload
HARP-NeXtGitHubharpnext_raw_local_best_val_miou.ptDownload
SalsaNextGitHubsalsanext_raw_local_best_val_miou.ptDownload
Cylinder3DGitHubcylinder3d_raw_local_best_val_miou.ptDownload

Training and evaluation

Install each method according to its repository README. Semantic-ITC requires no additional dataset-specific package. SalsaNext, WaffleIron, and HARP-NeXt require TensorBoard. Cylinder3D requires a CUDA-compatible spconv installation. Pointcept requires pointops, spconv, and PyTorch Geometric as documented by Pointcept; the provided PTv3 configuration does not require FlashAttention.

Paths

export ITC_CODE_ROOT=/path/to/directory/containing/the/five/repositories
export ITC_RUN_ROOT=/path/to/output/directory
export ITC_CHECKPOINT_ROOT=/path/to/downloaded/checkpoints
export GPU_ID=0

export ITC_COORDINATES=raw_local
export ITC_DATASET=/path/to/point_clouds_local_bin

WaffleIron

Repository ↗

Train

conda activate waffleiron
PROJECT="$ITC_CODE_ROOT/WaffleIron"
RUN_DIR="$ITC_RUN_ROOT/$ITC_COORDINATES/WaffleIron"
cd "$PROJECT"
PYTHONPATH="$PROJECT:${PYTHONPATH:-}" python -u launch_train.py \
  --dataset itc --path_dataset "$ITC_DATASET" --log_path "$RUN_DIR" \
  --config configs/WaffleIron-48-256__itc.yaml \
  --gpu "$GPU_ID" --seed 0 --fp16

Evaluate released checkpoint

CKPT="$ITC_CHECKPOINT_ROOT/waffleiron_${ITC_COORDINATES}_best_val_miou.pt"
TEST_DIR="$ITC_RUN_ROOT/$ITC_COORDINATES/WaffleIron_test_best"
cd "$ITC_CODE_ROOT/WaffleIron"
PYTHONPATH="$PWD:${PYTHONPATH:-}" python -u eval_itc.py \
  --config configs/WaffleIron-48-256__itc.yaml \
  --path_dataset "$ITC_DATASET" --ckpt "$CKPT" --phase test \
  --run_dir "$TEST_DIR" --batch_size 1 --num_workers 8 --fp16

Point Transformer V3

Repository ↗

Train

conda activate pointcept
PROJECT="$ITC_CODE_ROOT/Pointcept"
RUN_DIR="$ITC_RUN_ROOT/$ITC_COORDINATES/PointTransformerV3"
cd "$PROJECT"
PYTHONPATH="$PROJECT:${PYTHONPATH:-}" python -u tools/train.py \
  --num-gpus 1 --config-file configs/itc/semseg-pt-v3m1-0-itc.py \
  --options save_path="$RUN_DIR" data.train.data_root="$ITC_DATASET" \
    data.val.data_root="$ITC_DATASET" data.test.data_root="$ITC_DATASET"

Evaluate released checkpoint

CKPT="$ITC_CHECKPOINT_ROOT/ptv3_${ITC_COORDINATES}_best_val_miou.pt"
TEST_DIR="$ITC_RUN_ROOT/$ITC_COORDINATES/PointTransformerV3_test_best"
cd "$ITC_CODE_ROOT/Pointcept"
PYTHONPATH="$PWD:${PYTHONPATH:-}" python -u tools/test.py \
  --num-gpus 1 --config-file configs/itc/semseg-pt-v3m1-0-itc.py \
  --options save_path="$TEST_DIR" weight="$CKPT" \
    data.test.data_root="$ITC_DATASET" data.test.split=test

Train

conda activate harpnext
PROJECT="$ITC_CODE_ROOT/HARPNeXt"
RUN_DIR="$ITC_RUN_ROOT/$ITC_COORDINATES/HARPNeXt"
cd "$PROJECT"
PYTHONPATH="$PROJECT:${PYTHONPATH:-}" python -u main.py \
  --net harpnext --dataset itc --path_dataset "$ITC_DATASET" \
  --mainconfig configs/main/main-config-itc.yaml \
  --netconfig configs/net/harpnext-itc.yaml --log_path "$RUN_DIR" \
  --gpu "$GPU_ID" --seed 0 --fp16

Evaluate released checkpoint

CKPT="$ITC_CHECKPOINT_ROOT/harpnext_${ITC_COORDINATES}_best_val_miou.pt"
TEST_DIR="$ITC_RUN_ROOT/$ITC_COORDINATES/HARPNeXt_test_best"
cd "$ITC_CODE_ROOT/HARPNeXt"
PYTHONPATH="$PWD:${PYTHONPATH:-}" python -u main.py \
  --net harpnext --dataset itc --path_dataset "$ITC_DATASET" \
  --mainconfig configs/main/main-config-itc.yaml \
  --netconfig configs/net/harpnext-itc.yaml --log_path "$TEST_DIR" \
  --checkpoint "$CKPT" --gpu "$GPU_ID" --seed 0 --fp16 \
  --eval --eval-phase test --restart

Train

conda activate salsanext
PROJECT="$ITC_CODE_ROOT/SalsaNext"
RUN_DIR="$ITC_RUN_ROOT/$ITC_COORDINATES/SalsaNext"
cd "$PROJECT/train/tasks/semantic"
python -u train.py --dataset "$ITC_DATASET" \
  --arch_cfg "$PROJECT/salsanext_itc.yaml" \
  --data_cfg "$PROJECT/train/tasks/semantic/config/labels/itc.yaml" \
  --log "$RUN_DIR" --name "salsanext_itc_${ITC_COORDINATES}" \
  --run-dir-exact

Evaluate released checkpoint

CKPT="$ITC_CHECKPOINT_ROOT/salsanext_${ITC_COORDINATES}_best_val_miou.pt"
TEST_DIR="$ITC_RUN_ROOT/$ITC_COORDINATES/SalsaNext_test_best"
PROJECT="$ITC_CODE_ROOT/SalsaNext"
cd "$PROJECT"
python -u eval_itc.py --dataset "$ITC_DATASET" \
  --arch-cfg "$PROJECT/salsanext_itc.yaml" \
  --data-cfg "$PROJECT/train/tasks/semantic/config/labels/itc.yaml" \
  --checkpoint "$CKPT" --run-dir "$TEST_DIR" --split test --workers 8

Cylinder3D

Repository ↗

Train

conda activate cylinder3d
PROJECT="$ITC_CODE_ROOT/Cylinder3D"
RUN_DIR="$ITC_RUN_ROOT/$ITC_COORDINATES/Cylinder3D"
cd "$PROJECT"
python -u train_cylinder_asym.py -y config/itc.yaml \
  --dataset-root "$ITC_DATASET" --run-dir "$RUN_DIR" --seed 0

Evaluate released checkpoint

CKPT="$ITC_CHECKPOINT_ROOT/cylinder3d_${ITC_COORDINATES}_best_val_miou.pt"
TEST_DIR="$ITC_RUN_ROOT/$ITC_COORDINATES/Cylinder3D_test_best"
cd "$ITC_CODE_ROOT/Cylinder3D"
python -u eval_itc.py -y config/itc.yaml \
  --dataset-root "$ITC_DATASET" --checkpoint "$CKPT" \
  --run-dir "$TEST_DIR" --split test --batch-size 1 --num-workers 8