Download
Dataset structure
Point format
Results
Checkpoints
Training and evaluation
Download and extract
For the semantic segmentation benchmark, download the point cloud archive only. RGB images are optional and can be downloaded by sequence.
4TU.ResearchData dataset record · File formats
RGB image archives by sequence
Image archive manifest
Training (37 sequences)
Validation (5 sequences)
Test (10 sequences)
Verify the point cloud archive
Download SHA256SUMS.txt to the same directory as the point cloud archive.
sha256sum -c SHA256SUMS.txt
Extract point clouds
mkdir -p Semantic-ITC
tar -xf Semantic-ITC_raw-local.tar -C Semantic-ITC
Dataset structure
The dataset contains 52 public sequence IDs, with 37 training, 5 validation, and 10 test sequences.
Semantic-ITC/
└── point_clouds_local_bin/
├── train/<sequence_id>/<timestamp>.bin
├── val/<sequence_id>/<timestamp>.bin
├── test/<sequence_id>/<timestamp>.bin
└── splits/{train,val,test}.txt
Point clouds use original per-frame LiDAR sensor coordinates (raw-local).
Sequence ID mapping (Appendix B to 4TU)
Appendix B and the 4TU release use different sequence IDs, with identical train, validation, and test splits.
Paper ID 4TU ID Split Scene type Frames
1 21 test Classroom 950
2 19 test Classroom 1240
3 17 test Classroom 971
4 47 test Corridor 3456
5 01 test Meeting room 620
6 02 test Meeting room 497
7 03 test Meeting room 582
8 20 test Office 664
9 18 test Office 1017
10 49 test Study area 3340
11 25 train Classroom 979
12 24 train Classroom 946
13 23 train Classroom 841
14 22 train Classroom 864
15 08 train Classroom 778
16 07 train Classroom 759
17 06 train Classroom 1130
18 09 train Classroom 871
19 10 val Classroom 1156
20 48 train Corridor 2776
21 39 train Corridor 1968
22 26 train Meeting room 529
23 05 train Meeting room 651
24 04 train Meeting room 693
25 11 train Meeting room 435
26 12 train Meeting room 427
27 51 val Study area 2332
28 50 train Study area 1672
29 27 train Classroom 824
30 31 train Classroom 1582
31 52 val Corridor 1845
32 40 train Corridor 3190
33 41 train Corridor 3513
34 14 val Meeting room 951
35 13 train Meeting room 935
36 29 train Office 1019
37 28 train Office 1062
38 30 val Office 1016
39 44 train Study area 3758
40 45 train Study area 4768
41 32 train Classroom 1183
42 33 train Classroom 1186
43 42 train Corridor 2904
44 43 train Corridor 3490
45 34 train Meeting room 575
46 16 train Meeting room 973
47 15 train Meeting room 960
48 35 train Office 1304
49 38 train Office 989
50 36 train Office 2278
51 37 train Office 1101
52 46 train Study area 4558
Show all 52 sequences
Benchmark results
Test-set results in percent.
Training and evaluation
Install each method according to its repository README. Semantic-ITC requires no additional dataset-specific package. SalsaNext, WaffleIron, and HARP-NeXt require TensorBoard. Cylinder3D requires a CUDA-compatible spconv installation. Pointcept requires pointops, spconv, and PyTorch Geometric as documented by Pointcept; the provided PTv3 configuration does not require FlashAttention.
Paths
export ITC_CODE_ROOT=/path/to/directory/containing/the/five/repositories
export ITC_RUN_ROOT=/path/to/output/directory
export ITC_CHECKPOINT_ROOT=/path/to/downloaded/checkpoints
export GPU_ID=0
export ITC_COORDINATES=raw_local
export ITC_DATASET=/path/to/point_clouds_local_bin
Train
conda activate waffleiron
PROJECT="$ITC_CODE_ROOT/WaffleIron"
RUN_DIR="$ITC_RUN_ROOT/$ITC_COORDINATES/WaffleIron"
cd "$PROJECT"
PYTHONPATH="$PROJECT:${PYTHONPATH:-}" python -u launch_train.py \
--dataset itc --path_dataset "$ITC_DATASET" --log_path "$RUN_DIR" \
--config configs/WaffleIron-48-256__itc.yaml \
--gpu "$GPU_ID" --seed 0 --fp16
Evaluate released checkpoint
CKPT="$ITC_CHECKPOINT_ROOT/waffleiron_${ITC_COORDINATES}_best_val_miou.pt"
TEST_DIR="$ITC_RUN_ROOT/$ITC_COORDINATES/WaffleIron_test_best"
cd "$ITC_CODE_ROOT/WaffleIron"
PYTHONPATH="$PWD:${PYTHONPATH:-}" python -u eval_itc.py \
--config configs/WaffleIron-48-256__itc.yaml \
--path_dataset "$ITC_DATASET" --ckpt "$CKPT" --phase test \
--run_dir "$TEST_DIR" --batch_size 1 --num_workers 8 --fp16
Train
conda activate pointcept
PROJECT="$ITC_CODE_ROOT/Pointcept"
RUN_DIR="$ITC_RUN_ROOT/$ITC_COORDINATES/PointTransformerV3"
cd "$PROJECT"
PYTHONPATH="$PROJECT:${PYTHONPATH:-}" python -u tools/train.py \
--num-gpus 1 --config-file configs/itc/semseg-pt-v3m1-0-itc.py \
--options save_path="$RUN_DIR" data.train.data_root="$ITC_DATASET" \
data.val.data_root="$ITC_DATASET" data.test.data_root="$ITC_DATASET"
Evaluate released checkpoint
CKPT="$ITC_CHECKPOINT_ROOT/ptv3_${ITC_COORDINATES}_best_val_miou.pt"
TEST_DIR="$ITC_RUN_ROOT/$ITC_COORDINATES/PointTransformerV3_test_best"
cd "$ITC_CODE_ROOT/Pointcept"
PYTHONPATH="$PWD:${PYTHONPATH:-}" python -u tools/test.py \
--num-gpus 1 --config-file configs/itc/semseg-pt-v3m1-0-itc.py \
--options save_path="$TEST_DIR" weight="$CKPT" \
data.test.data_root="$ITC_DATASET" data.test.split=test
Train
conda activate harpnext
PROJECT="$ITC_CODE_ROOT/HARPNeXt"
RUN_DIR="$ITC_RUN_ROOT/$ITC_COORDINATES/HARPNeXt"
cd "$PROJECT"
PYTHONPATH="$PROJECT:${PYTHONPATH:-}" python -u main.py \
--net harpnext --dataset itc --path_dataset "$ITC_DATASET" \
--mainconfig configs/main/main-config-itc.yaml \
--netconfig configs/net/harpnext-itc.yaml --log_path "$RUN_DIR" \
--gpu "$GPU_ID" --seed 0 --fp16
Evaluate released checkpoint
CKPT="$ITC_CHECKPOINT_ROOT/harpnext_${ITC_COORDINATES}_best_val_miou.pt"
TEST_DIR="$ITC_RUN_ROOT/$ITC_COORDINATES/HARPNeXt_test_best"
cd "$ITC_CODE_ROOT/HARPNeXt"
PYTHONPATH="$PWD:${PYTHONPATH:-}" python -u main.py \
--net harpnext --dataset itc --path_dataset "$ITC_DATASET" \
--mainconfig configs/main/main-config-itc.yaml \
--netconfig configs/net/harpnext-itc.yaml --log_path "$TEST_DIR" \
--checkpoint "$CKPT" --gpu "$GPU_ID" --seed 0 --fp16 \
--eval --eval-phase test --restart
Train
conda activate salsanext
PROJECT="$ITC_CODE_ROOT/SalsaNext"
RUN_DIR="$ITC_RUN_ROOT/$ITC_COORDINATES/SalsaNext"
cd "$PROJECT/train/tasks/semantic"
python -u train.py --dataset "$ITC_DATASET" \
--arch_cfg "$PROJECT/salsanext_itc.yaml" \
--data_cfg "$PROJECT/train/tasks/semantic/config/labels/itc.yaml" \
--log "$RUN_DIR" --name "salsanext_itc_${ITC_COORDINATES}" \
--run-dir-exact
Evaluate released checkpoint
CKPT="$ITC_CHECKPOINT_ROOT/salsanext_${ITC_COORDINATES}_best_val_miou.pt"
TEST_DIR="$ITC_RUN_ROOT/$ITC_COORDINATES/SalsaNext_test_best"
PROJECT="$ITC_CODE_ROOT/SalsaNext"
cd "$PROJECT"
python -u eval_itc.py --dataset "$ITC_DATASET" \
--arch-cfg "$PROJECT/salsanext_itc.yaml" \
--data-cfg "$PROJECT/train/tasks/semantic/config/labels/itc.yaml" \
--checkpoint "$CKPT" --run-dir "$TEST_DIR" --split test --workers 8
Train
conda activate cylinder3d
PROJECT="$ITC_CODE_ROOT/Cylinder3D"
RUN_DIR="$ITC_RUN_ROOT/$ITC_COORDINATES/Cylinder3D"
cd "$PROJECT"
python -u train_cylinder_asym.py -y config/itc.yaml \
--dataset-root "$ITC_DATASET" --run-dir "$RUN_DIR" --seed 0
Evaluate released checkpoint
CKPT="$ITC_CHECKPOINT_ROOT/cylinder3d_${ITC_COORDINATES}_best_val_miou.pt"
TEST_DIR="$ITC_RUN_ROOT/$ITC_COORDINATES/Cylinder3D_test_best"
cd "$ITC_CODE_ROOT/Cylinder3D"
python -u eval_itc.py -y config/itc.yaml \
--dataset-root "$ITC_DATASET" --checkpoint "$CKPT" \
--run-dir "$TEST_DIR" --split test --batch-size 1 --num-workers 8