Submission ID: e9043677
sp_disk_scale_8k
Processed: 21-06-15. Download link: e90436771b444793-613json.json
This page ranks the submission against all others using the same number of keypoints, regardless of descriptor size. Please hover over table headers for descriptions on metrics and full scene names.
- Phototourism dataset: Stereo track / Multiview track
- Prague Parks dataset: Stereo track / Multiview track
- Google Urban dataset: Stereo track / Multiview track
Metadata
- Authors: Xiaopeng Bi, Yu Chen, Xinyang Liu, Dehao Zhang, Ran Yan, Zheng Chai, Haotian Zhang, and Xiao Liu (contact)
- Keypoint: superpoint and disk
- Descriptor: mss (0 none: 0 bytes)
- Number of features: 8000
- Summary: superpoint and disk with 8k features, using the guided superglue matching
- Paper: N/A
- Website: N/A
- Processing date: 21-06-15
Phototourism dataset / Stereo track
mAA at 10 degrees: 0.63975 (±0.00000 over 1 run(s) / ±0.12419 over 9 scenes)
Rank (per category): 1 (of 51)
Scene | Features | Matches (raw) |
Matches (final) |
Rep. @ 3 px. | MS @ 3 px. | mAA(5o) | mAA(10o) |
BM | 7913.9 | — | 2021.9 | 0.657 Rank: 19/51 |
0.917 Rank: 30/51 |
0.32974 (±0.00000) Rank: 11/51 |
0.47500 (±0.00000) Rank: 11/51 |
FCS | 7944.3 | — | 1797.3 | 0.510 Rank: 23/51 |
0.902 Rank: 16/51 |
0.69887 (±0.00000) Rank: 1/51 |
0.80201 (±0.00000) Rank: 1/51 |
LMS | 7930.9 | — | 1234.7 | 0.601 Rank: 6/51 |
0.684 Rank: 23/51 |
0.64922 (±0.00000) Rank: 1/51 |
0.76534 (±0.00000) Rank: 1/51 |
LB | 7948.0 | — | 1308.8 | 0.620 Rank: 14/51 |
0.760 Rank: 17/51 |
0.57166 (±0.00000) Rank: 11/51 |
0.66807 (±0.00000) Rank: 3/51 |
MC | 7948.0 | — | 2164.1 | 0.661 Rank: 16/51 |
0.910 Rank: 32/51 |
0.47418 (±0.00000) Rank: 11/51 |
0.62443 (±0.00000) Rank: 2/51 |
MR | 7945.2 | — | 1797.4 | 0.570 Rank: 23/51 |
0.940 Rank: 24/51 |
0.35679 (±0.00000) Rank: 2/51 |
0.47950 (±0.00000) Rank: 2/51 |
PSM | 7948.0 | — | 1515.6 | 0.505 Rank: 16/51 |
0.761 Rank: 8/51 |
0.31219 (±0.00000) Rank: 2/51 |
0.47985 (±0.00000) Rank: 2/51 |
SF | 7948.0 | — | 1725.4 | 0.501 Rank: 27/51 |
0.850 Rank: 17/51 |
0.59526 (±0.00000) Rank: 1/51 |
0.71844 (±0.00000) Rank: 1/51 |
SPC | 7948.0 | — | 1799.3 | 0.596 Rank: 18/51 |
0.856 Rank: 17/51 |
0.60344 (±0.00000) Rank: 8/51 |
0.74511 (±0.00000) Rank: 8/51 |
Avg | 7941.6 | — | 1707.2 | 0.580 Rank: 19/51 |
0.842 Rank: 13/51 |
0.51015 (±0.00000) Rank: 1/51 |
0.63975 (±0.00000) Rank: 1/51 |
We show the inliers that survive the robust estimation loop (i.e. RANSAC), or those supplied with the submission if using custom matches, and use the depth estimates to determine whether they are correct. We draw matches above a 5-pixel error threshold in red, and those below are color-coded by their error, from 0 (green) to 5 pixels (yellow). Matches for which we do not have depth estimates are drawn in blue. Please note that the depth maps are estimates and may contain errors.
— British Museum —










— Florence Cathedral Side —










— Lincoln Memorial Statue —










— London Bridge —










— Milan Cathedral —










— Mount Rushmore —










— Piazza San Marco —










— Sagrada Familia —










— Saint Paul's Cathedral —










Phototourism dataset / Multiview track
mAA at 10 degrees: N/A (±0.00000 over 1 run(s) / ±0.09160 over 9 scenes)
Rank (per category): 1 (of 51)
Scene | Features | Matches (input) |
Registration Ratio (%) |
Number of Landmarks |
Track Length | ATE | mAA(50) | mAA(100) |
BM | 7913.9 | 2029.50 | 99.87 Rank: 14/51 |
8130.84 Rank: 3/51 |
5.832 Rank: 10/51 |
0.34617 Rank: 4/51 |
0.58568 (±0.00000) Rank: 8/51 |
0.72074 (±0.00000) Rank: 8/51 |
FCS | 7944.3 | 1836.19 | 98.87 Rank: 8/51 |
10130.07 Rank: 2/51 |
5.119 Rank: 12/51 |
0.22033 Rank: 8/51 |
0.77100 (±0.00000) Rank: 9/51 |
0.82204 (±0.00000) Rank: 15/51 |
LMS | 7930.9 | 1310.03 | 99.73 Rank: 1/51 |
7041.41 Rank: 6/51 |
5.345 Rank: 8/51 |
0.34542 Rank: 36/51 |
0.85934 (±0.00000) Rank: 3/51 |
0.90386 (±0.00000) Rank: 8/51 |
LB | 7948.0 | 1536.43 | 98.36 Rank: 1/51 |
6960.42 Rank: 4/51 |
5.599 Rank: 10/51 |
0.47957 Rank: 19/51 |
0.77017 (±0.00000) Rank: 1/51 |
0.84329 (±0.00000) Rank: 1/51 |
MC | 7948.0 | 2131.56 | 100.00 Rank: 1/51 |
8929.38 Rank: 1/51 |
5.950 Rank: 10/51 |
0.32098 Rank: 6/51 |
0.57806 (±0.00000) Rank: 8/51 |
0.71872 (±0.00000) Rank: 5/51 |
MR | 7945.2 | 1767.75 | 95.35 Rank: 13/51 |
9378.22 Rank: 1/51 |
4.954 Rank: 11/51 |
0.51766 Rank: 32/51 |
0.48072 (±0.00000) Rank: 10/51 |
0.59915 (±0.00000) Rank: 6/51 |
PSM | 7948.0 | 1505.31 | 99.83 Rank: 4/51 |
10327.40 Rank: 2/51 |
4.769 Rank: 4/51 |
0.35728 Rank: 12/51 |
0.66119 (±0.00000) Rank: 4/51 |
0.74124 (±0.00000) Rank: 5/51 |
SF | 7948.0 | 1696.24 | 99.89 Rank: 4/51 |
10438.10 Rank: 2/51 |
5.043 Rank: 15/51 |
0.27814 Rank: 3/51 |
0.78703 (±0.00000) Rank: 6/51 |
0.86907 (±0.00000) Rank: 5/51 |
SPC | 7948.0 | 1844.25 | 100.00 Rank: 1/51 |
8983.40 Rank: 3/51 |
5.673 Rank: 7/51 |
0.42377 Rank: 11/51 |
0.76644 (±0.00000) Rank: 2/51 |
0.85262 (±0.00000) Rank: 3/51 |
Avg | 7941.6 | 1739.70 | 99.10 Rank: 4/51 |
8924.36 Rank: 1/51 |
5.365 Rank: 10/51 |
0.36548 Rank: 6/51 |
0.69551 (±0.00000) Rank: 1/51 |
0.78564 (±0.00000) Rank: 1/51 |
In the multi-view track we reconstruct the scene with Structure-from-Motion (Colmap) with small sets of images. We show the results for one bag of 10 images. Keypoints are drawn in blue if they are part of the model, and in red otherwise.
— British Museum —










— Florence Cathedral Side —










— Lincoln Memorial Statue —










— London Bridge —










— Milan Cathedral —










— Mount Rushmore —










— Piazza San Marco —










— Sagrada Familia —










— Saint Paul's Cathedral —










Prague Parks dataset / Stereo track
mAA at 10 degrees: 0.80700 (±0.00000 over 1 run(s) / ±0.05729 over 3 scenes)
Rank (per category): 1 (of 51)
Scene | Features | Matches (raw) |
Matches (final) |
Rep. @ 3 px. | MS @ 3 px. | mAA(5o) | mAA(10o) |
Lizard | 7318.1 | — | 1208.4 | 0.086 Rank: 31/51 |
0.011 Rank: 13/51 |
0.65354 (±0.00000) Rank: 1/51 |
0.77101 (±0.00000) Rank: 1/51 |
Pond | 7420.8 | — | 1422.9 | 0.111 Rank: 26/51 |
0.049 Rank: 27/51 |
0.64088 (±0.00000) Rank: 1/51 |
0.76212 (±0.00000) Rank: 1/51 |
Tree | 7575.0 | — | 1013.6 | 0.091 Rank: 33/51 |
0.022 Rank: 5/51 |
0.80839 (±0.00000) Rank: 2/51 |
0.88786 (±0.00000) Rank: 2/51 |
Avg | 7438.0 | — | 1215.0 | 0.096 Rank: 33/51 |
0.027 Rank: 23/51 |
0.70094 (±0.00000) Rank: 1/51 |
0.80700 (±0.00000) Rank: 1/51 |
We show the inliers that survive the robust estimation loop (i.e. RANSAC), or those supplied with the submission if using custom matches, and use the depth estimates to determine whether they are correct. We draw matches above a 5-pixel error threshold in red, and those below are color-coded by their error, from 0 (green) to 5 pixels (yellow). Matches for which we do not have depth estimates are drawn in blue. Please note that the depth maps are estimates and may contain errors.
— Lizard —










— Pond —










— Tree —










Prague Parks dataset / Multiview track
mAA at 10 degrees: N/A (±0.00000 over 1 run(s) / ±0.13823 over 3 scenes)
Rank (per category): 5 (of 51)
Scene | Features | Matches (input) |
Registration Ratio (%) |
Number of Landmarks |
Track Length | ATE | mAA(50) | mAA(100) |
Lizard | 7318.1 | 1349.62 | 85.30 Rank: 4/51 |
4104.47 Rank: 4/51 |
3.425 Rank: 13/51 |
14.29127 Rank: 35/51 |
0.60191 (±0.00000) Rank: 2/51 |
0.67836 (±0.00000) Rank: 2/51 |
Pond | 7420.8 | 1727.20 | 72.37 Rank: 4/51 |
4397.82 Rank: 4/51 |
3.154 Rank: 7/51 |
0.45778 Rank: 40/51 |
0.30587 (±0.00000) Rank: 6/51 |
0.34210 (±0.00000) Rank: 2/51 |
Tree | 7575.0 | 1073.44 | 71.57 Rank: 19/51 |
2473.92 Rank: 7/51 |
3.071 Rank: 8/51 |
6.13678 Rank: 27/51 |
0.44982 (±0.00000) Rank: 18/51 |
0.47588 (±0.00000) Rank: 21/51 |
Avg | 7438.0 | 1383.42 | 76.41 Rank: 5/51 |
3658.74 Rank: 4/51 |
3.217 Rank: 7/51 |
6.96194 Rank: 32/51 |
0.45253 (±0.00000) Rank: 4/51 |
0.49878 (±0.00000) Rank: 5/51 |
Google Urban dataset / Stereo track
mAA at 10 degrees: 0.43952 (±0.00000 over 1 run(s) / ±0.13977 over 17 scenes)
Rank (per category): 1 (of 51)
Scene | Features | Matches (raw) |
Matches (final) |
mAA(5o) | mAA(10o) |
Amsterdam (AMS) | 7932.0 | — | 909.4 | 0.30714 (±0.00000) Rank: 1/51 |
0.47366 (±0.00000) Rank: 1/51 |
Bangkok (BGK) | 7924.5 | — | 1133.4 | 0.07146 (±0.00000) Rank: 10/51 |
0.19950 (±0.00000) Rank: 9/51 |
Barcelona (BCN) | 7933.6 | — | 602.6 | 0.13480 (±0.00000) Rank: 10/51 |
0.23333 (±0.00000) Rank: 7/51 |
Buenos Aires (BAR) | 7948.0 | — | 759.3 | 0.27397 (±0.00000) Rank: 1/51 |
0.43699 (±0.00000) Rank: 4/51 |
Cambridge (CAM) | 7756.2 | — | 876.7 | 0.33836 (±0.00000) Rank: 1/51 |
0.48699 (±0.00000) Rank: 1/51 |
Cannes (CAN) | 7923.5 | — | 881.4 | 0.44147 (±0.00000) Rank: 1/51 |
0.56682 (±0.00000) Rank: 1/51 |
Chicago (CHI) | 7797.3 | — | 451.3 | 0.23347 (±0.00000) Rank: 9/51 |
0.36243 (±0.00000) Rank: 8/51 |
Helsinki (HEL) | 7948.0 | — | 1372.4 | 0.43402 (±0.00000) Rank: 1/51 |
0.62758 (±0.00000) Rank: 1/51 |
Madrid (MAD) | 7948.0 | — | 502.9 | 0.11489 (±0.00000) Rank: 8/51 |
0.23891 (±0.00000) Rank: 8/51 |
Mountain View (MTV) | 7900.6 | — | 514.3 | 0.25977 (±0.00000) Rank: 8/51 |
0.41270 (±0.00000) Rank: 1/51 |
New Orleans (NOR) | 7916.5 | — | 520.1 | 0.31775 (±0.00000) Rank: 1/51 |
0.43728 (±0.00000) Rank: 1/51 |
San Francisco (SF) | 7602.7 | — | 824.2 | 0.20420 (±0.00000) Rank: 8/51 |
0.35827 (±0.00000) Rank: 1/51 |
Singapore (SG) | 7837.5 | — | 657.6 | 0.37215 (±0.00000) Rank: 1/51 |
0.49335 (±0.00000) Rank: 1/51 |
Sydney (SYD) | 7948.0 | — | 645.9 | 0.36856 (±0.00000) Rank: 3/51 |
0.52402 (±0.00000) Rank: 3/51 |
Tokyo (TOK) | 7948.0 | — | 820.5 | 0.63725 (±0.00000) Rank: 1/51 |
0.77353 (±0.00000) Rank: 1/51 |
Toronto (TOR) | 7928.5 | — | 413.3 | 0.27440 (±0.00000) Rank: 1/51 |
0.44920 (±0.00000) Rank: 1/51 |
Zurich (ZRH) | 7948.0 | — | 797.9 | 0.30241 (±0.00000) Rank: 1/51 |
0.39725 (±0.00000) Rank: 1/51 |
Average (Avg) | 7890.6 | — | 746.1 | 0.29918 (±0.00000) Rank: 1/51 |
0.43952 (±0.00000) Rank: 1/51 |
We show the inliers that survive the robust estimation loop (i.e. RANSAC), or those supplied with the submission if using custom matches. As the dataset does not contain depth, we color them based on the symmetric epopilar distance on normalized coordinates: from 0 (green) to 2e-4 (yellow), and in red above it. Note that these occasionally contain false positives.
— Amsterdam —










— Bangkok —










— Barcelona —










— Buenos Aires —










— Cambridge —










— Cannes —










— Chicago —










— Helsinki —










— Madrid —










— Mountain View —










— New Orleans —










— San Francisco —










— Singapore —










— Sydney —










— Tokyo —










— Toronto —










— Zurich —










Google Urban dataset / Multiview track
mAA at 10 degrees: N/A (±0.00000 over 1 run(s) / ±0.14519 over 17 scenes)
Rank (per category): 1 (of 51)
Scene | Features | Matches (input) |
Registration Ratio (%) |
Number of Landmarks |
Track Length | ATE | mAA(50) | mAA(100) |
AMS | 7932.0 | 567.93 | 92.40 Rank: 7/51 |
4541.22 Rank: 7/51 |
3.759 Rank: 4/51 |
26.33682 Rank: 21/51 |
0.35568 (±0.00000) Rank: 7/51 |
0.46149 (±0.00000) Rank: 10/51 |
BGK | 7924.5 | 769.02 | 97.07 Rank: 9/51 |
7458.28 Rank: 5/51 |
3.667 Rank: 7/51 |
14.83294 Rank: 25/51 |
0.02215 (±0.00000) Rank: 16/51 |
0.07575 (±0.00000) Rank: 17/51 |
BCN | 7933.6 | 357.01 | 89.20 Rank: 2/51 |
2823.71 Rank: 7/51 |
3.615 Rank: 4/51 |
30.17880 Rank: 27/51 |
0.16424 (±0.00000) Rank: 5/51 |
0.25928 (±0.00000) Rank: 4/51 |
BAR | 7948.0 | 431.68 | 92.00 Rank: 1/51 |
3230.32 Rank: 7/51 |
3.291 Rank: 3/51 |
16.03430 Rank: 20/51 |
0.15645 (±0.00000) Rank: 8/51 |
0.26335 (±0.00000) Rank: 7/51 |
CAM | 7756.2 | 529.43 | 93.07 Rank: 1/51 |
4399.32 Rank: 3/51 |
3.537 Rank: 4/51 |
30.81018 Rank: 28/51 |
0.20221 (±0.00000) Rank: 2/51 |
0.30347 (±0.00000) Rank: 2/51 |
CAN | 7923.5 | 486.72 | 88.74 Rank: 1/51 |
2708.35 Rank: 6/51 |
3.550 Rank: 2/51 |
28.80093 Rank: 28/51 |
0.10188 (±0.00000) Rank: 6/51 |
0.17409 (±0.00000) Rank: 4/51 |
CHI | 7797.3 | 396.50 | 88.00 Rank: 10/51 |
1145.61 Rank: 7/51 |
4.967 Rank: 6/51 |
47.99844 Rank: 23/51 |
0.14892 (±0.00000) Rank: 8/51 |
0.24132 (±0.00000) Rank: 8/51 |
HEL | 7948.0 | 975.64 | 95.73 Rank: 3/51 |
6884.10 Rank: 2/51 |
3.910 Rank: 5/51 |
14.02448 Rank: 25/51 |
0.32767 (±0.00000) Rank: 1/51 |
0.45497 (±0.00000) Rank: 3/51 |
MAD | 7948.0 | 315.80 | 93.07 Rank: 1/51 |
3357.63 Rank: 7/51 |
3.312 Rank: 7/51 |
6.64869 Rank: 25/51 |
0.09696 (±0.00000) Rank: 2/51 |
0.21127 (±0.00000) Rank: 2/51 |
MTV | 7900.6 | 388.50 | 93.20 Rank: 3/51 |
3051.79 Rank: 7/51 |
3.798 Rank: 5/51 |
16.13885 Rank: 25/51 |
0.26798 (±0.00000) Rank: 3/51 |
0.40420 (±0.00000) Rank: 3/51 |
NOR | 7916.5 | 340.33 | 90.32 Rank: 1/51 |
2955.14 Rank: 6/51 |
3.290 Rank: 3/51 |
13.18759 Rank: 24/51 |
0.31816 (±0.00000) Rank: 1/51 |
0.40416 (±0.00000) Rank: 1/51 |
SF | 7602.7 | 517.17 | 97.60 Rank: 1/51 |
4327.76 Rank: 5/51 |
3.697 Rank: 3/51 |
19.82951 Rank: 25/51 |
0.28621 (±0.00000) Rank: 1/51 |
0.42618 (±0.00000) Rank: 1/51 |
SG | 7837.5 | 402.84 | 83.08 Rank: 1/51 |
3085.35 Rank: 5/51 |
3.293 Rank: 2/51 |
18.41632 Rank: 26/51 |
0.28208 (±0.00000) Rank: 1/51 |
0.36017 (±0.00000) Rank: 1/51 |
SYD | 7948.0 | 386.27 | 91.39 Rank: 1/51 |
3135.78 Rank: 6/51 |
3.535 Rank: 2/51 |
23.11808 Rank: 28/51 |
0.33127 (±0.00000) Rank: 1/51 |
0.42515 (±0.00000) Rank: 1/51 |
TOK | 7948.0 | 515.71 | 92.93 Rank: 3/51 |
5266.02 Rank: 6/51 |
3.680 Rank: 4/51 |
14.48514 Rank: 20/51 |
0.65316 (±0.00000) Rank: 3/51 |
0.73176 (±0.00000) Rank: 3/51 |
TOR | 7928.5 | 251.39 | 90.13 Rank: 7/51 |
2471.40 Rank: 7/51 |
3.239 Rank: 7/51 |
17.20514 Rank: 21/51 |
0.19661 (±0.00000) Rank: 1/51 |
0.32496 (±0.00000) Rank: 2/51 |
ZRH | 7948.0 | 482.88 | 89.19 Rank: 2/51 |
4484.00 Rank: 3/51 |
3.402 Rank: 3/51 |
18.67775 Rank: 21/51 |
0.13180 (±0.00000) Rank: 6/51 |
0.21319 (±0.00000) Rank: 6/51 |
Avg | 7890.6 | 477.34 | 91.60 Rank: 1/51 |
3842.69 Rank: 6/51 |
3.620 Rank: 4/51 |
20.98376 Rank: 28/51 |
0.23785 (±0.00000) Rank: 1/51 |
0.33734 (±0.00000) Rank: 1/51 |
In the multi-view track we reconstruct the scene with Structure-from-Motion (Colmap) with small sets of images. We show the results for one bag of 10 images. Keypoints are drawn in blue if they are part of the model, and in red otherwise.
— Amsterdam —










— Bangkok —










— Barcelona —










— Buenos Aires —










— Cambridge —










— Cannes —










— Chicago —










— Helsinki —










— Madrid —










— Mountain View —










— New Orleans —










— San Francisco —










— Singapore —










— Sydney —










— Tokyo —










— Toronto —










— Zurich —









