Submission ID: d7503ab2
mssscalev2
Processed: 21-06-05. Download link: d7503ab255cc200d-603json.json
This page ranks the submission against all others using the same number of keypoints, regardless of descriptor size. Please hover over table headers for descriptions on metrics and full scene names.
- Phototourism dataset: Stereo track / Multiview track
- Prague Parks dataset: Stereo track / Multiview track
- Google Urban dataset: Stereo track / Multiview track
Metadata
- Authors: Xiaopeng Bi, Yu Chen, Xinyang Liu, Dehao Zhang, Ran Yan, Zheng Chai, Haotian Zhang, and Xiao Liu (contact)
- Keypoint: superpoint
- Descriptor: mss (0 none: 0 bytes)
- Number of features: 2048
- Summary: superpoint with 2k features, using the guided superglue matching
- Paper: N/A
- Website: N/A
- Processing date: 21-06-05
Phototourism dataset / Stereo track
mAA at 10 degrees: 0.59205 (±0.00000 over 1 run(s) / ±0.12847 over 9 scenes)
Rank (per category): 9 (of 87)
Scene | Features | Matches (raw) |
Matches (final) |
Rep. @ 3 px. | MS @ 3 px. | mAA(5o) | mAA(10o) |
BM | 2046.0 | — | 415.1 | 0.470 Rank: 35/87 |
0.897 Rank: 38/87 |
0.35139 (±0.00000) Rank: 10/87 |
0.50609 (±0.00000) Rank: 10/87 |
FCS | 2046.8 | — | 541.8 | 0.418 Rank: 10/87 |
0.873 Rank: 19/87 |
0.65746 (±0.00000) Rank: 17/87 |
0.77328 (±0.00000) Rank: 19/87 |
LMS | 2048.0 | — | 555.4 | 0.449 Rank: 20/87 |
0.689 Rank: 33/87 |
0.62548 (±0.00000) Rank: 13/87 |
0.74550 (±0.00000) Rank: 14/87 |
LB | 2048.0 | — | 414.4 | 0.406 Rank: 20/87 |
0.704 Rank: 39/87 |
0.50085 (±0.00000) Rank: 10/87 |
0.61483 (±0.00000) Rank: 11/87 |
MC | 2048.0 | — | 452.9 | 0.429 Rank: 28/87 |
0.860 Rank: 43/87 |
0.35336 (±0.00000) Rank: 10/87 |
0.51201 (±0.00000) Rank: 19/87 |
MR | 2045.2 | — | 464.6 | 0.427 Rank: 33/87 |
0.901 Rank: 32/87 |
0.28673 (±0.00000) Rank: 10/87 |
0.40444 (±0.00000) Rank: 8/87 |
PSM | 2048.0 | — | 403.8 | 0.339 Rank: 38/87 |
0.620 Rank: 21/87 |
0.26197 (±0.00000) Rank: 9/87 |
0.42303 (±0.00000) Rank: 10/87 |
SF | 2048.0 | — | 521.1 | 0.377 Rank: 25/87 |
0.790 Rank: 34/87 |
0.51531 (±0.00000) Rank: 19/87 |
0.66021 (±0.00000) Rank: 19/87 |
SPC | 2048.0 | — | 433.5 | 0.386 Rank: 37/87 |
0.801 Rank: 28/87 |
0.52585 (±0.00000) Rank: 10/87 |
0.68908 (±0.00000) Rank: 15/87 |
Avg | 2047.3 | — | 467.0 | 0.411 Rank: 33/87 |
0.793 Rank: 22/87 |
0.45315 (±0.00000) Rank: 8/87 |
0.59205 (±0.00000) Rank: 9/87 |
We show the inliers that survive the robust estimation loop (i.e. RANSAC), or those supplied with the submission if using custom matches, and use the depth estimates to determine whether they are correct. We draw matches above a 5-pixel error threshold in red, and those below are color-coded by their error, from 0 (green) to 5 pixels (yellow). Matches for which we do not have depth estimates are drawn in blue. Please note that the depth maps are estimates and may contain errors.
— British Museum —
— Florence Cathedral Side —
— Lincoln Memorial Statue —
— London Bridge —
— Milan Cathedral —
— Mount Rushmore —
— Piazza San Marco —
— Sagrada Familia —
— Saint Paul's Cathedral —
Phototourism dataset / Multiview track
mAA at 10 degrees: N/A (±0.00000 over 1 run(s) / ±0.09757 over 9 scenes)
Rank (per category): 10 (of 87)
Scene | Features | Matches (input) |
RegistrationRatio (%) | Number of Landmarks |
Track Length | ATE | mAA(50) | mAA(100) |
BM | 2046.0 | 415.62 | 99.81 Rank: 46/87 |
2094.12 Rank: 30/87 |
5.004 Rank: 30/87 |
0.35833 Rank: 28/87 |
0.58940 (±0.00000) Rank: 23/87 |
0.72505 (±0.00000) Rank: 23/87 |
FCS | 2046.8 | 549.42 | 97.63 Rank: 45/87 |
2662.55 Rank: 25/87 |
5.068 Rank: 36/87 |
0.24934 Rank: 34/87 |
0.73207 (±0.00000) Rank: 38/87 |
0.78732 (±0.00000) Rank: 42/87 |
LMS | 2048.0 | 581.11 | 99.55 Rank: 13/87 |
2031.77 Rank: 22/87 |
5.848 Rank: 20/87 |
0.24967 Rank: 5/87 |
0.88141 (±0.00000) Rank: 2/87 |
0.92816 (±0.00000) Rank: 2/87 |
LB | 2048.0 | 489.11 | 98.23 Rank: 32/87 |
2128.51 Rank: 21/87 |
5.394 Rank: 23/87 |
0.48268 Rank: 27/87 |
0.72278 (±0.00000) Rank: 21/87 |
0.81458 (±0.00000) Rank: 18/87 |
MC | 2048.0 | 445.44 | 100.00 Rank: 1/87 |
2220.31 Rank: 31/87 |
5.247 Rank: 22/87 |
0.35744 Rank: 34/87 |
0.55981 (±0.00000) Rank: 17/87 |
0.70812 (±0.00000) Rank: 15/87 |
MR | 2045.2 | 457.77 | 97.27 Rank: 1/87 |
2331.60 Rank: 27/87 |
5.028 Rank: 4/87 |
0.51085 Rank: 29/87 |
0.45207 (±0.00000) Rank: 4/87 |
0.57656 (±0.00000) Rank: 4/87 |
PSM | 2048.0 | 402.51 | 99.44 Rank: 20/87 |
2557.80 Rank: 24/87 |
4.628 Rank: 10/87 |
0.35821 Rank: 33/87 |
0.65233 (±0.00000) Rank: 16/87 |
0.73986 (±0.00000) Rank: 18/87 |
SF | 2048.0 | 513.94 | 99.93 Rank: 13/87 |
2831.31 Rank: 21/87 |
5.099 Rank: 9/87 |
0.27726 Rank: 12/87 |
0.78092 (±0.00000) Rank: 20/87 |
0.86369 (±0.00000) Rank: 19/87 |
SPC | 2048.0 | 443.52 | 100.00 Rank: 1/87 |
2326.19 Rank: 28/87 |
5.210 Rank: 21/87 |
0.40966 Rank: 11/87 |
0.75335 (±0.00000) Rank: 28/87 |
0.84629 (±0.00000) Rank: 29/87 |
Avg | 2047.3 | 477.61 | 99.09 Rank: 3/87 |
2353.80 Rank: 25/87 |
5.170 Rank: 19/87 |
0.36149 Rank: 16/87 |
0.68046 (±0.00000) Rank: 12/87 |
0.77662 (±0.00000) Rank: 10/87 |
In the multi-view track we reconstruct the scene with Structure-from-Motion (Colmap) with small sets of images. We show the results for one bag of 10 images. Keypoints are drawn in blue if they are part of the model, and in red otherwise.
— British Museum —
— Florence Cathedral Side —
— Lincoln Memorial Statue —
— London Bridge —
— Milan Cathedral —
— Mount Rushmore —
— Piazza San Marco —
— Sagrada Familia —
— Saint Paul's Cathedral —
Prague Parks dataset / Stereo track
mAA at 10 degrees: 0.77377 (±0.00000 over 1 run(s) / ±0.04383 over 3 scenes)
Rank (per category): 6 (of 87)
Scene | Features | Matches (raw) |
Matches (final) |
Rep. @ 3 px. | MS @ 3 px. | mAA(5o) | mAA(10o) |
Lizard | 2048.0 | — | 403.2 | 0.035 Rank: 32/87 |
0.013 Rank: 8/87 |
0.62191 (±0.00000) Rank: 8/87 |
0.75340 (±0.00000) Rank: 6/87 |
Pond | 2048.0 | — | 421.9 | 0.048 Rank: 41/87 |
0.046 Rank: 58/87 |
0.60040 (±0.00000) Rank: 5/87 |
0.73327 (±0.00000) Rank: 6/87 |
Tree | 2048.0 | — | 275.6 | 0.029 Rank: 39/87 |
0.024 Rank: 23/87 |
0.73289 (±0.00000) Rank: 13/87 |
0.83466 (±0.00000) Rank: 15/87 |
Avg | 2048.0 | — | 366.9 | 0.038 Rank: 36/87 |
0.028 Rank: 19/87 |
0.65174 (±0.00000) Rank: 8/87 |
0.77377 (±0.00000) Rank: 6/87 |
We show the inliers that survive the robust estimation loop (i.e. RANSAC), or those supplied with the submission if using custom matches, and use the depth estimates to determine whether they are correct. We draw matches above a 5-pixel error threshold in red, and those below are color-coded by their error, from 0 (green) to 5 pixels (yellow). Matches for which we do not have depth estimates are drawn in blue. Please note that the depth maps are estimates and may contain errors.
— Lizard —
— Pond —
— Tree —
Prague Parks dataset / Multiview track
mAA at 10 degrees: N/A (±0.00000 over 1 run(s) / ±0.14105 over 3 scenes)
Rank (per category): 3 (of 87)
Scene | Features | Matches (input) |
RegistrationRatio (%) | Number of Landmarks |
Track Length | ATE | mAA(50) | mAA(100) |
Lizard | 2048.0 | 422.06 | 85.70 Rank: 2/87 |
1290.16 Rank: 6/87 |
3.363 Rank: 46/87 |
14.45755 Rank: 56/87 |
0.59373 (±0.00000) Rank: 14/87 |
0.67711 (±0.00000) Rank: 9/87 |
Pond | 2048.0 | 453.30 | 68.37 Rank: 34/87 |
1048.06 Rank: 17/87 |
2.809 Rank: 55/87 |
0.43908 Rank: 54/87 |
0.30276 (±0.00000) Rank: 4/87 |
0.33183 (±0.00000) Rank: 6/87 |
Tree | 2048.0 | 265.72 | 70.96 Rank: 40/87 |
613.72 Rank: 11/87 |
2.991 Rank: 30/87 |
6.10088 Rank: 47/87 |
0.46216 (±0.00000) Rank: 12/87 |
0.49381 (±0.00000) Rank: 14/87 |
Avg | 2048.0 | 380.36 | 75.01 Rank: 28/87 |
983.98 Rank: 11/87 |
3.054 Rank: 46/87 |
6.99917 Rank: 61/87 |
0.45288 (±0.00000) Rank: 2/87 |
0.50092 (±0.00000) Rank: 3/87 |
Google Urban dataset / Stereo track
mAA at 10 degrees: 0.40769 (±0.00000 over 1 run(s) / ±0.13719 over 17 scenes)
Rank (per category): 10 (of 87)
Scene | Features | Matches (raw) |
Matches (final) |
mAA(5o) | mAA(10o) |
Amsterdam (AMS) | 2048.0 | — | 287.9 | 0.27768 (±0.00000) Rank: 6/87 |
0.44420 (±0.00000) Rank: 5/87 |
Bangkok (BGK) | 2048.0 | — | 411.5 | 0.06452 (±0.00000) Rank: 15/87 |
0.18288 (±0.00000) Rank: 12/87 |
Barcelona (BCN) | 2046.3 | — | 294.8 | 0.11575 (±0.00000) Rank: 25/87 |
0.20733 (±0.00000) Rank: 24/87 |
Buenos Aires (BAR) | 2048.0 | — | 285.0 | 0.21461 (±0.00000) Rank: 6/87 |
0.35662 (±0.00000) Rank: 33/87 |
Cambridge (CAM) | 2047.6 | — | 294.5 | 0.30753 (±0.00000) Rank: 6/87 |
0.45616 (±0.00000) Rank: 23/87 |
Cannes (CAN) | 2048.0 | — | 352.8 | 0.40276 (±0.00000) Rank: 18/87 |
0.52488 (±0.00000) Rank: 16/87 |
Chicago (CHI) | 2048.0 | — | 240.2 | 0.20710 (±0.00000) Rank: 14/87 |
0.34276 (±0.00000) Rank: 14/87 |
Helsinki (HEL) | 2048.0 | — | 527.0 | 0.38814 (±0.00000) Rank: 13/87 |
0.58814 (±0.00000) Rank: 10/87 |
Madrid (MAD) | 2048.0 | — | 214.3 | 0.10091 (±0.00000) Rank: 4/87 |
0.21489 (±0.00000) Rank: 7/87 |
Mountain View (MTV) | 2048.0 | — | 262.7 | 0.22500 (±0.00000) Rank: 25/87 |
0.37539 (±0.00000) Rank: 27/87 |
New Orleans (NOR) | 2039.2 | — | 243.3 | 0.28935 (±0.00000) Rank: 7/87 |
0.41006 (±0.00000) Rank: 4/87 |
San Francisco (SF) | 2048.0 | — | 334.5 | 0.19580 (±0.00000) Rank: 23/87 |
0.33963 (±0.00000) Rank: 28/87 |
Singapore (SG) | 2048.0 | — | 279.3 | 0.32975 (±0.00000) Rank: 20/87 |
0.46076 (±0.00000) Rank: 20/87 |
Sydney (SYD) | 2048.0 | — | 316.0 | 0.36070 (±0.00000) Rank: 4/87 |
0.51572 (±0.00000) Rank: 5/87 |
Tokyo (TOK) | 2048.0 | — | 367.5 | 0.59608 (±0.00000) Rank: 23/87 |
0.74510 (±0.00000) Rank: 13/87 |
Toronto (TOR) | 2048.0 | — | 234.1 | 0.23040 (±0.00000) Rank: 12/87 |
0.38880 (±0.00000) Rank: 15/87 |
Zurich (ZRH) | 2048.0 | — | 349.1 | 0.27835 (±0.00000) Rank: 6/87 |
0.37732 (±0.00000) Rank: 7/87 |
Average (Avg) | 2047.4 | — | 311.4 | 0.26967 (±0.00000) Rank: 11/87 |
0.40769 (±0.00000) Rank: 10/87 |
We show the inliers that survive the robust estimation loop (i.e. RANSAC), or those supplied with the submission if using custom matches. As the dataset does not contain depth, we color them based on the symmetric epopilar distance on normalized coordinates: from 0 (green) to 2e-4 (yellow), and in red above it. Note that these occasionally contain false positives.
— Amsterdam —
— Bangkok —
— Barcelona —
— Buenos Aires —
— Cambridge —
— Cannes —
— Chicago —
— Helsinki —
— Madrid —
— Mountain View —
— New Orleans —
— San Francisco —
— Singapore —
— Sydney —
— Tokyo —
— Toronto —
— Zurich —
Google Urban dataset / Multiview track
mAA at 10 degrees: N/A (±0.00000 over 1 run(s) / ±0.15179 over 17 scenes)
Rank (per category): 18 (of 87)
Scene | Features | Matches (input) |
RegistrationRatio (%) | Number of Landmarks |
Track Length | ATE | mAA(50) | mAA(100) |
AMS | 2048.0 | 195.50 | 92.13 Rank: 24/87 |
1447.19 Rank: 16/87 |
3.773 Rank: 28/87 |
26.93243 Rank: 44/87 |
0.38639 (±0.00000) Rank: 4/87 |
0.50619 (±0.00000) Rank: 8/87 |
BGK | 2048.0 | 290.91 | 96.93 Rank: 18/87 |
2543.27 Rank: 12/87 |
3.645 Rank: 29/87 |
11.76394 Rank: 11/87 |
0.03093 (±0.00000) Rank: 12/87 |
0.09710 (±0.00000) Rank: 8/87 |
BCN | 2046.3 | 185.68 | 89.07 Rank: 1/87 |
1398.27 Rank: 5/87 |
3.754 Rank: 23/87 |
30.14422 Rank: 48/87 |
0.14225 (±0.00000) Rank: 16/87 |
0.22554 (±0.00000) Rank: 16/87 |
BAR | 2048.0 | 173.55 | 89.46 Rank: 4/87 |
1389.74 Rank: 4/87 |
3.376 Rank: 26/87 |
17.95040 Rank: 52/87 |
0.16681 (±0.00000) Rank: 17/87 |
0.27917 (±0.00000) Rank: 11/87 |
CAM | 2047.6 | 194.79 | 87.93 Rank: 23/87 |
1311.65 Rank: 16/87 |
3.422 Rank: 39/87 |
25.37302 Rank: 24/87 |
0.15724 (±0.00000) Rank: 29/87 |
0.24454 (±0.00000) Rank: 29/87 |
CAN | 2048.0 | 203.60 | 77.20 Rank: 26/87 |
907.33 Rank: 18/87 |
3.425 Rank: 35/87 |
18.99573 Rank: 26/87 |
0.07422 (±0.00000) Rank: 19/87 |
0.13288 (±0.00000) Rank: 20/87 |
CHI | 2048.0 | 214.87 | 90.00 Rank: 14/87 |
663.29 Rank: 15/87 |
4.876 Rank: 14/87 |
46.24938 Rank: 20/87 |
0.16191 (±0.00000) Rank: 11/87 |
0.26757 (±0.00000) Rank: 9/87 |
HEL | 2048.0 | 382.03 | 93.73 Rank: 31/87 |
2230.90 Rank: 26/87 |
3.977 Rank: 34/87 |
14.33412 Rank: 29/87 |
0.29849 (±0.00000) Rank: 35/87 |
0.41867 (±0.00000) Rank: 40/87 |
MAD | 2048.0 | 147.66 | 91.83 Rank: 8/87 |
1508.24 Rank: 10/87 |
3.284 Rank: 25/87 |
6.69303 Rank: 35/87 |
0.10284 (±0.00000) Rank: 13/87 |
0.20961 (±0.00000) Rank: 17/87 |
MTV | 2048.0 | 198.34 | 92.98 Rank: 6/87 |
1538.50 Rank: 11/87 |
3.831 Rank: 18/87 |
16.38074 Rank: 27/87 |
0.27515 (±0.00000) Rank: 25/87 |
0.40847 (±0.00000) Rank: 23/87 |
NOR | 2039.2 | 164.56 | 88.53 Rank: 16/87 |
1311.42 Rank: 10/87 |
3.382 Rank: 22/87 |
12.99411 Rank: 28/87 |
0.27512 (±0.00000) Rank: 21/87 |
0.36944 (±0.00000) Rank: 21/87 |
SF | 2048.0 | 229.84 | 97.07 Rank: 3/87 |
1771.03 Rank: 16/87 |
3.742 Rank: 21/87 |
18.92856 Rank: 18/87 |
0.29235 (±0.00000) Rank: 16/87 |
0.44003 (±0.00000) Rank: 16/87 |
SG | 2048.0 | 179.89 | 79.08 Rank: 15/87 |
1049.45 Rank: 28/87 |
3.356 Rank: 21/87 |
17.20030 Rank: 29/87 |
0.22063 (±0.00000) Rank: 27/87 |
0.29066 (±0.00000) Rank: 26/87 |
SYD | 2048.0 | 202.17 | 91.55 Rank: 6/87 |
1612.65 Rank: 10/87 |
3.559 Rank: 25/87 |
20.90002 Rank: 30/87 |
0.33978 (±0.00000) Rank: 8/87 |
0.44199 (±0.00000) Rank: 7/87 |
TOK | 2048.0 | 235.75 | 92.93 Rank: 22/87 |
2089.79 Rank: 18/87 |
3.732 Rank: 25/87 |
14.36427 Rank: 25/87 |
0.65837 (±0.00000) Rank: 27/87 |
0.73539 (±0.00000) Rank: 25/87 |
TOR | 2048.0 | 154.49 | 89.73 Rank: 9/87 |
1466.03 Rank: 16/87 |
3.183 Rank: 34/87 |
16.90120 Rank: 25/87 |
0.18428 (±0.00000) Rank: 29/87 |
0.31553 (±0.00000) Rank: 27/87 |
ZRH | 2048.0 | 224.02 | 90.79 Rank: 11/87 |
1806.86 Rank: 16/87 |
3.428 Rank: 28/87 |
19.97786 Rank: 32/87 |
0.10776 (±0.00000) Rank: 25/87 |
0.18107 (±0.00000) Rank: 23/87 |
Avg | 2047.4 | 210.45 | 90.06 Rank: 11/87 |
1532.10 Rank: 17/87 |
3.632 Rank: 30/87 |
19.76961 Rank: 24/87 |
0.22791 (±0.00000) Rank: 21/87 |
0.32729 (±0.00000) Rank: 18/87 |
In the multi-view track we reconstruct the scene with Structure-from-Motion (Colmap) with small sets of images. We show the results for one bag of 10 images. Keypoints are drawn in blue if they are part of the model, and in red otherwise.
— Amsterdam —
— Bangkok —
— Barcelona —
— Buenos Aires —
— Cambridge —
— Cannes —
— Chicago —
— Helsinki —
— Madrid —
— Mountain View —
— New Orleans —
— San Francisco —
— Singapore —
— Sydney —
— Tokyo —
— Toronto —
— Zurich —