Submission ID: 1bc99607
e2e
Processed: 21-05-14. Download link: 1bc99607752e0369-e2e.json
This page ranks the submission against all others using the same number of keypoints, regardless of descriptor size. Please hover over table headers for descriptions on metrics and full scene names.
- Phototourism dataset: Stereo track / Multiview track
- Prague Parks dataset: Stereo track / Multiview track
- Google Urban dataset: Stereo track / Multiview track
Metadata
- Authors: big (contact)
- Keypoint: superpoint
- Descriptor: superpoint (128 float32: 512 bytes)
- Number of features: 2048
- Summary: superpoint
- Paper: N/A
- Website: N/A
- Processing date: 21-05-14
Phototourism dataset / Stereo track
mAA at 10 degrees: 0.58705 (±0.00000 over 1 run(s) / ±0.13361 over 9 scenes)
Rank (per category): 16 (of 87)
Scene | Features | Matches (raw) |
Matches (final) |
Rep. @ 3 px. | MS @ 3 px. | mAA(5o) | mAA(10o) |
BM | 2048.0 | — | 353.7 | 0.454 Rank: 51/87 |
0.896 Rank: 42/87 |
0.35135 (±0.00000) Rank: 11/87 |
0.50743 (±0.00000) Rank: 8/87 |
FCS | 2048.0 | — | 508.4 | 0.413 Rank: 29/87 |
0.872 Rank: 27/87 |
0.65794 (±0.00000) Rank: 13/87 |
0.77386 (±0.00000) Rank: 18/87 |
LMS | 2048.0 | — | 561.6 | 0.454 Rank: 15/87 |
0.693 Rank: 23/87 |
0.62523 (±0.00000) Rank: 14/87 |
0.74453 (±0.00000) Rank: 16/87 |
LB | 2048.0 | — | 367.4 | 0.393 Rank: 41/87 |
0.708 Rank: 29/87 |
0.50754 (±0.00000) Rank: 11/87 |
0.61765 (±0.00000) Rank: 7/87 |
MC | 2048.0 | — | 390.7 | 0.416 Rank: 42/87 |
0.859 Rank: 48/87 |
0.35638 (±0.00000) Rank: 11/87 |
0.51047 (±0.00000) Rank: 22/87 |
MR | 2048.0 | — | 379.0 | 0.415 Rank: 50/87 |
0.903 Rank: 27/87 |
0.27681 (±0.00000) Rank: 28/87 |
0.39504 (±0.00000) Rank: 20/87 |
PSM | 2048.0 | — | 352.7 | 0.328 Rank: 58/87 |
0.609 Rank: 37/87 |
0.23959 (±0.00000) Rank: 22/87 |
0.39516 (±0.00000) Rank: 26/87 |
SF | 2048.0 | — | 501.1 | 0.374 Rank: 37/87 |
0.790 Rank: 31/87 |
0.50795 (±0.00000) Rank: 27/87 |
0.65408 (±0.00000) Rank: 27/87 |
SPC | 2048.0 | — | 393.0 | 0.376 Rank: 50/87 |
0.800 Rank: 37/87 |
0.51953 (±0.00000) Rank: 25/87 |
0.68520 (±0.00000) Rank: 21/87 |
Avg | 2048.0 | — | 423.1 | 0.403 Rank: 50/87 |
0.792 Rank: 30/87 |
0.44915 (±0.00000) Rank: 16/87 |
0.58705 (±0.00000) Rank: 16/87 |
We show the inliers that survive the robust estimation loop (i.e. RANSAC), or those supplied with the submission if using custom matches, and use the depth estimates to determine whether they are correct. We draw matches above a 5-pixel error threshold in red, and those below are color-coded by their error, from 0 (green) to 5 pixels (yellow). Matches for which we do not have depth estimates are drawn in blue. Please note that the depth maps are estimates and may contain errors.
— British Museum —
— Florence Cathedral Side —
— Lincoln Memorial Statue —
— London Bridge —
— Milan Cathedral —
— Mount Rushmore —
— Piazza San Marco —
— Sagrada Familia —
— Saint Paul's Cathedral —
Phototourism dataset / Multiview track
mAA at 10 degrees: N/A (±0.00000 over 1 run(s) / ±0.09866 over 9 scenes)
Rank (per category): 18 (of 87)
Scene | Features | Matches (input) |
RegistrationRatio (%) | Number of Landmarks |
Track Length | ATE | mAA(50) | mAA(100) |
BM | 2048.0 | 353.46 | 99.87 Rank: 32/87 |
1887.23 Rank: 43/87 |
4.883 Rank: 51/87 |
0.33460 Rank: 4/87 |
0.59584 (±0.00000) Rank: 14/87 |
0.73288 (±0.00000) Rank: 12/87 |
FCS | 2048.0 | 514.37 | 96.51 Rank: 64/87 |
2503.81 Rank: 40/87 |
5.067 Rank: 37/87 |
0.25782 Rank: 47/87 |
0.72612 (±0.00000) Rank: 42/87 |
0.77961 (±0.00000) Rank: 48/87 |
LMS | 2048.0 | 588.41 | 99.55 Rank: 13/87 |
2002.26 Rank: 30/87 |
5.909 Rank: 11/87 |
0.27746 Rank: 20/87 |
0.86520 (±0.00000) Rank: 12/87 |
0.91216 (±0.00000) Rank: 14/87 |
LB | 2048.0 | 440.46 | 98.29 Rank: 29/87 |
1919.06 Rank: 39/87 |
5.401 Rank: 17/87 |
0.50533 Rank: 62/87 |
0.71929 (±0.00000) Rank: 27/87 |
0.81278 (±0.00000) Rank: 22/87 |
MC | 2048.0 | 384.22 | 100.00 Rank: 1/87 |
2019.36 Rank: 42/87 |
5.099 Rank: 46/87 |
0.33284 Rank: 12/87 |
0.55658 (±0.00000) Rank: 24/87 |
0.70240 (±0.00000) Rank: 26/87 |
MR | 2048.0 | 373.27 | 95.73 Rank: 6/87 |
1905.96 Rank: 49/87 |
4.822 Rank: 36/87 |
0.45606 Rank: 1/87 |
0.43674 (±0.00000) Rank: 25/87 |
0.55774 (±0.00000) Rank: 27/87 |
PSM | 2048.0 | 350.63 | 99.49 Rank: 17/87 |
2371.53 Rank: 40/87 |
4.596 Rank: 15/87 |
0.33258 Rank: 18/87 |
0.66305 (±0.00000) Rank: 5/87 |
0.75299 (±0.00000) Rank: 5/87 |
SF | 2048.0 | 493.32 | 99.81 Rank: 21/87 |
2730.74 Rank: 34/87 |
5.064 Rank: 21/87 |
0.28415 Rank: 34/87 |
0.77783 (±0.00000) Rank: 28/87 |
0.86065 (±0.00000) Rank: 27/87 |
SPC | 2048.0 | 402.90 | 100.00 Rank: 1/87 |
2167.40 Rank: 42/87 |
5.146 Rank: 32/87 |
0.42357 Rank: 17/87 |
0.75240 (±0.00000) Rank: 30/87 |
0.84779 (±0.00000) Rank: 27/87 |
Avg | 2048.0 | 433.45 | 98.81 Rank: 26/87 |
2167.48 Rank: 40/87 |
5.110 Rank: 29/87 |
0.35605 Rank: 7/87 |
0.67700 (±0.00000) Rank: 20/87 |
0.77322 (±0.00000) Rank: 18/87 |
In the multi-view track we reconstruct the scene with Structure-from-Motion (Colmap) with small sets of images. We show the results for one bag of 10 images. Keypoints are drawn in blue if they are part of the model, and in red otherwise.
— British Museum —
— Florence Cathedral Side —
— Lincoln Memorial Statue —
— London Bridge —
— Milan Cathedral —
— Mount Rushmore —
— Piazza San Marco —
— Sagrada Familia —
— Saint Paul's Cathedral —
Prague Parks dataset / Stereo track
mAA at 10 degrees: 0.74246 (±0.00000 over 1 run(s) / ±0.05454 over 3 scenes)
Rank (per category): 27 (of 87)
Scene | Features | Matches (raw) |
Matches (final) |
Rep. @ 3 px. | MS @ 3 px. | mAA(5o) | mAA(10o) |
Lizard | 2048.0 | — | 306.6 | 0.035 Rank: 42/87 |
0.010 Rank: 32/87 |
0.59584 (±0.00000) Rank: 14/87 |
0.73190 (±0.00000) Rank: 14/87 |
Pond | 2048.0 | — | 295.9 | 0.049 Rank: 37/87 |
0.049 Rank: 26/87 |
0.52224 (±0.00000) Rank: 41/87 |
0.68156 (±0.00000) Rank: 38/87 |
Tree | 2048.0 | — | 191.1 | 0.030 Rank: 38/87 |
0.025 Rank: 14/87 |
0.70110 (±0.00000) Rank: 22/87 |
0.81391 (±0.00000) Rank: 22/87 |
Avg | 2048.0 | — | 264.5 | 0.038 Rank: 35/87 |
0.028 Rank: 20/87 |
0.60640 (±0.00000) Rank: 29/87 |
0.74246 (±0.00000) Rank: 27/87 |
We show the inliers that survive the robust estimation loop (i.e. RANSAC), or those supplied with the submission if using custom matches, and use the depth estimates to determine whether they are correct. We draw matches above a 5-pixel error threshold in red, and those below are color-coded by their error, from 0 (green) to 5 pixels (yellow). Matches for which we do not have depth estimates are drawn in blue. Please note that the depth maps are estimates and may contain errors.
— Lizard —
— Pond —
— Tree —
Prague Parks dataset / Multiview track
mAA at 10 degrees: N/A (±0.00000 over 1 run(s) / ±0.15143 over 3 scenes)
Rank (per category): 34 (of 87)
Scene | Features | Matches (input) |
RegistrationRatio (%) | Number of Landmarks |
Track Length | ATE | mAA(50) | mAA(100) |
Lizard | 2048.0 | 327.88 | 85.30 Rank: 19/87 |
1013.39 Rank: 37/87 |
3.495 Rank: 2/87 |
14.12119 Rank: 29/87 |
0.59080 (±0.00000) Rank: 18/87 |
0.67171 (±0.00000) Rank: 19/87 |
Pond | 2048.0 | 338.50 | 69.87 Rank: 16/87 |
896.54 Rank: 31/87 |
2.962 Rank: 27/87 |
0.42277 Rank: 25/87 |
0.27558 (±0.00000) Rank: 42/87 |
0.30093 (±0.00000) Rank: 45/87 |
Tree | 2048.0 | 186.83 | 71.14 Rank: 34/87 |
445.99 Rank: 48/87 |
3.020 Rank: 20/87 |
6.15248 Rank: 57/87 |
0.44369 (±0.00000) Rank: 22/87 |
0.47737 (±0.00000) Rank: 26/87 |
Avg | 2048.0 | 284.40 | 75.44 Rank: 15/87 |
785.31 Rank: 40/87 |
3.159 Rank: 14/87 |
6.89881 Rank: 38/87 |
0.43669 (±0.00000) Rank: 26/87 |
0.48334 (±0.00000) Rank: 34/87 |
Google Urban dataset / Stereo track
mAA at 10 degrees: 0.40366 (±0.00000 over 1 run(s) / ±0.13776 over 17 scenes)
Rank (per category): 16 (of 87)
Scene | Features | Matches (raw) |
Matches (final) |
mAA(5o) | mAA(10o) |
Amsterdam (AMS) | 2048.0 | — | 265.4 | 0.23661 (±0.00000) Rank: 25/87 |
0.39866 (±0.00000) Rank: 20/87 |
Bangkok (BGK) | 2048.0 | — | 351.1 | 0.05161 (±0.00000) Rank: 37/87 |
0.17022 (±0.00000) Rank: 25/87 |
Barcelona (BCN) | 2048.0 | — | 274.8 | 0.11575 (±0.00000) Rank: 24/87 |
0.21429 (±0.00000) Rank: 14/87 |
Buenos Aires (BAR) | 2048.0 | — | 272.4 | 0.22831 (±0.00000) Rank: 25/87 |
0.39087 (±0.00000) Rank: 9/87 |
Cambridge (CAM) | 2048.0 | — | 273.0 | 0.32055 (±0.00000) Rank: 25/87 |
0.46267 (±0.00000) Rank: 18/87 |
Cannes (CAN) | 2048.0 | — | 347.5 | 0.39908 (±0.00000) Rank: 21/87 |
0.52258 (±0.00000) Rank: 19/87 |
Chicago (CHI) | 2048.0 | — | 206.2 | 0.22199 (±0.00000) Rank: 5/87 |
0.35786 (±0.00000) Rank: 5/87 |
Helsinki (HEL) | 2048.0 | — | 475.3 | 0.37113 (±0.00000) Rank: 26/87 |
0.57062 (±0.00000) Rank: 28/87 |
Madrid (MAD) | 2048.0 | — | 193.5 | 0.08207 (±0.00000) Rank: 24/87 |
0.18328 (±0.00000) Rank: 28/87 |
Mountain View (MTV) | 2048.0 | — | 252.0 | 0.21758 (±0.00000) Rank: 30/87 |
0.37207 (±0.00000) Rank: 29/87 |
New Orleans (NOR) | 2048.0 | — | 220.0 | 0.29112 (±0.00000) Rank: 5/87 |
0.40947 (±0.00000) Rank: 6/87 |
San Francisco (SF) | 2048.0 | — | 317.6 | 0.20997 (±0.00000) Rank: 12/87 |
0.37034 (±0.00000) Rank: 5/87 |
Singapore (SG) | 2048.0 | — | 267.4 | 0.34684 (±0.00000) Rank: 13/87 |
0.47057 (±0.00000) Rank: 10/87 |
Sydney (SYD) | 2048.0 | — | 304.9 | 0.33886 (±0.00000) Rank: 20/87 |
0.50087 (±0.00000) Rank: 17/87 |
Tokyo (TOK) | 2048.0 | — | 360.2 | 0.60539 (±0.00000) Rank: 16/87 |
0.74461 (±0.00000) Rank: 15/87 |
Toronto (TOR) | 2048.0 | — | 216.4 | 0.19760 (±0.00000) Rank: 34/87 |
0.35520 (±0.00000) Rank: 34/87 |
Zurich (ZRH) | 2048.0 | — | 340.1 | 0.27491 (±0.00000) Rank: 10/87 |
0.36804 (±0.00000) Rank: 21/87 |
Average (Avg) | 2048.0 | — | 290.5 | 0.26526 (±0.00000) Rank: 19/87 |
0.40366 (±0.00000) Rank: 16/87 |
We show the inliers that survive the robust estimation loop (i.e. RANSAC), or those supplied with the submission if using custom matches. As the dataset does not contain depth, we color them based on the symmetric epopilar distance on normalized coordinates: from 0 (green) to 2e-4 (yellow), and in red above it. Note that these occasionally contain false positives.
— Amsterdam —
— Bangkok —
— Barcelona —
— Buenos Aires —
— Cambridge —
— Cannes —
— Chicago —
— Helsinki —
— Madrid —
— Mountain View —
— New Orleans —
— San Francisco —
— Singapore —
— Sydney —
— Tokyo —
— Toronto —
— Zurich —
Google Urban dataset / Multiview track
mAA at 10 degrees: N/A (±0.00000 over 1 run(s) / ±0.15317 over 17 scenes)
Rank (per category): 21 (of 87)
Scene | Features | Matches (input) |
RegistrationRatio (%) | Number of Landmarks |
Track Length | ATE | mAA(50) | mAA(100) |
AMS | 2048.0 | 175.18 | 91.07 Rank: 32/87 |
1257.51 Rank: 33/87 |
3.810 Rank: 22/87 |
24.36905 Rank: 19/87 |
0.33825 (±0.00000) Rank: 33/87 |
0.44692 (±0.00000) Rank: 34/87 |
BGK | 2048.0 | 244.86 | 97.73 Rank: 4/87 |
2195.47 Rank: 27/87 |
3.636 Rank: 31/87 |
12.82947 Rank: 21/87 |
0.02512 (±0.00000) Rank: 32/87 |
0.08477 (±0.00000) Rank: 28/87 |
BCN | 2048.0 | 166.73 | 83.89 Rank: 29/87 |
1161.27 Rank: 27/87 |
3.749 Rank: 25/87 |
26.80187 Rank: 25/87 |
0.14562 (±0.00000) Rank: 13/87 |
0.23150 (±0.00000) Rank: 12/87 |
BAR | 2048.0 | 159.25 | 85.69 Rank: 26/87 |
1212.75 Rank: 21/87 |
3.377 Rank: 25/87 |
16.61675 Rank: 35/87 |
0.17656 (±0.00000) Rank: 7/87 |
0.27757 (±0.00000) Rank: 13/87 |
CAM | 2048.0 | 171.88 | 83.52 Rank: 34/87 |
1098.70 Rank: 31/87 |
3.438 Rank: 35/87 |
23.72177 Rank: 16/87 |
0.14552 (±0.00000) Rank: 35/87 |
0.22612 (±0.00000) Rank: 35/87 |
CAN | 2048.0 | 192.37 | 77.72 Rank: 23/87 |
872.01 Rank: 22/87 |
3.604 Rank: 7/87 |
18.93718 Rank: 24/87 |
0.09510 (±0.00000) Rank: 10/87 |
0.15819 (±0.00000) Rank: 10/87 |
CHI | 2048.0 | 182.93 | 92.48 Rank: 2/87 |
587.96 Rank: 23/87 |
4.733 Rank: 21/87 |
47.83369 Rank: 35/87 |
0.10141 (±0.00000) Rank: 29/87 |
0.19754 (±0.00000) Rank: 28/87 |
HEL | 2048.0 | 339.03 | 94.80 Rank: 12/87 |
2187.01 Rank: 27/87 |
4.077 Rank: 10/87 |
15.89404 Rank: 50/87 |
0.38596 (±0.00000) Rank: 2/87 |
0.52726 (±0.00000) Rank: 3/87 |
MAD | 2048.0 | 126.02 | 91.07 Rank: 17/87 |
1288.07 Rank: 28/87 |
3.345 Rank: 10/87 |
6.18885 Rank: 30/87 |
0.09130 (±0.00000) Rank: 30/87 |
0.20091 (±0.00000) Rank: 26/87 |
MTV | 2048.0 | 183.86 | 92.34 Rank: 17/87 |
1423.17 Rank: 27/87 |
3.830 Rank: 19/87 |
17.12739 Rank: 40/87 |
0.27372 (±0.00000) Rank: 26/87 |
0.41099 (±0.00000) Rank: 22/87 |
NOR | 2048.0 | 143.82 | 87.29 Rank: 24/87 |
1168.09 Rank: 26/87 |
3.364 Rank: 26/87 |
13.57919 Rank: 35/87 |
0.28634 (±0.00000) Rank: 16/87 |
0.38769 (±0.00000) Rank: 12/87 |
SF | 2048.0 | 207.99 | 95.73 Rank: 22/87 |
1668.18 Rank: 23/87 |
3.702 Rank: 27/87 |
19.78348 Rank: 24/87 |
0.31233 (±0.00000) Rank: 6/87 |
0.45683 (±0.00000) Rank: 7/87 |
SG | 2048.0 | 168.05 | 80.07 Rank: 10/87 |
1187.37 Rank: 15/87 |
3.488 Rank: 7/87 |
16.29420 Rank: 18/87 |
0.22138 (±0.00000) Rank: 25/87 |
0.28417 (±0.00000) Rank: 28/87 |
SYD | 2048.0 | 188.14 | 87.30 Rank: 29/87 |
1393.16 Rank: 28/87 |
3.644 Rank: 7/87 |
19.38625 Rank: 19/87 |
0.30323 (±0.00000) Rank: 14/87 |
0.38939 (±0.00000) Rank: 17/87 |
TOK | 2048.0 | 226.12 | 92.27 Rank: 31/87 |
1992.05 Rank: 27/87 |
3.739 Rank: 23/87 |
14.27867 Rank: 19/87 |
0.65276 (±0.00000) Rank: 30/87 |
0.72070 (±0.00000) Rank: 32/87 |
TOR | 2048.0 | 137.07 | 89.20 Rank: 13/87 |
1392.12 Rank: 25/87 |
3.202 Rank: 32/87 |
16.35330 Rank: 17/87 |
0.19798 (±0.00000) Rank: 23/87 |
0.32707 (±0.00000) Rank: 22/87 |
ZRH | 2048.0 | 209.61 | 91.34 Rank: 6/87 |
1804.13 Rank: 17/87 |
3.505 Rank: 14/87 |
18.42817 Rank: 22/87 |
0.12972 (±0.00000) Rank: 12/87 |
0.20656 (±0.00000) Rank: 12/87 |
Avg | 2048.0 | 189.58 | 89.03 Rank: 26/87 |
1405.24 Rank: 26/87 |
3.661 Rank: 19/87 |
19.31902 Rank: 23/87 |
0.22837 (±0.00000) Rank: 19/87 |
0.32554 (±0.00000) Rank: 21/87 |
In the multi-view track we reconstruct the scene with Structure-from-Motion (Colmap) with small sets of images. We show the results for one bag of 10 images. Keypoints are drawn in blue if they are part of the model, and in red otherwise.
— Amsterdam —
— Bangkok —
— Barcelona —
— Buenos Aires —
— Cambridge —
— Cannes —
— Chicago —
— Helsinki —
— Madrid —
— Mountain View —
— New Orleans —
— San Francisco —
— Singapore —
— Sydney —
— Tokyo —
— Toronto —
— Zurich —