Submission ID: 85b31795
ss-ada-retrain
Processed: 21-06-17. Download link: 85b317955d63fca1-ssadamix.json
This page ranks the submission against all others using the same number of keypoints, regardless of descriptor size. Please hover over table headers for descriptions on metrics and full scene names.
- Phototourism dataset: Stereo track / Multiview track
- Prague Parks dataset: Stereo track / Multiview track
- Google Urban dataset: Stereo track / Multiview track
Metadata
- Authors: yt (contact)
- Keypoint: spmamix
- Descriptor: sgmix (128 float32: 512 bytes)
- Number of features: 2048
- Summary: retrain ada sg in several scenes
- Paper: N/A
- Website: N/A
- Processing date: 21-06-17
Phototourism dataset / Stereo track
mAA at 10 degrees: 0.58934 (±0.00000 over 1 run(s) / ±0.13238 over 9 scenes)
Rank (per category): 14 (of 87)
Scene | Features | Matches (raw) |
Matches (final) |
Rep. @ 3 px. | MS @ 3 px. | mAA(5o) | mAA(10o) |
BM | 2048.0 | — | 438.0 | 0.449 Rank: 58/87 |
0.881 Rank: 59/87 |
0.35425 (±0.00000) Rank: 8/87 |
0.50460 (±0.00000) Rank: 15/87 |
FCS | 2048.0 | — | 549.6 | 0.406 Rank: 42/87 |
0.864 Rank: 46/87 |
0.65512 (±0.00000) Rank: 21/87 |
0.77394 (±0.00000) Rank: 17/87 |
LMS | 2048.0 | — | 530.3 | 0.417 Rank: 40/87 |
0.673 Rank: 56/87 |
0.62358 (±0.00000) Rank: 15/87 |
0.75661 (±0.00000) Rank: 8/87 |
LB | 2048.0 | — | 410.0 | 0.391 Rank: 48/87 |
0.670 Rank: 69/87 |
0.48101 (±0.00000) Rank: 8/87 |
0.60203 (±0.00000) Rank: 30/87 |
MC | 2048.0 | — | 472.3 | 0.414 Rank: 46/87 |
0.840 Rank: 68/87 |
0.34736 (±0.00000) Rank: 8/87 |
0.50357 (±0.00000) Rank: 31/87 |
MR | 2048.0 | — | 432.1 | 0.379 Rank: 63/87 |
0.881 Rank: 59/87 |
0.27245 (±0.00000) Rank: 30/87 |
0.39049 (±0.00000) Rank: 28/87 |
PSM | 2048.0 | — | 421.4 | 0.330 Rank: 47/87 |
0.614 Rank: 28/87 |
0.26141 (±0.00000) Rank: 10/87 |
0.42549 (±0.00000) Rank: 9/87 |
SF | 2048.0 | — | 499.6 | 0.350 Rank: 63/87 |
0.772 Rank: 60/87 |
0.51460 (±0.00000) Rank: 21/87 |
0.66029 (±0.00000) Rank: 18/87 |
SPC | 2048.0 | — | 450.0 | 0.375 Rank: 61/87 |
0.784 Rank: 61/87 |
0.52281 (±0.00000) Rank: 21/87 |
0.68707 (±0.00000) Rank: 19/87 |
Avg | 2048.0 | — | 467.0 | 0.390 Rank: 58/87 |
0.775 Rank: 59/87 |
0.44807 (±0.00000) Rank: 19/87 |
0.58934 (±0.00000) Rank: 14/87 |
We show the inliers that survive the robust estimation loop (i.e. RANSAC), or those supplied with the submission if using custom matches, and use the depth estimates to determine whether they are correct. We draw matches above a 5-pixel error threshold in red, and those below are color-coded by their error, from 0 (green) to 5 pixels (yellow). Matches for which we do not have depth estimates are drawn in blue. Please note that the depth maps are estimates and may contain errors.
— British Museum —
— Florence Cathedral Side —
— Lincoln Memorial Statue —
— London Bridge —
— Milan Cathedral —
— Mount Rushmore —
— Piazza San Marco —
— Sagrada Familia —
— Saint Paul's Cathedral —
Phototourism dataset / Multiview track
mAA at 10 degrees: N/A (±0.00000 over 1 run(s) / ±0.09696 over 9 scenes)
Rank (per category): 4 (of 87)
Scene | Features | Matches (input) |
RegistrationRatio (%) | Number of Landmarks |
Track Length | ATE | mAA(50) | mAA(100) |
BM | 2048.0 | 438.19 | 99.80 Rank: 49/87 |
2482.02 Rank: 3/87 |
4.781 Rank: 61/87 |
0.35173 Rank: 23/87 |
0.60100 (±0.00000) Rank: 4/87 |
0.73500 (±0.00000) Rank: 10/87 |
FCS | 2048.0 | 557.84 | 98.33 Rank: 16/87 |
2880.41 Rank: 3/87 |
5.067 Rank: 38/87 |
0.22659 Rank: 10/87 |
0.76663 (±0.00000) Rank: 3/87 |
0.82075 (±0.00000) Rank: 6/87 |
LMS | 2048.0 | 553.59 | 99.07 Rank: 51/87 |
2349.27 Rank: 8/87 |
5.263 Rank: 56/87 |
0.30146 Rank: 46/87 |
0.85301 (±0.00000) Rank: 22/87 |
0.90033 (±0.00000) Rank: 28/87 |
LB | 2048.0 | 483.44 | 98.16 Rank: 42/87 |
2372.33 Rank: 3/87 |
5.086 Rank: 46/87 |
0.48646 Rank: 34/87 |
0.72356 (±0.00000) Rank: 20/87 |
0.81477 (±0.00000) Rank: 17/87 |
MC | 2048.0 | 464.15 | 100.00 Rank: 1/87 |
2531.27 Rank: 7/87 |
5.026 Rank: 49/87 |
0.31989 Rank: 5/87 |
0.57331 (±0.00000) Rank: 5/87 |
0.71633 (±0.00000) Rank: 5/87 |
MR | 2048.0 | 423.68 | 95.20 Rank: 17/87 |
2563.62 Rank: 6/87 |
4.642 Rank: 56/87 |
0.49022 Rank: 13/87 |
0.44303 (±0.00000) Rank: 17/87 |
0.56568 (±0.00000) Rank: 18/87 |
PSM | 2048.0 | 417.96 | 99.67 Rank: 11/87 |
2778.39 Rank: 7/87 |
4.521 Rank: 33/87 |
0.31347 Rank: 8/87 |
0.65606 (±0.00000) Rank: 11/87 |
0.74349 (±0.00000) Rank: 10/87 |
SF | 2048.0 | 491.60 | 99.81 Rank: 21/87 |
2986.93 Rank: 7/87 |
4.873 Rank: 46/87 |
0.27965 Rank: 22/87 |
0.78461 (±0.00000) Rank: 8/87 |
0.86798 (±0.00000) Rank: 3/87 |
SPC | 2048.0 | 460.74 | 100.00 Rank: 1/87 |
2579.15 Rank: 8/87 |
5.071 Rank: 44/87 |
0.47544 Rank: 51/87 |
0.77178 (±0.00000) Rank: 3/87 |
0.85857 (±0.00000) Rank: 4/87 |
Avg | 2048.0 | 476.80 | 98.89 Rank: 14/87 |
2613.71 Rank: 3/87 |
4.926 Rank: 46/87 |
0.36055 Rank: 14/87 |
0.68589 (±0.00000) Rank: 4/87 |
0.78032 (±0.00000) Rank: 4/87 |
In the multi-view track we reconstruct the scene with Structure-from-Motion (Colmap) with small sets of images. We show the results for one bag of 10 images. Keypoints are drawn in blue if they are part of the model, and in red otherwise.
— British Museum —
— Florence Cathedral Side —
— Lincoln Memorial Statue —
— London Bridge —
— Milan Cathedral —
— Mount Rushmore —
— Piazza San Marco —
— Sagrada Familia —
— Saint Paul's Cathedral —
Prague Parks dataset / Stereo track
mAA at 10 degrees: 0.75402 (±0.00000 over 1 run(s) / ±0.05713 over 3 scenes)
Rank (per category): 19 (of 87)
Scene | Features | Matches (raw) |
Matches (final) |
Rep. @ 3 px. | MS @ 3 px. | mAA(5o) | mAA(10o) |
Lizard | 2048.0 | — | 384.4 | 0.036 Rank: 21/87 |
0.011 Rank: 22/87 |
0.57448 (±0.00000) Rank: 27/87 |
0.70541 (±0.00000) Rank: 30/87 |
Pond | 2048.0 | — | 409.6 | 0.051 Rank: 28/87 |
0.047 Rank: 44/87 |
0.59038 (±0.00000) Rank: 18/87 |
0.72244 (±0.00000) Rank: 18/87 |
Tree | 2048.0 | — | 274.1 | 0.031 Rank: 27/87 |
0.024 Rank: 29/87 |
0.72936 (±0.00000) Rank: 15/87 |
0.83422 (±0.00000) Rank: 17/87 |
Avg | 2048.0 | — | 356.0 | 0.039 Rank: 24/87 |
0.027 Rank: 31/87 |
0.63141 (±0.00000) Rank: 19/87 |
0.75402 (±0.00000) Rank: 19/87 |
We show the inliers that survive the robust estimation loop (i.e. RANSAC), or those supplied with the submission if using custom matches, and use the depth estimates to determine whether they are correct. We draw matches above a 5-pixel error threshold in red, and those below are color-coded by their error, from 0 (green) to 5 pixels (yellow). Matches for which we do not have depth estimates are drawn in blue. Please note that the depth maps are estimates and may contain errors.
— Lizard —
— Pond —
— Tree —
Prague Parks dataset / Multiview track
mAA at 10 degrees: N/A (±0.00000 over 1 run(s) / ±0.14501 over 3 scenes)
Rank (per category): 26 (of 87)
Scene | Features | Matches (input) |
RegistrationRatio (%) | Number of Landmarks |
Track Length | ATE | mAA(50) | mAA(100) |
Lizard | 2048.0 | 408.23 | 85.70 Rank: 2/87 |
1256.07 Rank: 16/87 |
3.413 Rank: 20/87 |
14.51684 Rank: 58/87 |
0.58233 (±0.00000) Rank: 29/87 |
0.67062 (±0.00000) Rank: 25/87 |
Pond | 2048.0 | 441.94 | 66.93 Rank: 56/87 |
1032.86 Rank: 19/87 |
2.862 Rank: 41/87 |
0.43993 Rank: 58/87 |
0.28460 (±0.00000) Rank: 33/87 |
0.31598 (±0.00000) Rank: 28/87 |
Tree | 2048.0 | 257.45 | 72.36 Rank: 11/87 |
622.97 Rank: 8/87 |
3.006 Rank: 27/87 |
6.18847 Rank: 60/87 |
0.43540 (±0.00000) Rank: 29/87 |
0.47613 (±0.00000) Rank: 28/87 |
Avg | 2048.0 | 369.21 | 75.00 Rank: 29/87 |
970.63 Rank: 18/87 |
3.094 Rank: 28/87 |
7.04841 Rank: 69/87 |
0.43411 (±0.00000) Rank: 33/87 |
0.48758 (±0.00000) Rank: 26/87 |
Google Urban dataset / Stereo track
mAA at 10 degrees: 0.40844 (±0.00000 over 1 run(s) / ±0.13689 over 17 scenes)
Rank (per category): 7 (of 87)
Scene | Features | Matches (raw) |
Matches (final) |
mAA(5o) | mAA(10o) |
Amsterdam (AMS) | 2048.0 | — | 287.9 | 0.24732 (±0.00000) Rank: 22/87 |
0.38527 (±0.00000) Rank: 23/87 |
Bangkok (BGK) | 2046.2 | — | 424.3 | 0.06898 (±0.00000) Rank: 9/87 |
0.18288 (±0.00000) Rank: 12/87 |
Barcelona (BCN) | 2048.0 | — | 307.5 | 0.13333 (±0.00000) Rank: 11/87 |
0.21832 (±0.00000) Rank: 12/87 |
Buenos Aires (BAR) | 2048.0 | — | 291.0 | 0.23196 (±0.00000) Rank: 22/87 |
0.38265 (±0.00000) Rank: 13/87 |
Cambridge (CAM) | 2048.0 | — | 295.7 | 0.31507 (±0.00000) Rank: 22/87 |
0.47158 (±0.00000) Rank: 13/87 |
Cannes (CAN) | 2048.0 | — | 355.9 | 0.42304 (±0.00000) Rank: 4/87 |
0.53594 (±0.00000) Rank: 5/87 |
Chicago (CHI) | 2048.0 | — | 239.5 | 0.20082 (±0.00000) Rank: 20/87 |
0.33108 (±0.00000) Rank: 24/87 |
Helsinki (HEL) | 2048.0 | — | 549.9 | 0.37990 (±0.00000) Rank: 19/87 |
0.58376 (±0.00000) Rank: 13/87 |
Madrid (MAD) | 2048.0 | — | 211.0 | 0.09301 (±0.00000) Rank: 10/87 |
0.20973 (±0.00000) Rank: 12/87 |
Mountain View (MTV) | 2048.0 | — | 267.1 | 0.25625 (±0.00000) Rank: 6/87 |
0.39238 (±0.00000) Rank: 13/87 |
New Orleans (NOR) | 2048.0 | — | 226.4 | 0.29704 (±0.00000) Rank: 4/87 |
0.40207 (±0.00000) Rank: 7/87 |
San Francisco (SF) | 2048.0 | — | 341.0 | 0.20630 (±0.00000) Rank: 17/87 |
0.35853 (±0.00000) Rank: 17/87 |
Singapore (SG) | 2048.0 | — | 273.6 | 0.35316 (±0.00000) Rank: 4/87 |
0.47373 (±0.00000) Rank: 7/87 |
Sydney (SYD) | 2048.0 | — | 324.4 | 0.34148 (±0.00000) Rank: 18/87 |
0.49782 (±0.00000) Rank: 18/87 |
Tokyo (TOK) | 2048.0 | — | 378.0 | 0.61814 (±0.00000) Rank: 2/87 |
0.75123 (±0.00000) Rank: 6/87 |
Toronto (TOR) | 2048.0 | — | 231.4 | 0.23920 (±0.00000) Rank: 6/87 |
0.38920 (±0.00000) Rank: 14/87 |
Zurich (ZRH) | 2048.0 | — | 346.9 | 0.27766 (±0.00000) Rank: 9/87 |
0.37732 (±0.00000) Rank: 7/87 |
Average (Avg) | 2047.9 | — | 314.8 | 0.27545 (±0.00000) Rank: 2/87 |
0.40844 (±0.00000) Rank: 7/87 |
We show the inliers that survive the robust estimation loop (i.e. RANSAC), or those supplied with the submission if using custom matches. As the dataset does not contain depth, we color them based on the symmetric epopilar distance on normalized coordinates: from 0 (green) to 2e-4 (yellow), and in red above it. Note that these occasionally contain false positives.
— Amsterdam —
— Bangkok —
— Barcelona —
— Buenos Aires —
— Cambridge —
— Cannes —
— Chicago —
— Helsinki —
— Madrid —
— Mountain View —
— New Orleans —
— San Francisco —
— Singapore —
— Sydney —
— Tokyo —
— Toronto —
— Zurich —
Google Urban dataset / Multiview track
mAA at 10 degrees: N/A (±0.00000 over 1 run(s) / ±0.14971 over 17 scenes)
Rank (per category): 7 (of 87)
Scene | Features | Matches (input) |
RegistrationRatio (%) | Number of Landmarks |
Track Length | ATE | mAA(50) | mAA(100) |
AMS | 2048.0 | 191.31 | 93.87 Rank: 5/87 |
1484.23 Rank: 11/87 |
3.819 Rank: 18/87 |
29.04742 Rank: 51/87 |
0.37945 (±0.00000) Rank: 10/87 |
0.50483 (±0.00000) Rank: 10/87 |
BGK | 2046.2 | 295.66 | 97.07 Rank: 14/87 |
2741.05 Rank: 6/87 |
3.614 Rank: 36/87 |
13.51313 Rank: 27/87 |
0.03061 (±0.00000) Rank: 14/87 |
0.09669 (±0.00000) Rank: 10/87 |
BCN | 2048.0 | 184.24 | 86.12 Rank: 13/87 |
1291.63 Rank: 20/87 |
3.785 Rank: 19/87 |
26.65569 Rank: 24/87 |
0.13547 (±0.00000) Rank: 24/87 |
0.21078 (±0.00000) Rank: 26/87 |
BAR | 2048.0 | 171.31 | 83.55 Rank: 33/87 |
1196.21 Rank: 26/87 |
3.414 Rank: 20/87 |
15.96583 Rank: 25/87 |
0.16821 (±0.00000) Rank: 15/87 |
0.26681 (±0.00000) Rank: 24/87 |
CAM | 2048.0 | 187.42 | 90.19 Rank: 5/87 |
1405.44 Rank: 8/87 |
3.577 Rank: 13/87 |
29.66702 Rank: 50/87 |
0.20336 (±0.00000) Rank: 8/87 |
0.30668 (±0.00000) Rank: 6/87 |
CAN | 2048.0 | 198.08 | 78.09 Rank: 21/87 |
997.96 Rank: 8/87 |
3.518 Rank: 23/87 |
22.85315 Rank: 46/87 |
0.09953 (±0.00000) Rank: 7/87 |
0.16199 (±0.00000) Rank: 8/87 |
CHI | 2048.0 | 212.56 | 89.50 Rank: 22/87 |
745.02 Rank: 3/87 |
4.855 Rank: 16/87 |
49.28722 Rank: 50/87 |
0.15615 (±0.00000) Rank: 15/87 |
0.25005 (±0.00000) Rank: 15/87 |
HEL | 2048.0 | 393.54 | 94.53 Rank: 18/87 |
2287.75 Rank: 23/87 |
4.042 Rank: 19/87 |
13.00156 Rank: 12/87 |
0.29630 (±0.00000) Rank: 36/87 |
0.42776 (±0.00000) Rank: 35/87 |
MAD | 2048.0 | 135.92 | 90.31 Rank: 26/87 |
1507.53 Rank: 12/87 |
3.260 Rank: 34/87 |
5.70389 Rank: 24/87 |
0.09300 (±0.00000) Rank: 27/87 |
0.20667 (±0.00000) Rank: 20/87 |
MTV | 2048.0 | 194.31 | 92.66 Rank: 16/87 |
1583.18 Rank: 6/87 |
3.804 Rank: 31/87 |
17.54833 Rank: 47/87 |
0.29940 (±0.00000) Rank: 9/87 |
0.43540 (±0.00000) Rank: 11/87 |
NOR | 2048.0 | 147.24 | 87.90 Rank: 19/87 |
1290.91 Rank: 14/87 |
3.304 Rank: 32/87 |
13.71317 Rank: 41/87 |
0.30043 (±0.00000) Rank: 7/87 |
0.39673 (±0.00000) Rank: 8/87 |
SF | 2048.0 | 224.88 | 95.07 Rank: 27/87 |
1763.94 Rank: 17/87 |
3.770 Rank: 12/87 |
20.09457 Rank: 27/87 |
0.29773 (±0.00000) Rank: 12/87 |
0.45159 (±0.00000) Rank: 10/87 |
SG | 2048.0 | 170.51 | 79.90 Rank: 11/87 |
1265.71 Rank: 4/87 |
3.430 Rank: 11/87 |
19.90630 Rank: 49/87 |
0.26498 (±0.00000) Rank: 4/87 |
0.34649 (±0.00000) Rank: 3/87 |
SYD | 2048.0 | 201.98 | 86.33 Rank: 33/87 |
1501.98 Rank: 23/87 |
3.406 Rank: 37/87 |
17.77682 Rank: 14/87 |
0.26344 (±0.00000) Rank: 31/87 |
0.34551 (±0.00000) Rank: 32/87 |
TOK | 2048.0 | 238.30 | 93.73 Rank: 6/87 |
2182.32 Rank: 6/87 |
3.787 Rank: 12/87 |
14.69651 Rank: 39/87 |
0.68170 (±0.00000) Rank: 4/87 |
0.75365 (±0.00000) Rank: 4/87 |
TOR | 2048.0 | 145.31 | 88.67 Rank: 21/87 |
1455.87 Rank: 17/87 |
3.257 Rank: 9/87 |
18.88225 Rank: 48/87 |
0.21466 (±0.00000) Rank: 5/87 |
0.34882 (±0.00000) Rank: 5/87 |
ZRH | 2048.0 | 216.72 | 90.67 Rank: 14/87 |
1902.51 Rank: 3/87 |
3.525 Rank: 4/87 |
23.35285 Rank: 51/87 |
0.16537 (±0.00000) Rank: 1/87 |
0.23873 (±0.00000) Rank: 3/87 |
Avg | 2047.9 | 206.43 | 89.30 Rank: 22/87 |
1564.90 Rank: 11/87 |
3.657 Rank: 22/87 |
20.68622 Rank: 45/87 |
0.23822 (±0.00000) Rank: 6/87 |
0.33819 (±0.00000) Rank: 7/87 |
In the multi-view track we reconstruct the scene with Structure-from-Motion (Colmap) with small sets of images. We show the results for one bag of 10 images. Keypoints are drawn in blue if they are part of the model, and in red otherwise.
— Amsterdam —
— Bangkok —
— Barcelona —
— Buenos Aires —
— Cambridge —
— Cannes —
— Chicago —
— Helsinki —
— Madrid —
— Mountain View —
— New Orleans —
— San Francisco —
— Singapore —
— Sydney —
— Tokyo —
— Toronto —
— Zurich —