Submission ID: 0e7e0bb0
tmss
Processed: 21-05-26. Download link: 0e7e0bb00a26ae49-523json.json
This page ranks the submission against all others using the same number of keypoints, regardless of descriptor size. Please hover over table headers for descriptions on metrics and full scene names.
- Phototourism dataset: Stereo track / Multiview track
- Prague Parks dataset: Stereo track / Multiview track
- Google Urban dataset: Stereo track / Multiview track
Metadata
- Authors: Megvii 3D (contact)
- Keypoint: pt
- Descriptor: pt (128 float32: 512 bytes)
- Number of features: 2048
- Summary: pt
- Paper: N/A
- Website: N/A
- Processing date: 21-05-26
Phototourism dataset / Stereo track
mAA at 10 degrees: 0.59079 (±0.00000 over 1 run(s) / ±0.12975 over 9 scenes)
Rank (per category): 12 (of 87)
Scene | Features | Matches (raw) |
Matches (final) |
Rep. @ 3 px. | MS @ 3 px. | mAA(5o) | mAA(10o) |
BM | 2046.0 | — | 414.4 | 0.470 Rank: 35/87 |
0.897 Rank: 36/87 |
0.35012 (±0.00000) Rank: 15/87 |
0.50466 (±0.00000) Rank: 14/87 |
FCS | 2046.8 | — | 541.2 | 0.418 Rank: 10/87 |
0.872 Rank: 26/87 |
0.65397 (±0.00000) Rank: 27/87 |
0.77176 (±0.00000) Rank: 24/87 |
LMS | 2048.0 | — | 554.6 | 0.449 Rank: 20/87 |
0.689 Rank: 37/87 |
0.62300 (±0.00000) Rank: 17/87 |
0.74416 (±0.00000) Rank: 17/87 |
LB | 2048.0 | — | 409.0 | 0.406 Rank: 20/87 |
0.705 Rank: 36/87 |
0.49614 (±0.00000) Rank: 15/87 |
0.60847 (±0.00000) Rank: 24/87 |
MC | 2048.0 | — | 452.9 | 0.429 Rank: 28/87 |
0.859 Rank: 46/87 |
0.35844 (±0.00000) Rank: 15/87 |
0.51398 (±0.00000) Rank: 15/87 |
MR | 2045.2 | — | 464.0 | 0.427 Rank: 33/87 |
0.901 Rank: 33/87 |
0.29160 (±0.00000) Rank: 4/87 |
0.40888 (±0.00000) Rank: 2/87 |
PSM | 2048.0 | — | 391.2 | 0.339 Rank: 38/87 |
0.616 Rank: 26/87 |
0.24932 (±0.00000) Rank: 16/87 |
0.40936 (±0.00000) Rank: 15/87 |
SF | 2048.0 | — | 520.6 | 0.377 Rank: 25/87 |
0.789 Rank: 36/87 |
0.51988 (±0.00000) Rank: 6/87 |
0.66370 (±0.00000) Rank: 5/87 |
SPC | 2048.0 | — | 433.2 | 0.386 Rank: 37/87 |
0.801 Rank: 31/87 |
0.52876 (±0.00000) Rank: 5/87 |
0.69217 (±0.00000) Rank: 5/87 |
Avg | 2047.3 | — | 464.6 | 0.411 Rank: 33/87 |
0.792 Rank: 29/87 |
0.45236 (±0.00000) Rank: 12/87 |
0.59079 (±0.00000) Rank: 12/87 |
We show the inliers that survive the robust estimation loop (i.e. RANSAC), or those supplied with the submission if using custom matches, and use the depth estimates to determine whether they are correct. We draw matches above a 5-pixel error threshold in red, and those below are color-coded by their error, from 0 (green) to 5 pixels (yellow). Matches for which we do not have depth estimates are drawn in blue. Please note that the depth maps are estimates and may contain errors.
— British Museum —
— Florence Cathedral Side —
— Lincoln Memorial Statue —
— London Bridge —
— Milan Cathedral —
— Mount Rushmore —
— Piazza San Marco —
— Sagrada Familia —
— Saint Paul's Cathedral —
Phototourism dataset / Multiview track
mAA at 10 degrees: N/A (±0.00000 over 1 run(s) / ±0.09951 over 9 scenes)
Rank (per category): 13 (of 87)
Scene | Features | Matches (input) |
RegistrationRatio (%) | Number of Landmarks |
Track Length | ATE | mAA(50) | mAA(100) |
BM | 2046.0 | 414.99 | 99.87 Rank: 32/87 |
2096.25 Rank: 26/87 |
5.005 Rank: 29/87 |
0.34198 Rank: 12/87 |
0.59878 (±0.00000) Rank: 10/87 |
0.73520 (±0.00000) Rank: 9/87 |
FCS | 2046.8 | 549.13 | 98.53 Rank: 10/87 |
2672.70 Rank: 24/87 |
5.156 Rank: 12/87 |
0.23018 Rank: 15/87 |
0.75633 (±0.00000) Rank: 13/87 |
0.81149 (±0.00000) Rank: 14/87 |
LMS | 2048.0 | 580.25 | 99.20 Rank: 42/87 |
2021.27 Rank: 25/87 |
5.844 Rank: 22/87 |
0.24611 Rank: 1/87 |
0.87708 (±0.00000) Rank: 3/87 |
0.92018 (±0.00000) Rank: 3/87 |
LB | 2048.0 | 487.07 | 98.36 Rank: 1/87 |
2127.52 Rank: 22/87 |
5.394 Rank: 22/87 |
0.48527 Rank: 30/87 |
0.72052 (±0.00000) Rank: 26/87 |
0.81238 (±0.00000) Rank: 24/87 |
MC | 2048.0 | 445.34 | 100.00 Rank: 1/87 |
2216.93 Rank: 33/87 |
5.254 Rank: 19/87 |
0.32634 Rank: 9/87 |
0.55798 (±0.00000) Rank: 22/87 |
0.70655 (±0.00000) Rank: 19/87 |
MR | 2045.2 | 457.29 | 95.07 Rank: 23/87 |
2283.60 Rank: 31/87 |
4.912 Rank: 20/87 |
0.52139 Rank: 35/87 |
0.44506 (±0.00000) Rank: 16/87 |
0.56795 (±0.00000) Rank: 15/87 |
PSM | 2048.0 | 388.51 | 99.16 Rank: 32/87 |
2511.51 Rank: 29/87 |
4.646 Rank: 8/87 |
0.34472 Rank: 25/87 |
0.63423 (±0.00000) Rank: 37/87 |
0.71802 (±0.00000) Rank: 39/87 |
SF | 2048.0 | 513.15 | 99.75 Rank: 35/87 |
2824.65 Rank: 24/87 |
5.096 Rank: 12/87 |
0.27843 Rank: 16/87 |
0.77908 (±0.00000) Rank: 25/87 |
0.85920 (±0.00000) Rank: 31/87 |
SPC | 2048.0 | 443.10 | 100.00 Rank: 1/87 |
2320.77 Rank: 32/87 |
5.217 Rank: 18/87 |
0.43354 Rank: 26/87 |
0.75866 (±0.00000) Rank: 18/87 |
0.85141 (±0.00000) Rank: 14/87 |
Avg | 2047.3 | 475.43 | 98.88 Rank: 16/87 |
2341.69 Rank: 29/87 |
5.169 Rank: 20/87 |
0.35644 Rank: 8/87 |
0.68086 (±0.00000) Rank: 11/87 |
0.77582 (±0.00000) Rank: 13/87 |
In the multi-view track we reconstruct the scene with Structure-from-Motion (Colmap) with small sets of images. We show the results for one bag of 10 images. Keypoints are drawn in blue if they are part of the model, and in red otherwise.
— British Museum —
— Florence Cathedral Side —
— Lincoln Memorial Statue —
— London Bridge —
— Milan Cathedral —
— Mount Rushmore —
— Piazza San Marco —
— Sagrada Familia —
— Saint Paul's Cathedral —
Prague Parks dataset / Stereo track
mAA at 10 degrees: 0.76994 (±0.00000 over 1 run(s) / ±0.05155 over 3 scenes)
Rank (per category): 12 (of 87)
Scene | Features | Matches (raw) |
Matches (final) |
Rep. @ 3 px. | MS @ 3 px. | mAA(5o) | mAA(10o) |
Lizard | 2048.0 | — | 377.6 | 0.035 Rank: 32/87 |
0.012 Rank: 15/87 |
0.61110 (±0.00000) Rank: 13/87 |
0.74730 (±0.00000) Rank: 10/87 |
Pond | 2048.0 | — | 389.9 | 0.048 Rank: 41/87 |
0.047 Rank: 41/87 |
0.58998 (±0.00000) Rank: 20/87 |
0.72124 (±0.00000) Rank: 21/87 |
Tree | 2048.0 | — | 253.2 | 0.029 Rank: 39/87 |
0.025 Rank: 13/87 |
0.73996 (±0.00000) Rank: 8/87 |
0.84128 (±0.00000) Rank: 6/87 |
Avg | 2048.0 | — | 340.2 | 0.038 Rank: 36/87 |
0.028 Rank: 16/87 |
0.64701 (±0.00000) Rank: 14/87 |
0.76994 (±0.00000) Rank: 12/87 |
We show the inliers that survive the robust estimation loop (i.e. RANSAC), or those supplied with the submission if using custom matches, and use the depth estimates to determine whether they are correct. We draw matches above a 5-pixel error threshold in red, and those below are color-coded by their error, from 0 (green) to 5 pixels (yellow). Matches for which we do not have depth estimates are drawn in blue. Please note that the depth maps are estimates and may contain errors.
— Lizard —
— Pond —
— Tree —
Prague Parks dataset / Multiview track
mAA at 10 degrees: N/A (±0.00000 over 1 run(s) / ±0.14181 over 3 scenes)
Rank (per category): 18 (of 87)
Scene | Features | Matches (input) |
RegistrationRatio (%) | Number of Landmarks |
Track Length | ATE | mAA(50) | mAA(100) |
Lizard | 2048.0 | 397.15 | 85.30 Rank: 19/87 |
1214.33 Rank: 21/87 |
3.395 Rank: 28/87 |
14.29748 Rank: 53/87 |
0.59378 (±0.00000) Rank: 13/87 |
0.67526 (±0.00000) Rank: 14/87 |
Pond | 2048.0 | 424.75 | 68.80 Rank: 30/87 |
1008.76 Rank: 21/87 |
2.776 Rank: 59/87 |
0.43181 Rank: 43/87 |
0.29658 (±0.00000) Rank: 10/87 |
0.33071 (±0.00000) Rank: 8/87 |
Tree | 2048.0 | 243.74 | 69.73 Rank: 54/87 |
557.45 Rank: 27/87 |
2.957 Rank: 46/87 |
6.14574 Rank: 55/87 |
0.43320 (±0.00000) Rank: 32/87 |
0.46477 (±0.00000) Rank: 36/87 |
Avg | 2048.0 | 355.22 | 74.61 Rank: 46/87 |
926.85 Rank: 22/87 |
3.042 Rank: 54/87 |
6.95834 Rank: 55/87 |
0.44119 (±0.00000) Rank: 18/87 |
0.49024 (±0.00000) Rank: 18/87 |
Google Urban dataset / Stereo track
mAA at 10 degrees: 0.40379 (±0.00000 over 1 run(s) / ±0.13943 over 17 scenes)
Rank (per category): 15 (of 87)
Scene | Features | Matches (raw) |
Matches (final) |
mAA(5o) | mAA(10o) |
Amsterdam (AMS) | 2048.0 | — | 286.4 | 0.24196 (±0.00000) Rank: 24/87 |
0.40848 (±0.00000) Rank: 17/87 |
Bangkok (BGK) | 2048.0 | — | 411.1 | 0.06104 (±0.00000) Rank: 25/87 |
0.17494 (±0.00000) Rank: 23/87 |
Barcelona (BCN) | 2046.3 | — | 291.6 | 0.10476 (±0.00000) Rank: 34/87 |
0.20879 (±0.00000) Rank: 23/87 |
Buenos Aires (BAR) | 2048.0 | — | 281.6 | 0.22557 (±0.00000) Rank: 24/87 |
0.37260 (±0.00000) Rank: 24/87 |
Cambridge (CAM) | 2047.6 | — | 291.0 | 0.31164 (±0.00000) Rank: 24/87 |
0.45788 (±0.00000) Rank: 19/87 |
Cannes (CAN) | 2048.0 | — | 351.0 | 0.40369 (±0.00000) Rank: 14/87 |
0.52442 (±0.00000) Rank: 18/87 |
Chicago (CHI) | 2048.0 | — | 239.3 | 0.21216 (±0.00000) Rank: 10/87 |
0.34536 (±0.00000) Rank: 11/87 |
Helsinki (HEL) | 2048.0 | — | 526.7 | 0.39639 (±0.00000) Rank: 3/87 |
0.59278 (±0.00000) Rank: 5/87 |
Madrid (MAD) | 2048.0 | — | 209.5 | 0.08146 (±0.00000) Rank: 26/87 |
0.18085 (±0.00000) Rank: 30/87 |
Mountain View (MTV) | 2048.0 | — | 259.8 | 0.23242 (±0.00000) Rank: 18/87 |
0.37832 (±0.00000) Rank: 24/87 |
New Orleans (NOR) | 2039.2 | — | 232.5 | 0.27811 (±0.00000) Rank: 26/87 |
0.38284 (±0.00000) Rank: 27/87 |
San Francisco (SF) | 2048.0 | — | 331.4 | 0.19528 (±0.00000) Rank: 26/87 |
0.35118 (±0.00000) Rank: 24/87 |
Singapore (SG) | 2048.0 | — | 269.8 | 0.34304 (±0.00000) Rank: 17/87 |
0.47057 (±0.00000) Rank: 8/87 |
Sydney (SYD) | 2048.0 | — | 311.3 | 0.35721 (±0.00000) Rank: 6/87 |
0.51092 (±0.00000) Rank: 13/87 |
Tokyo (TOK) | 2048.0 | — | 365.4 | 0.59510 (±0.00000) Rank: 26/87 |
0.73824 (±0.00000) Rank: 26/87 |
Toronto (TOR) | 2048.0 | — | 230.5 | 0.23520 (±0.00000) Rank: 9/87 |
0.39480 (±0.00000) Rank: 8/87 |
Zurich (ZRH) | 2048.0 | — | 339.8 | 0.26598 (±0.00000) Rank: 23/87 |
0.37148 (±0.00000) Rank: 19/87 |
Average (Avg) | 2047.4 | — | 307.6 | 0.26712 (±0.00000) Rank: 15/87 |
0.40379 (±0.00000) Rank: 15/87 |
We show the inliers that survive the robust estimation loop (i.e. RANSAC), or those supplied with the submission if using custom matches. As the dataset does not contain depth, we color them based on the symmetric epopilar distance on normalized coordinates: from 0 (green) to 2e-4 (yellow), and in red above it. Note that these occasionally contain false positives.
— Amsterdam —
— Bangkok —
— Barcelona —
— Buenos Aires —
— Cambridge —
— Cannes —
— Chicago —
— Helsinki —
— Madrid —
— Mountain View —
— New Orleans —
— San Francisco —
— Singapore —
— Sydney —
— Tokyo —
— Toronto —
— Zurich —
Google Urban dataset / Multiview track
mAA at 10 degrees: N/A (±0.00000 over 1 run(s) / ±0.14843 over 17 scenes)
Rank (per category): 16 (of 87)
Scene | Features | Matches (input) |
RegistrationRatio (%) | Number of Landmarks |
Track Length | ATE | mAA(50) | mAA(100) |
AMS | 2048.0 | 188.99 | 92.00 Rank: 25/87 |
1389.55 Rank: 24/87 |
3.823 Rank: 16/87 |
25.44510 Rank: 32/87 |
0.36887 (±0.00000) Rank: 12/87 |
0.48325 (±0.00000) Rank: 18/87 |
BGK | 2048.0 | 284.80 | 97.07 Rank: 14/87 |
2490.77 Rank: 17/87 |
3.685 Rank: 15/87 |
11.97274 Rank: 15/87 |
0.03080 (±0.00000) Rank: 13/87 |
0.09376 (±0.00000) Rank: 16/87 |
BCN | 2046.3 | 176.24 | 86.53 Rank: 11/87 |
1281.49 Rank: 22/87 |
3.805 Rank: 17/87 |
27.97191 Rank: 33/87 |
0.14879 (±0.00000) Rank: 10/87 |
0.24237 (±0.00000) Rank: 7/87 |
BAR | 2048.0 | 164.78 | 86.91 Rank: 19/87 |
1233.92 Rank: 20/87 |
3.452 Rank: 14/87 |
15.71940 Rank: 21/87 |
0.15845 (±0.00000) Rank: 25/87 |
0.27180 (±0.00000) Rank: 19/87 |
CAM | 2047.6 | 182.56 | 87.11 Rank: 24/87 |
1202.63 Rank: 29/87 |
3.617 Rank: 8/87 |
28.98281 Rank: 43/87 |
0.16958 (±0.00000) Rank: 27/87 |
0.26258 (±0.00000) Rank: 24/87 |
CAN | 2048.0 | 195.37 | 80.27 Rank: 17/87 |
956.23 Rank: 11/87 |
3.515 Rank: 24/87 |
21.93160 Rank: 41/87 |
0.08804 (±0.00000) Rank: 13/87 |
0.14940 (±0.00000) Rank: 13/87 |
CHI | 2048.0 | 213.01 | 92.18 Rank: 4/87 |
683.28 Rank: 9/87 |
5.210 Rank: 3/87 |
47.65980 Rank: 32/87 |
0.17093 (±0.00000) Rank: 4/87 |
0.28211 (±0.00000) Rank: 2/87 |
HEL | 2048.0 | 373.77 | 93.87 Rank: 26/87 |
2280.14 Rank: 24/87 |
4.050 Rank: 18/87 |
15.43672 Rank: 41/87 |
0.33253 (±0.00000) Rank: 30/87 |
0.46214 (±0.00000) Rank: 30/87 |
MAD | 2048.0 | 135.44 | 90.64 Rank: 22/87 |
1442.57 Rank: 17/87 |
3.316 Rank: 16/87 |
6.83062 Rank: 36/87 |
0.09347 (±0.00000) Rank: 25/87 |
0.20215 (±0.00000) Rank: 25/87 |
MTV | 2048.0 | 190.57 | 91.65 Rank: 24/87 |
1485.02 Rank: 18/87 |
3.824 Rank: 21/87 |
15.85364 Rank: 19/87 |
0.27159 (±0.00000) Rank: 27/87 |
0.40253 (±0.00000) Rank: 27/87 |
NOR | 2039.2 | 151.23 | 88.84 Rank: 14/87 |
1259.31 Rank: 16/87 |
3.460 Rank: 8/87 |
13.44879 Rank: 32/87 |
0.28685 (±0.00000) Rank: 14/87 |
0.37940 (±0.00000) Rank: 16/87 |
SF | 2048.0 | 218.56 | 96.53 Rank: 10/87 |
1698.73 Rank: 22/87 |
3.693 Rank: 28/87 |
17.63611 Rank: 15/87 |
0.27593 (±0.00000) Rank: 26/87 |
0.41497 (±0.00000) Rank: 29/87 |
SG | 2048.0 | 168.69 | 79.70 Rank: 12/87 |
1141.71 Rank: 22/87 |
3.499 Rank: 5/87 |
16.64515 Rank: 21/87 |
0.24708 (±0.00000) Rank: 12/87 |
0.31910 (±0.00000) Rank: 12/87 |
SYD | 2048.0 | 192.11 | 87.21 Rank: 30/87 |
1533.14 Rank: 19/87 |
3.590 Rank: 19/87 |
19.79737 Rank: 23/87 |
0.30207 (±0.00000) Rank: 15/87 |
0.38556 (±0.00000) Rank: 22/87 |
TOK | 2048.0 | 229.24 | 93.07 Rank: 20/87 |
2032.26 Rank: 23/87 |
3.761 Rank: 19/87 |
14.47858 Rank: 31/87 |
0.66876 (±0.00000) Rank: 18/87 |
0.74530 (±0.00000) Rank: 15/87 |
TOR | 2048.0 | 145.13 | 86.80 Rank: 35/87 |
1446.25 Rank: 20/87 |
3.242 Rank: 18/87 |
18.74836 Rank: 47/87 |
0.20230 (±0.00000) Rank: 17/87 |
0.32910 (±0.00000) Rank: 19/87 |
ZRH | 2048.0 | 209.88 | 90.74 Rank: 13/87 |
1772.04 Rank: 20/87 |
3.402 Rank: 30/87 |
22.28421 Rank: 44/87 |
0.11176 (±0.00000) Rank: 20/87 |
0.18741 (±0.00000) Rank: 20/87 |
Avg | 2047.4 | 201.20 | 89.48 Rank: 21/87 |
1489.94 Rank: 21/87 |
3.703 Rank: 6/87 |
20.04958 Rank: 28/87 |
0.23105 (±0.00000) Rank: 15/87 |
0.33017 (±0.00000) Rank: 16/87 |
In the multi-view track we reconstruct the scene with Structure-from-Motion (Colmap) with small sets of images. We show the results for one bag of 10 images. Keypoints are drawn in blue if they are part of the model, and in red otherwise.
— Amsterdam —
— Bangkok —
— Barcelona —
— Buenos Aires —
— Cambridge —
— Cannes —
— Chicago —
— Helsinki —
— Madrid —
— Mountain View —
— New Orleans —
— San Francisco —
— Singapore —
— Sydney —
— Tokyo —
— Toronto —
— Zurich —