Skip to content

Commit d1ab374

Browse files
ingberamingberam
authored
leaderboard update (#285)
1 parent 9537af2 commit d1ab374

File tree

1 file changed

+62
-26
lines changed

1 file changed

+62
-26
lines changed

‎neurips23.html

+62-26
Original file line numberDiff line numberDiff line change
@@ -32,8 +32,7 @@
3232
<nav>
3333
<ul>
3434
<li><a href="#tracks">Tracks</a></li>
35-
<li><a href="#winners">Winners</a></li>
36-
<li><a href="#participate">Participate</a></li>
35+
<li><a href="https://github.com/harsha-simhadri/big-ann-benchmarks/blob/main/neurips23/README.md">Participate</a></li>
3736
<li><a href="#organizers">Organizers</a></li>
3837
<li><a href="neurips21.html">NeurIPS'21: Billion-Scale ANN Challenge</a></li>
3938
</ul>
@@ -73,7 +72,7 @@ <h1>
7372

7473
<div class="table-container">
7574
<p class="hero-text">
76-
<b>New: the latest ongoing leaderboard has been released (Feb 1st, 2024). <br> Top entries:</b>
75+
<b>New: the latest ongoing leaderboard has been released (March 1st, 2024). <br> Top entries:</b>
7776
</p>
7877

7978
<table>
@@ -98,38 +97,75 @@ <h1>
9897
<td class="group-border">85,491</td>
9998
<td>1</td>
10099
<td><a href="https://github.com/harsha-simhadri/big-ann-benchmarks/tree/main/neurips23/ood/pinecone-ood">Pinecone-ood</a></td>
101-
<td class="group-border">31,643</td>
100+
<td class="group-border">38,088</td>
102101
<td>1</td>
103102
<td><a href="https://github.com/harsha-simhadri/big-ann-benchmarks/tree/main/neurips23/sparse/zilliz ">Zilliz</a></td>
104-
<td>9,933</td>
103+
<td>10,749</td>
105104
</tr>
106105
<tr>
107106
<td>2</td>
108107
<td><a href="https://github.com/harsha-simhadri/big-ann-benchmarks/tree/main/neurips23/filter/zilliz ">Zilliz</a></td>
109108
<td class="group-border">84,596</td>
110109
<td>2</td>
111110
<td><a href="https://github.com/harsha-simhadri/big-ann-benchmarks/tree/main/neurips23/ood/zilliz ">Zilliz</a></td>
112-
<td class="group-border">27,585</td>
111+
<td class="group-border">33,241</td>
113112
<td>2</td>
114-
<td><a href="https://github.com/harsha-simhadri/big-ann-benchmarks/tree/main/neurips23/sparse/pyanns">PyANNS</a></td>
115-
<td>8,732</td>
113+
<td><a href="https://github.com/harsha-simhadri/big-ann-benchmarks/tree/main/neurips23/sparse/pinecone_smips">Pinecone_smips</a></td>
114+
<td>10,440</td>
116115
</tr>
117-
<tr>
116+
<tr>
118117
<td>3</td>
119118
<td><a href="https://github.com/harsha-simhadri/big-ann-benchmarks/tree/main/neurips23/filter/parlayivf">ParlayANN IVF<sup>2</sup></a></td>
120119
<td class="group-border">37,902</td>
121120
<td>3</td>
122121
<td><a href="https://github.com/harsha-simhadri/big-ann-benchmarks/tree/main/neurips23/ood/mysteryann">RoarANN</a></td>
123122
<td class="group-border">22,555</td>
124123
<td>3</td>
125-
<td><a href="https://github.com/harsha-simhadri/big-ann-benchmarks/tree/main/neurips23/sparse/pinecone_smips">Pinecone_smips</a></td>
126-
<td>8,078</td>
124+
<td><a href="https://github.com/harsha-simhadri/big-ann-benchmarks/tree/main/neurips23/sparse/pyanns">PyANNS</a></td>
125+
<td>8,732</td>
126+
</tr>
127+
<tr>
128+
<td>4</td>
129+
<td><a href="https://github.com/harsha-simhadri/big-ann-benchmarks/tree/main/neurips23/filter/puck">Puck</a></td>
130+
<td class="group-border">19,193</td>
131+
<td>4</td>
132+
<td><a href="https://github.com/harsha-simhadri/big-ann-benchmarks/tree/main/neurips23/ood/pyanns">PyANNS</a></td>
133+
<td class="group-border">22,296</td>
134+
<td>4</td>
135+
<td><a href="https://github.com/harsha-simhadri/big-ann-benchmarks/tree/main/neurips23/sparse/shnsw">shnsw</a></td>
136+
<td>7,137</td>
137+
</tr>
138+
<tr >
139+
<td style="padding: 0;"> ...</td>
140+
<td style="padding: 0;"> ...</td>
141+
<td style="padding: 0;" class="group-border"> ...</td>
142+
<td style="padding: 0;"> ...</td>
143+
<td style="padding: 0;"> ...</td>
144+
<td style="padding: 0;" class="group-border"> ...</td>
145+
<td style="padding: 0;"> ...</td>
146+
<td style="padding: 0;"> ...</td>
147+
<td style="padding: 0;"> ...</td>
127148
</tr>
149+
<tr>
150+
<td>Baseline</td>
151+
<td><a href="https://github.com/harsha-simhadri/big-ann-benchmarks/tree/main/neurips23/filter/faiss">FAISS</a></td>
152+
<td class="group-border">3,032</td>
153+
<td>Baseline</td>
154+
<td><a href="https://github.com/harsha-simhadri/big-ann-benchmarks/tree/main/neurips23/ood/diskann">Diskann</a></td>
155+
<td class="group-border">4,133</td>
156+
<td>Baseline</td>
157+
<td><a href="https://github.com/harsha-simhadri/big-ann-benchmarks/tree/main/neurips23/sparse/pyanns">Linscan</a></td>
158+
<td>93</td>
159+
</tr>
160+
128161
</table>
129162
<p class="hero-text">
130-
See here for the <a href="https://github.com/harsha-simhadri/big-ann-benchmarks/blob/main/neurips23/ongoing_leaderboard/leaderboard.md">full ongoing leaderboard and rules</a>. Next update: March 1st, 2024.
131-
<br>
132163
Note: entries by pinecone and zilliz are not open source.
164+
<br>
165+
<div class="buttons">
166+
<a href="https://github.com/harsha-simhadri/big-ann-benchmarks/blob/main/neurips23/ongoing_leaderboard/leaderboard.md"
167+
class="button button-alpha">Full Leaderboard, Plots, and Rules</a>
168+
</div>
133169
</p>
134170
</div>
135171

@@ -148,19 +184,19 @@ <h1>
148184
by limiting the scale of the datasets to about 10 million points.
149185
</p>
150186

151-
<div class="buttons">
152-
<a href="https://github.com/harsha-simhadri/big-ann-benchmarks/blob/main/neurips23/README.md"
153-
class="button button-white">Get Started</a>
154-
<a href="https://neurips.cc/virtual/2023/competition/66587" class="button button-alpha">
155-
NeurIPS'23 Session
156-
</a>
157-
<a href="https://github.com/harsha-simhadri/big-ann-benchmarks/blob/main/neurips23/leaderboard.md" class="button button-white">
158-
NeurIPS'23 Leaderboard
159-
</a>
160-
<a href="#winners" class="button button-alpha">
161-
Track Winners and presentations
162-
</a>
163-
</div>
187+
<!-- <div class="buttons">-->
188+
<!-- <a href="https://github.com/harsha-simhadri/big-ann-benchmarks/blob/main/neurips23/README.md"-->
189+
<!-- class="button button-white">Get Started</a>-->
190+
<!-- <a href="https://neurips.cc/virtual/2023/competition/66587" class="button button-alpha">-->
191+
<!-- NeurIPS'23 Session-->
192+
<!-- </a>-->
193+
<!-- <a href="https://github.com/harsha-simhadri/big-ann-benchmarks/blob/main/neurips23/leaderboard.md" class="button button-white">-->
194+
<!-- NeurIPS'23 Leaderboard-->
195+
<!-- </a>-->
196+
<!-- <a href="#winners" class="button button-alpha">-->
197+
<!-- Track Winners and presentations-->
198+
<!-- </a>-->
199+
<!-- </div>-->
164200
</div>
165201
</section>
166202

0 commit comments

Comments
 (0)