Clarification on whether both cgan_2023 and cgan2026 are included in the benchmark set

[xiangruzh]

Hi,

I noticed that the current benchmark set appears to contain both cgan_2023 and cgan2026. Could you clarify how these two benchmarks are intended to be handled? In particular:

• Will cgan_2023 be removed or deprecated in favor of cgan2026?
• Or are both cgan_2023 and cgan2026 intended to be included and scored as separate benchmarks?

Thanks!

[xiangruzh]

The same question applies to relusplitter.

[stanleybak]

cgan 2026 should be updated to the latest commit... if it's not too late that's the preference... otherwise we can just use cgan_2023 this time and do the newer version next year

[toladnertum]

Thanks for bringing this up! I think the 2023 version of both benchmarks are just included in the repo as we transferred all benchmarks from last year over to this year. However, please note that the submission platform only lets you select the 2026 version. Thus, that's the version that will be scored. This is also in line with the benchmark voting results: VNN-COMP/vnncomp2026#6 (comment)