Published-Benchmarks - Documentation

English

Published Benchmarks (SSYZ Benchmarks)

Benchmark List and Filtering

Benchmarks published on the platform can be accessed using the “SSYZ Benchmarks” button. Listings can be filtered using the left-panel options. Clicking any benchmark opens its detailed view page.

Benchmark Details Page

On the details page, users can view: 1. Benchmark start and end dates, 2. Participation requirements, 3. General descriptions and notices under the “Get Started” section (these may vary by benchmark).

The “Phases” tab includes the schedule and explanations for each benchmark phase.

The “My Submissions” section allows uploading model submissions and reviewing previous submissions for each phase.

The Results section displays leaderboard rankings. Clicking a participant’s name reveals detailed information.

Participation and Submission Process

Benchmark Registration

To enter a benchmark, users must open the “My Submissions” tab and accept the rules. When required, a registration request is sent to the organizer. Once approved, the user is notified. Organized instructions must be followed during this step.

Submission Types

Submissions require uploading a .zip file prepared according to organizer specifications:

a. Code Submission: Includes a metadata file specifying the execution command. b. Result Submission: Submission of model inference results. (No code is executed on the platform.)

Submission Steps

Log in to the SSYZ Benchmark Platform. If you do not have an account, you must create one using an invitation code.
Choose a benchmark and open the “My Submissions” tab. Provided datasets can also be downloaded here.
In the upload area:
- Enterprise users upload on behalf of their organization,
- Academic users upload individually.
Click the attachment icon and upload the .zip file.
If you previously uploaded a model, it may be selected from the “Choose Model” list.

Submission Results

Submission status and results can be monitored through the “My Submissions” tab. Users may choose to make any submission public, in which case it will appear on the leaderboard in the Results section.

SSYZ Benchmark Platform is an enterprise platform that enables secure and comparable evaluation of large language models on the SSYZ network infrastructure operated under SSB coordination.

Presidency of Defense Industries - Artificial Intelligence Center (SSYZ)

www.ssb.gov.tr www.sayzek.org.tr ssyz.org.tr

Edit Created By: Key: Is Public: Yes No Files Solutions Search by name... Show Public Tasks Upload Task Create Task Delete Selected Tasks Name Description Creator In Use Public Actions Select Users Select top 5 biggest users Download as CSV Last snapshot date: No snapshot has been taken yet User Joined at Datasets Submissions Total usage Competitions usage Users usage Administration usage Orphaned files usage Select top 5 biggest competitions Competition Organizer Creation date Submission Management Search Users... Search Competitions... Re-run Selected Stop Selected Delete Selected File Name File Size Submitted at Processing Start Processing End Compute Worker Queue Docker Image User Management Portal Search Users... Name Username Email User Type Delete User Delete User ? Cancel Change User User ID Switch User Search... Delete Selected File Name Benchmark Size Uploaded Delete? No Datasets Yet! Details Key Created By Created Description: Used by: Download File Close Filter Leaderboard by Columns Start typing to filter columns under 'Meta-data' or Tasks. Task: # Participant Date ID This CSV This JSON You are not a participant of this competition. Please register in My Submissions tab to view the leaderboard. Your request to participate in this competition is waiting for an approval from the competition organizer. Your request to participate in this competition is denied. Please contact the competition organizer for more details. No submissions have been added to this leaderboard yet! Preparing submission... this may take a few moments.. Scoring Ingestion ---- Approved Pending Denied Unknown Show deleted accounts Email all participants Download all participants Username Is Bot? account deleted Revoke Approve Send Message Send Email Subject A message from the admins of {competition_title} Content Number of submissions used for the day The submission limit resets at midnight server time. Number of total submissions used All ID # File name Owner Phase Date Status Score Detailed Results Actions Run Submission Rerun Submission Delete Submission Cancel Submission Add to Leaderboard On the Leaderboard Make Public Make Private Task Admin ERROR: Submission is a parent, but has no children. There was an error during creation.