•   Home
  • Thank-You Letters
•   About IOI
  • Regulations
  • Committees
  • Members
  • History
  • The First IOI
  • The 21st IOI
•   Who is who
  • Honorary Patron
  • Organizers
  • Organizing Commettees
  • Sponsors
  • Media Partners
•   The place
  • About Bulgaria
  • About Plovdiv
  • Weather
  • Currency
  • Power supply equipment
•   Schedule
  • Detailed schedule
  • Conference schedule
•   Registration
  • Registration form
  • Participating teams
  • Observers
  • Visitors
  • Guests
  • Questors
  • Guides
  • Arrivals and departures
  • Accommodation
  • Fees
  • Visas
•   Competition
  • Rules
  • Syllabus
  • Equipment & Environment
  • Training session
  • Workplaces
  • Tasks and Solutions
  • Results
  • Online contest
  • Tasks of Past IOIs
•   Newsletter
•   Gallery
•   Team Photos of 12 Aug

Reactive tasks

The source program provided by the contestant must be contained in a single source file. The task statement will specify:

• the task to be solved,
• the input and output data formats,
• explanation of how to interact with the "opponent" program,
• the resource limitations for the computations (e.g., CPU time, memory limitations),
• elements of the grading criteria (e.g. "In some of the official test data that worth 40 points, N will be up to 100"),
• any other constraints on the program.

Output-only tasks

The competition might include tasks for which input data is given to the contestant and the contestant is required to produce only the output data as a solution. If the contestant writes programs to help determine the output data, the programs must not be submitted with the solution. The input data will be provided in ASCII text files. For these tasks, the task statement will specify:

• the task to be solved,
• the structure of the input and output files,
• information on obtaining the full set of official input files,
• names of output files,
• grading criteria.

The contestants should submit a zip or tgz archive with output files (only).

Input and output data

In all tasks, input and output data consist of one or more lines, each ending with an end-of-line character, including the last line. The end-of-line character in Linux is represented by the single character '\n' (ASCII code 10). Each line contains one or more space-separated items. An item is a string of printable non-white-space characters (ASCII code from 33 through 126, inclusive). An item may represent an integer or a general string; the meaning of each item will be given in the task description.

The format and limits for input and output data will be specified in the task description. The output data should be formatted strictly according to the task-specific instructions. The exact amount and type of whitespace you use to separate the elements in the output file will not matter in most cases. However, it is recommended to follow the output specification as precisely as possible.

Competition Procedures

Competition Schedule

There will be two competition days. On each competition day contestants will be given four tasks to complete in the five hours. Out of these four tasks, at least one will have detailed feedback enabled for the entire set of the official test cases. The schedule will be published on the official competition web site.

There will also be a two hour Practice Competition prior to the first competition day. The purpose of this practice round is to familiarize all participants with the environment and procedures. The practice tasks will be distributed in advance of the IOI. Contestants may bring printed solutions to the practice tasks, on paper only. All contestants are encouraged to take part in the Practice Competition round.

Quarantine

In order to protect the confidentiality of the tasks, all direct and indirect contacts and communication between contestants and delegation leaders are prohibited between the moment where tasks for a competition day are presented to the members of the GA and the end of the five-hour round on the following day. During this period the contestants are not allowed to communicate by any means, direct or indirect, with any member of the GA or anyone who has seen the tasks. The GA members are not allowed to communicate task-related information to anyone who is not a member of the GA. The contestants, the GA members and anyone else who has had access to the tasks must obey any instructions which restrict their access to specific parts of the IOI venue.

If a contestant violates the quarantine, he or she can be subject to disqualification. If some other person associated with a national delegation violates the quarantine, then all contestants of that delegation can be subjects to disqualification.

In order to eliminate any suspicion of cheating, contestants and team leaders should not use mobile phones and should switch off all wireless facilities in all devices during the quarantine.

Competition Equipment and Environment

All contest machines will be installed to boot in Linux. Microsoft Windows will not be available in the contest machines. The following packages will be installed:

• Unubtu 8.04 i386; GNOME;

• web browsers: Firefox;

• editors: mcedit, joe, vim, kate, kwrite, kdevelop, emacs, xemacs, xwpe, lazarus, gedit, nano, scite, codeblocks, geany;

• compilers: gcc >= 4.2, g++ >= 4.2, Free Pascal >= 2.2 with documentation;

• debuggers: gdb, ddd;

• STL documentation.

Hardware specification:

• Chipset Intel Bearlake G31

• CPU Core 2 Duo E2160 (1.80GHz, 1MB L2 Cache)

• RAM 2.0GB DDR2

• HDD 74GB but only 30GB will be available to contestants.

• Standard keyboard (US layout)

Competition Supplies

In the competition room, blank paper and writing utensils will be provided. On the competition days, contestants may not bring anything into the competition rooms, but:

• clothing,
• reasonable jewelry,
• writing utensils,
• simple wristwatches,
• simple keyboards (see below),
• small mascots (see below),
• English dictionaries (see below).

If a contestant wants to bring a keyboard, small mascots or English dictionaries to the competition, these must be submitted to the technical staff during the practice competition day. Any of these will be checked and, if cleared, will be given to the contestant in the first competition day. After the first competition day, the contestant must leave these items on his or her workstation if he or she wants to use them during the second competition day. Once again these will be checked and, if cleared, will be given to the contestant in the second competition day. After the second competition day the contestant must take any of these items with him or her.

Any attempt to bring any other item into the competition room will be considered cheating. In particular, during competition rounds it is strictly prohibited to bring:

• any computing equipment (e.g., keyboards, mice, calculators, organizers, PDAs, computers, calculator or "data bank" watches),
• any books, manuals, written or printed materials,
• any data storage medium (e.g., diskettes, CD-ROMs, "pen drives", compact flash/smart cards, micro-drives),
• any communication devices (e.g., mobile phones, radios of any sort).

Any electronic or printed materials provided by the organizers during the Competition Round may be used by the contestants (e.g., a Users Guide to the Contest System, or any electronic documentation or reference manuals provided in the installed contest environment or on the provided Contest Server).

Starting the Competition

On the competition days, immediately after breakfast ends, contestants will be admitted to the competition hall. All contestants must wear their ID badges during the competition. Each contestant will have a pre-assigned workstation; this information will be posted in the morning of the competition day. Contestants should be in their seats by at least 5 minutes prior to the start of the competition. On the way to their computers contestants will be checked to verify that they are only bringing allowed items into the competition hall. Small mascots and dictionaries must be submitted to the technical staff during the practice competition day, check Competition supplies section. Contestants must find their assigned computer, sit down, and wait for the competition to begin without touching any:

• computers,
• keyboards,
• mice,
• other competition materials including tasks.

The beginning of the competition will be marked by an audible start signal, after which the contestant may use any of the above items.

Clarification Requests

During the first two hours and a half of competition, contestants may submit written questions concerning any ambiguities or items needing clarification in the competition tasks. After this period comments may be received, but no answers will be given. Questions and comments must be submitted on the provided Clarification Request Forms, expressed either in the contestant's native language or in English. If required, delegation leaders will translate their contestants' questions into English after they are submitted and before they are sent to the Scientific Committee. The Scientific Committee will respond to every question submitted by the contestants. Since this might take some time, contestants should continue working while waiting for the answer to their questions. Contestants should phrase their questions so that a yes/no answer will be meaningful. Questions will be answered with one of the following:

• "YES"
• "NO"
• "ANSWERED IN TASK DESCRIPTION (EXPLICITLY OR IMPLICITLY)" - The task description contains sufficient information. The contestant should read it again carefully.
• "INVALID QUESTION" - The question is most likely not phrased so that a yes/no answer would be meaningful. The contestant is encouraged to rephrase the question.
• "NO COMMENT" - The contestant is asking for information that the Scientific Committee cannot give.

Contestants will not be involved in or exposed to discussion regarding their questions. However, in cases where the Scientific Committee feels that the contestant does not understand the task statement, English text which helps clarify the task may be added to the response, and if necessary, translated by the contestant's Delegation Leader into the language in which the question was originally posed.

Competition Server

The IOI competition takes place in a distributed environment in which each competitor has his or her own workstation for development and initial testing. Grading and evaluation take place on the Competition Server, which provides a similar execution environment to that of the contestant workstation. Тhe hardware of the Competition Server is the same as that of the contestant's workstations.

Each contestant's workstation has only Linux installed. A set of software development tools will be available. These tools are used to develop solutions to the competition tasks. There is no restriction on the number of times a program may be edited, compiled, and run on the workstation.

The workstations will have network access to the Competition Server, to a web server which provides documentation, to relevant task data, and facilities such as printing, test execution, and solution submission.

Facilities provided by the Competition Server are described next. These descriptions as well as the whole competition rules will be available on-line on the Competition Server.

The workstations will neither have access to each other nor the Internet. Any attempt to access another competitor's computer or the Internet will be considered cheating. Attempts to tamper with the Competition server, such as probing the server with customized URL's, will also be considered cheating.

Printing

Contestants are allowed to print only text files during the competition. After a contestant requests that a document be printed via the Contest Server interface, the support staff will deliver the printout to the contestant; contestants should not leave their computer to find printouts. Printouts will be delivered as quickly as possible, but large volumes can produce delays in delivery. The limit on the length of a printed document is 10 pages and 50 KB. If a document to be printed is longer, only the first 10 pages of the first 50 KB will be printed. On each competition day the contestant can print at most 30 documents.

SUBMIT Interface

Contestants submit solutions to the Competition Server via a web browser.

The programming language used by the contestants is determined based on the solution file extension:

• Pascal - *.pas,
• C - *.c,
• C++ - *.cpp,

Solutions for tasks may be submitted at any time. For tasks that require programs as solutions, each submitted source program must be written in C, C++ or Pascal, it must be smaller than 100 KB, the evaluation server must be able to compile it in less than 30 seconds and at most 512 MB of memory. No other extensions different than the ones listed above will be accepted. Submissions not satisfying these conditions will be rejected by the grading system. However this restriction will be ignored if you set the programming language explicitly in the web interface. Note that the submission will be accepted even if the program does not solve the sample tests correctly or within the given resource constraints. For tasks which require output files as solutions, every submission is accepted unless it violates some other acceptance rule stated in the task description. If a contestant submits more than one solution for the same task, the last accepted submission will be graded. This also applies for output only tasks, i.e. only the last submitted archive is considered for grading. There is a limit of 50 submissions per task (including rejected submissions).

TEST Interface

For tasks that require programs as solutions, a contestant may run a program in the evaluation environment using the TEST interface. To use this facility, the contestant supplies the program and an input file to the interface. The same restrictions, as for the SUBMIT interface, apply to the program source code. The input file can be at most 2 MB. However, it is possible to provide a compressed file (gzip or zip archive containing a single file), provided that the size of the uncompressed input is less than 20 MB. The TEST interface will execute the program, enforcing the resource limitations for the particular task. The provided input file is presented to the program, and the first 100 KB of output (without error stream) is captured. The running time, the captured output and any applicable error messages will be displayed.

The TEST interface allows the contestant to determine the exact behavior of his or her program in the evaluation environment with respect to compilation parameters, time and memory limits, and so on.

The TEST interface will be disabled during the last 30 minutes of each competition day.

BACKUP

Contestants are allowed to backup their files during the competition, using the Competition Server. Contestants are advised to make backups of their solutions periodically. On each competition day the contestant can make up to 100 backups. The limit on the size of a single backup is 1MB. The total size of all backups can be up to 10MB.

Assistance

Contestants may ask the support staff for assistance at any time. The staff members will not answer questions about the competition tasks, but will deliver Clarification Request Forms and printouts, help locate toilets and refreshments, and assist with computer and network problems. The only manner in which contestants are allowed to access the network is via web browser access to the designated Competition Server; even running a single 'ping' command is strictly prohibited. Contestants should never attempt to "fix" or "debug" or even "check" computer or network problems themselves; instead, they should ask for assistance.

Ending the Competition

Three warnings will be given at 15 minutes, 5 minutes, and 1 minute before the end of the round. Each warning will be given by an audible signal. The end of the round will be announced both verbally and by an audible signal. At the announcement ending the round, contestants must immediately stop working and wait at their desks without operating the computers or touching anything on their desks. An additional announcement will be made instructing them to leave their tables and exit the competition room.

At the end of the first competition round, any previously submitted items a contestant would like to use during the second competition round should be left at the workstation. All other items should be taken out of the competition hall, including task statements. At the end of the second competition round, contestants should remove all items including their mascots and dictionaries or any other previously submitted item; nothing should be left behind.

Grading

For output-only tasks, output files will be submitted as described above and scored as described in the task description.

For tasks that require programs as solutions, the submitted source files will be compiled under Linux, enforcing the source file size, and compilation time and memory constraints. The following commands will be used to compile solutions of tasks (say the task name is abc):

• For C: gcc -o abc abc.c -std=gnu99 -O2 -s -static -lm -x c
  

• For C++: g++ -o abc abc.cpp -O2 -s -static -lm -x c++
  

• For Pascal: fpc -O2 -XS -Sg abc.pas

Test case (batch and reactive tasks)

If the submitted solution compiled correctly, the grading system will, at some time later, execute the compiled program under Linux, enforcing the task-specific run-time and memory resource constraints with several inputs.

A test case refers to each time the solution is executed with a different input. For each test case the resource constraints will be enforced. If a program exceeds its allotment of any resource, the program is terminated and the test case is marked incorrect, without regard to any output produced.

If the program produces an output within the specified resource constraints, the output will be checked to verify its correctness. A score will be assigned to that specific test case depending on the output. Different test cases may have different maximum scores assigned to them.

If the test case is marked incorrect because it exceeded the resource constraints or because it produced an incorrect output it will be assigned a score of zero points.

For some tasks, partial credit may be awarded in a test case. Whenever this is possible it will be stated explicitly in the task description.

Upon termination, programs must always explicitly return an exit code 0. Other exit codes will be interpreted by the grading system as failures and no points will be awarded for the test run

Test Group

A test group is a set of one or more test cases. The score for a test group is defined as the minimum of the scores of its constituent test cases.

The purpose of a test group is to assess a well-defined characteristic of a program in a reliable and robust way. Such a characteristic could focus on, for instance, efficiency or special corner cases.

For every task there will be at least one "easy" test group, whose requirements will be separately stated in the task description.

Score

The final score for any task will be obtained by adding the scores of each of the test groups for that task.
Only work which has been submitted to and accepted by the grading system will be awarded points.

Detailed feedback when submitting

For some of the tasks, detailed feedback may be enabled. When detailed feedback is enabled for a task, then for every accepted submission the detailed feedback is being prepared. However submissions received in the last 15 minutes of the contest day will not receive detailed feedback. The submitted program then enters a queue for evaluation. Please keep in mind that the program can stay in the queue any time from a few seconds to several minutes. When its turn comes, the contestant's program will be evaluated on some of the official test cases. After the evaluation is done, the Competition Server will show to the contestant a summary of their results on the executed test cases. The summary will contain the total number of test cases and the number of test cases for each of the following possible outcomes:

• OK: The program executed within the constraints and the output produced was correct.
• Wrong Answer: The program executed within the constraints but the output produced was not correct.
• Time Limit Exceeded: The program exceeded the run-time limit specified by the task.
• Run Time Error: The program terminated prematurely or irregularly (exit code other than 0, illegal instruction, floating point exception, invalid memory reference, etc).

No information on how the test cases are grouped together or their assigned score will be given to the contestant. But for every test group if one of its test cases is enabled for feedback then all of its test cases are enabled for feedback.

No information on the actual data, the output produced by the contestant solution or any other execution details will be given to the contestant.
After the contest is over, the solution is evaluated again, this time on all the tests. The official results are based on the second evaluation. If the contestant solution is not deterministic, then it may happens, that the detailed feedback does not match the final results.

Cheating

Submitted programs are not allowed to:

• access the network,
• fork,
• open and create files,
• attack the system security or the grader,
• execute other programs,
• change file system permissions,
• read file system information,
• make system calls not related to solving the competition task.

All of the above actions are considered cheating, and may result in disqualification.

Appeal Process

Submitted solutions are evaluated using data which conforms to the specification given in the problem statement, but which is unknown to competitors during the competition.

Provisional grades, based on these tests, are delivered to team leaders' mailboxes as soon as they are available, shortly after competition ends. The judge data will be made available electronically in the competition area after the competition as well. Contestants and team leaders may use the contestant's workstations to verify that the grades are assessed correctly.
A Team Leader may file an appeal by completing an Appeal Form, available near the mailboxes, and submitting the completed form to the mailbox labeled "Appeals" at least 30 minutes prior to the final GA meeting of that competition day. Every appeal will be reviewed by the Scientific Committee and the team leader will be notified the committee's decision. All appeals and their disposition will be summarized at the final GA meeting of that competition day.

In the event that a mistake is discovered in the grading of a task, every successful submission of that task will be re-graded and re-scored whether or not the scoring of that submission has been appealed. Note that re-scoring may result in a higher or lower score for any contestant. Should anyone's score change after grading results have been distributed, new results will be printed and distributed to them.

Medal Allocation

After the second Competition Day and before the IOI Awards Ceremony the scientific committee establishes the medal distribution. The medals will be awarded based on the number of points the contestants achieved. For each of the medals, the scientific committee establishes the minimum score necessary to achieve this medal. Each medal will be awarded to precisely those contestants who reached or exceeded the respective minimum score, and didn't achieve a better medal. The medal boundaries are uniquely determined by the following rules:

• The score necessary to achieve a gold medal is the largest score such that at least one twelfth of all contestants receive a gold medal.
• The score necessary to achieve a silver medal is the largest score such that at least one fourth of all contestants receive a silver or a gold medal.
• The score necessary to achieve a bronze medal is the smallest score such that at most one half of all contestants receive a medal.

Code of Conduct

Any contestant:

• interfering with other contestants' activities,
• damaging the competition or evaluation facilities,
• accessing the network or any computer other then their own during a competition round by any means other than pointing a web browser at the Competition Server as directed,
• subverting the security of any computers (e.g., making any material accessible to the network from their computer),
• interfering with the execution of the competition in any way,
• communicating in any way with anyone other than the competition staff during a competition round (whether providing or receiving information or materials),
• or attempting to do any of the above

will be considered to be cheating and is subject to disqualification. Also refer to the list above of prohibited program actions which are considered cheating and may result in disqualification.
Cheating will be taken very seriously and rules will be strictly enforced. Any contestant who is cheating in any way will be immediately disqualified, at the discretion of the International Scientific Committee. It is of the utmost importance that team leaders speak to their contestants about cheating, instructing and urging all contestants not to cheat, explaining the relevant rules and verifying that all contestants fully understand them.