X-Git-Url: http://mj.ucw.cz/gitweb/?a=blobdiff_plain;f=TODO;h=698a6ea58eaa1a54a4bf075bb63d2772d80f941b;hb=1636b318830d64ec5c393d1a2d043f595f0342c4;hp=32173204274c5d193fda9f74fe23d6496ff1bbaa;hpb=4c21fa2c4610fb912324229e92c0184744dc2dab;p=eval.git diff --git a/TODO b/TODO index 3217320..698a6ea 100644 --- a/TODO +++ b/TODO @@ -1,17 +1,11 @@ Evaluator ~~~~~~~~~ -score: better formatting of the score table interactive tasks: solve deadlocks? interactive tasks: logging of messages terminology: problem -> task ? -writing of verdicts to stdout (include timing and check on interactive tasks, including judge errors) -box: memory usage statistics (need to search for VMPeak in /proc/$PID/status, but it disappears too early) -remove scanning of users by UID Judges ~~~~~~ -integrate to the top-level makefile -clean up exit codes test cases for judge-shuff Environment @@ -26,16 +20,20 @@ New submitter: - contest: task status cache Various ideas: -scores dependent on time (like PL olympiad) -box: configurable access to timers and /proc/self/{stat,fd} -box: limit the total amount of data written to files, so that quotas don't have to be set up +- scores dependent on time (like PL olympiad) -TomGav: -- substitute $VAR without using eval -- stderr parsers -- VMMax -> getrusage() -- clean up names of temporary files -- machine-readable log file -- split bin -- configurable names of in/out files -- multiple in files (stored as an archive or directory) +TomGav +~~~~~~ +recursive try-ln for dir input +clean and well-defined expansion (beware of per-test re-expansion) +configurable names of in/out files (independent of $PROBLEM) +paranoidly check file mode/owner before running the sandbox + +Isolate +~~~~~~~ +Test: ptrace self +Test: SIGSTOP +Test: ping-pong timing attacks +Test: big static memory +Examine the use of taskstats for measuring memory +Switch license to GPL2/GPL3