X-Git-Url: http://mj.ucw.cz/gitweb/?a=blobdiff_plain;f=TODO;h=698a6ea58eaa1a54a4bf075bb63d2772d80f941b;hb=1636b318830d64ec5c393d1a2d043f595f0342c4;hp=f295577b02cc9a61dc0a7f54f8fe105c4854a7fc;hpb=f72d5d3207794371127e2cdad56083c95e2096dc;p=eval.git diff --git a/TODO b/TODO index f295577..698a6ea 100644 --- a/TODO +++ b/TODO @@ -1,16 +1,11 @@ Evaluator ~~~~~~~~~ -score: better formatting of the score table interactive tasks: solve deadlocks? interactive tasks: logging of messages terminology: problem -> task ? -writing of verdicts to stdout (include timing and check on interactive tasks, including judge errors) -box: memory usage statistics (need to search for VMPeak in /proc/$PID/status, but it disappears too early) Judges ~~~~~~ -integrate to the top-level makefile -clean up exit codes test cases for judge-shuff Environment @@ -18,7 +13,6 @@ Environment fpc: add switch -gl (runtime errors write line#), but avoid that when inside the sandbox Installer: -- mo-install: reduce what gets copied to mo-eval home - update group permissions - quotas @@ -26,21 +20,20 @@ New submitter: - contest: task status cache Various ideas: -scores dependent on time (like PL olympiad) -box: configurable access to timers and /proc/self/{stat,fd} -box: limit the total amount of data written to files, so that quotas don't have to be set up +- scores dependent on time (like PL olympiad) -TomGav: -- hook for translation of exit codes -- substitute $VAR without using eval -- stderr parsers -- {pre,post}{comp,run} hooks -- document which hook can be overridden by problem's config -- box: add redirection of stderr -- VMMax -> getrusage() -- clean up names of temporary files -- machine-readable log file -- split bin -- configurable names of in/out files -- multiple in files (stored as an archive or directory) -- locate-source: arbitrary input file name +TomGav +~~~~~~ +recursive try-ln for dir input +clean and well-defined expansion (beware of per-test re-expansion) +configurable names of in/out files (independent of $PROBLEM) +paranoidly check file mode/owner before running the sandbox + +Isolate +~~~~~~~ +Test: ptrace self +Test: SIGSTOP +Test: ping-pong timing attacks +Test: big static memory +Examine the use of taskstats for measuring memory +Switch license to GPL2/GPL3