]>
mj.ucw.cz Git - eval.git/log
Martin Mares [Sun, 9 Aug 2009 14:33:30 +0000 (16:33 +0200)]
First attempts at the evaluation overlord
Martin Mares [Sun, 9 Aug 2009 14:32:43 +0000 (16:32 +0200)]
Added a shabby skeleton of a logging module
Martin Mares [Sun, 9 Aug 2009 14:32:19 +0000 (16:32 +0200)]
Added a simple utility function for simulating mkdir -p.
Martin Mares [Sun, 9 Aug 2009 13:30:17 +0000 (15:30 +0200)]
Better error reporting
Martin Mares [Sun, 9 Aug 2009 13:11:25 +0000 (15:11 +0200)]
Better error reporting on the pipeline
Martin Mares [Sun, 9 Aug 2009 13:06:46 +0000 (15:06 +0200)]
A better implementation of the pipeline, including hook loader
Martin Mares [Sun, 9 Aug 2009 11:05:27 +0000 (13:05 +0200)]
Do not try to distinguish between single and double quotes
They are the same in Python.
Martin Mares [Sat, 8 Aug 2009 15:37:35 +0000 (17:37 +0200)]
A brief experiment with pipelines
Martin Mares [Sat, 8 Aug 2009 15:16:44 +0000 (17:16 +0200)]
Configuration values are now cached
Martin Mares [Sat, 8 Aug 2009 15:13:54 +0000 (17:13 +0200)]
Implemented overrides
Martin Mares [Sat, 8 Aug 2009 14:31:44 +0000 (16:31 +0200)]
Better error reporting
Martin Mares [Sat, 8 Aug 2009 14:23:44 +0000 (16:23 +0200)]
Added a prototype of the configuration module.
Martin Mares [Sat, 8 Aug 2009 13:29:45 +0000 (15:29 +0200)]
Initial experimental version of the meta-file module.
Martin Mares [Fri, 31 Jul 2009 18:57:06 +0000 (20:57 +0200)]
Eval: Added STACK_LIMIT.
Martin Mares [Fri, 31 Jul 2009 18:56:01 +0000 (20:56 +0200)]
Box: Do not report all errors as "during startup" if syscalls are not filtered.
Martin Mares [Fri, 31 Jul 2009 18:50:35 +0000 (20:50 +0200)]
Box: Added an option for controlling the stack size limit.
Beware, the default has been changed to `unlimited' instead of inheriting
the limit from the parent process.
Martin Mares [Wed, 29 Apr 2009 10:22:01 +0000 (12:22 +0200)]
Hopefully fixed the occasional "UGH" error.
When the machine creaks under high load, SIGALRM can arrive during the
final wait4() in box_exit(), causing it to return EINTR. Restart waiting
in such cases.
Martin Mares [Wed, 29 Apr 2009 10:19:15 +0000 (12:19 +0200)]
Include <linux/ptrace.h>, because <sys/ptrace.h> tends to be incomplete
Martin Mares [Sun, 5 Apr 2009 17:01:20 +0000 (19:01 +0200)]
Added a description of the meta-files
Martin Mares [Sun, 5 Apr 2009 16:51:40 +0000 (18:51 +0200)]
Box: Record in the meta-file whether the process has been killed
If it was, the time/memory statictics are known to be incomplete.
Martin Mares [Sun, 5 Apr 2009 16:48:17 +0000 (18:48 +0200)]
Box: Implemented the `-x' (extra timeout) option
Martin Mares [Sun, 5 Apr 2009 16:35:07 +0000 (18:35 +0200)]
Syscall handling reform
The previous code did not work with syscalls that do not return a value -- e.g.,
sysreturn(). In such cases, the kernel reports the exit from the syscall with
orig_eax == -1, which cannot be easily distinguished from a breakpoint.
I have rewritten the syscall checker to use the PTRACE_O_TRACESYSGOOD switch,
which causes the kernel to report syscalls in a slightly different way. Also,
the code now tests whether the syscall number on exit matched the one recorded
on entry (purely as a guard against possible silly bugs in synchronization
of syscall enter/exit reports with the kernel) and it also avoids suppresses
the meaningless return value of the sysreturn-like syscalls.
Martin Mares [Sat, 28 Mar 2009 16:21:53 +0000 (17:21 +0100)]
Box: Use SIGSTOP to notify the parent that the child is ready to be traced
instead of SIGCHLD. This should be safer.
Martin Mares [Sat, 28 Mar 2009 16:05:59 +0000 (17:05 +0100)]
Merge branch 'master' of ssh://git.ucw.cz/home/mj/GIT/eval
Martin Mares [Sat, 28 Mar 2009 16:05:55 +0000 (17:05 +0100)]
Sandbox: call setup_environment() before enabling syscall tracing
Martin Mares [Sat, 28 Mar 2009 13:49:58 +0000 (14:49 +0100)]
MOP: New templates for Debian Lenny
Martin Mares [Sat, 28 Mar 2009 13:22:38 +0000 (14:22 +0100)]
MOP: Updated the score table heading.
Martin Mares [Sat, 28 Mar 2009 13:20:40 +0000 (14:20 +0100)]
Added Milan's FPC patch (abort on runtime error)
Martin Mares [Sat, 28 Mar 2009 13:15:25 +0000 (14:15 +0100)]
mo-score-mop: implemented merging of test case groups
Martin Mares [Sat, 28 Mar 2009 13:10:40 +0000 (14:10 +0100)]
Install libraries with the submitter.
Martin Mares [Sat, 28 Mar 2009 13:08:14 +0000 (14:08 +0100)]
Merge branch 'layout'
Martin Mares [Thu, 26 Mar 2009 12:59:05 +0000 (13:59 +0100)]
Fixed typesetting of logins.
Martin Mares [Wed, 18 Mar 2009 13:56:19 +0000 (14:56 +0100)]
Adjusted configuration of tempfiles to new libucw.
Martin Mares [Wed, 18 Mar 2009 13:50:22 +0000 (14:50 +0100)]
Updated libucw config from upstream.
Martin Mares [Wed, 18 Mar 2009 13:42:13 +0000 (14:42 +0100)]
Need to switch directory when reading configuration.
The reason is that cf/mop needs to include cf/eval, but it cannot
use absolute paths, because the config file is read both before and
after installation to $MO_ROOT/.
Martin Mares [Wed, 18 Mar 2009 13:42:05 +0000 (14:42 +0100)]
Dereference links when installing.
Martin Mares [Wed, 18 Mar 2009 13:41:51 +0000 (14:41 +0100)]
Fixed a couple of very confusing bugs in the Makefiles.
Martin Mares [Wed, 18 Mar 2009 13:28:05 +0000 (14:28 +0100)]
More updates of MO-P admin scripts.
Martin Mares [Wed, 18 Mar 2009 13:17:28 +0000 (14:17 +0100)]
Updated MO-P admin scripts to new directory layout.
Martin Mares [Wed, 18 Mar 2009 13:16:38 +0000 (14:16 +0100)]
Submit: `make certs' is no longer used.
However, the certificate templates should be installed to lib/.
Martin Mares [Wed, 18 Mar 2009 13:16:25 +0000 (14:16 +0100)]
Updated create-certs to the new directory layout.
Martin Mares [Wed, 18 Mar 2009 13:15:40 +0000 (14:15 +0100)]
Include the right libucw config.
Martin Mares [Mon, 16 Mar 2009 22:48:39 +0000 (23:48 +0100)]
Updated tests after the recent change of judges' messages to stderr.
Martin Mares [Mon, 16 Mar 2009 22:45:35 +0000 (23:45 +0100)]
Disable building of libucw utilities.
Martin Mares [Mon, 16 Mar 2009 22:43:56 +0000 (23:43 +0100)]
Adapted to reflect changes in libucw.
Martin Mares [Mon, 16 Mar 2009 22:42:52 +0000 (23:42 +0100)]
Updated libucw to current version (Sherlock commit
17f29eb1ab186e9f053299c25f47ce368ee7e1de )
Martin Mares [Sun, 15 Mar 2009 12:31:14 +0000 (13:31 +0100)]
Default Pascal flags no longer enable range and stack checking.
Martin Mares [Sat, 14 Mar 2009 22:58:00 +0000 (23:58 +0100)]
The judge reports errors in a more useful way
They are reported to stderr as two lines: one is the location of the error,
another contains the error message. This is parsed by the evaluator and the
second line is displayed on the screen, while both are logged.
Martin Mares [Sat, 14 Mar 2009 22:57:02 +0000 (23:57 +0100)]
The judge IO streams remember the basename of the file instead of its full name
Martin Mares [Sat, 14 Mar 2009 22:35:12 +0000 (23:35 +0100)]
Compile the judge support functions as a separate library.
Martin Mares [Sat, 14 Mar 2009 22:34:57 +0000 (23:34 +0100)]
Judge: Added function get_nl() for checking of an expected end of line.
Martin Mares [Sat, 14 Mar 2009 17:56:24 +0000 (18:56 +0100)]
More makefile fixes.
Martin Mares [Sat, 14 Mar 2009 17:55:19 +0000 (18:55 +0100)]
Fix makefiles for compilation in a different directory.
Martin Mares [Sun, 2 Nov 2008 20:12:43 +0000 (21:12 +0100)]
Handle exit code translation failures gracefully.
Apparantly, "X=`false`" fails with a non-zero exit code
(and the script stops), even though "echo `false`" doesn't.
Martin Mares [Sat, 13 Sep 2008 13:08:18 +0000 (15:08 +0200)]
Avoid Perl when printing signal names.
Use `kill -l $SIG` as suggested by Lukas Turek.
This was the only Perl dependency in the whole libeval.
Martin Mares [Sun, 24 Aug 2008 22:09:47 +0000 (00:09 +0200)]
Updated TODO.
Martin Mares [Sun, 24 Aug 2008 22:09:32 +0000 (00:09 +0200)]
Sample memory usage only on selected syscalls.
Martin Mares [Sun, 24 Aug 2008 21:59:24 +0000 (23:59 +0200)]
Detect breakpoint instructions, which are reported as syscall #-1.
Martin Mares [Sun, 24 Aug 2008 21:56:44 +0000 (23:56 +0200)]
Introduced sampling of memory usage.
This patch introduces the basic stuff. So far, it samples VmPeak before and after
each syscalls, which will be fixed in subsequent commits.
Martin Mares [Sun, 24 Aug 2008 21:11:55 +0000 (23:11 +0200)]
Oops, there was a typo in the previous patch.
Martin Mares [Sun, 24 Aug 2008 21:08:40 +0000 (23:08 +0200)]
The mmap2() syscall is available even in the strict mode.
There is no reason to handle it differently from mmap().
Martin Mares [Sun, 24 Aug 2008 21:07:28 +0000 (23:07 +0200)]
Permit the set_tid_address() syscall.
It used by glibc 2.3.6 automagically.
Martin Mares [Sun, 24 Aug 2008 21:03:34 +0000 (23:03 +0200)]
Document various error reporting functions.
Martin Mares [Fri, 22 Aug 2008 18:25:01 +0000 (20:25 +0200)]
The FIXME was wrong, start_time is available whenever box_pid is.
Martin Mares [Fri, 22 Aug 2008 18:23:49 +0000 (20:23 +0200)]
Internal errors are reported properly.
Martin Mares [Fri, 22 Aug 2008 18:20:23 +0000 (20:20 +0200)]
Write all relevant information to the metafile.
Martin Mares [Fri, 22 Aug 2008 18:17:18 +0000 (20:17 +0200)]
usage() should exit with code 2, too.
Martin Mares [Fri, 22 Aug 2008 17:10:06 +0000 (19:10 +0200)]
We do not care about ancient C libraries any more.
Martin Mares [Fri, 22 Aug 2008 17:02:18 +0000 (19:02 +0200)]
Distinguish between die() and err().
die() is used for internal errors only and it exits with status 2,
err() is used for reporting errors of the process inside the box with status 1.
Martin Mares [Fri, 22 Aug 2008 16:54:49 +0000 (18:54 +0200)]
Changed formatting of time metas.
Martin Mares [Fri, 22 Aug 2008 16:50:08 +0000 (18:50 +0200)]
Gather timing statistics on unsuccessful exit, too.
Martin Mares [Fri, 22 Aug 2008 15:55:50 +0000 (17:55 +0200)]
Added basic support for writing meta-files.
Original patch by TomGav, cleaned up by me.
Martin Mares [Sat, 7 Jun 2008 21:17:15 +0000 (23:17 +0200)]
Use new Configure module to configure crypto libs.
Martin Mares [Sat, 7 Jun 2008 21:16:54 +0000 (23:16 +0200)]
Imported new Configure module from libucw which handles pkg-config.
Martin Mares [Sun, 25 May 2008 21:42:58 +0000 (23:42 +0200)]
CONFIG_MOP is now enabled by default.
Martin Mares [Sun, 25 May 2008 21:42:36 +0000 (23:42 +0200)]
Clean up exit codes of judges.
exit(1) always means an error in the judged output,
exit(2) is used whenever an internal error is encountered (missing files etc.).
Martin Mares [Sun, 25 May 2008 21:29:07 +0000 (23:29 +0200)]
Updated TODO.
Martin Mares [Sun, 25 May 2008 21:23:30 +0000 (23:23 +0200)]
Removed mo-create-packages from the makefile as well.
Martin Mares [Sun, 25 May 2008 21:19:04 +0000 (23:19 +0200)]
Cleaned up mop/admin/.
The script still need some updates and thorough testing.
Martin Mares [Sun, 25 May 2008 21:18:47 +0000 (23:18 +0200)]
Removed mo-create-packages.
Martin Mares [Sun, 25 May 2008 21:06:23 +0000 (23:06 +0200)]
Clean up backup, grab and push scripts.
Martin Mares [Sun, 25 May 2008 20:59:41 +0000 (22:59 +0200)]
Cleanups in mop/score/.
Martin Mares [Sun, 25 May 2008 20:59:33 +0000 (22:59 +0200)]
Cleanups in mop/eval/.
Martin Mares [Sun, 25 May 2008 20:52:38 +0000 (22:52 +0200)]
CT_UID_MAX is no longer used.
Martin Mares [Sun, 25 May 2008 20:51:56 +0000 (22:51 +0200)]
Move more things to mop.cf and also include userlist.
The old method of listing users by matching UID's is no longer supported.
Martin Mares [Sun, 25 May 2008 20:51:11 +0000 (22:51 +0200)]
MO_ROOT belongs to mop.cf.
Martin Mares [Sun, 25 May 2008 20:25:13 +0000 (22:25 +0200)]
Build all mop/ subdirs.
Martin Mares [Sun, 25 May 2008 20:09:09 +0000 (22:09 +0200)]
Split mop/ to several subdirectories: admin, eval, public and score.
This commit involves only file moves and renames.
Martin Mares [Sun, 25 May 2008 20:05:34 +0000 (22:05 +0200)]
mop/print-score is gone.
Martin Mares [Sun, 25 May 2008 20:05:20 +0000 (22:05 +0200)]
mo-merge-tests removed
Merging is already handled by both mo-score and mo-report.
Martin Mares [Sun, 25 May 2008 19:37:41 +0000 (21:37 +0200)]
Linked mop/ to the build system.
CONFIG_MOP is not enabled by default yet.
Martin Mares [Sun, 25 May 2008 19:37:15 +0000 (21:37 +0200)]
Moved md5crypt from utils/ to mop/
(The utility is used only by MO-P admin scripts anyway and I want to
avoid utils/ depending on libucw.)
Martin Mares [Sun, 25 May 2008 17:40:59 +0000 (19:40 +0200)]
Allow `configure OPTIONS' without specifying configuration name.
This involves a little bit of dwimmery -- we assume that the options are
all uppercase and the configuration files do not, but that's hopefully
a fair game.
Martin Mares [Sun, 25 May 2008 17:39:47 +0000 (19:39 +0200)]
Synchronized with current libucw.
Martin Mares [Wed, 21 May 2008 13:16:29 +0000 (15:16 +0200)]
`exceptions' moved to mop/.
Tomas Gavenciak [Wed, 21 May 2008 13:08:26 +0000 (15:08 +0200)]
TomGav's TODO list.
Martin Mares [Wed, 21 May 2008 13:07:57 +0000 (15:07 +0200)]
Improved description of IO_TYPE=dir.
Tomas Gavenciak [Wed, 21 May 2008 13:06:56 +0000 (15:06 +0200)]
Introduced IO_TYPE=dir.
Tomas Gavenciak [Wed, 21 May 2008 13:06:07 +0000 (15:06 +0200)]
Introduced TEST_EXEC_CMD.
Martin Mares [Wed, 21 May 2008 13:04:38 +0000 (15:04 +0200)]
HDIR should default to `.'.