]>
mj.ucw.cz Git - libucw.git/log
Martin Mares [Tue, 12 Dec 2006 20:45:33 +0000 (21:45 +0100)]
The asio.test should be performed only in threaded mode.
Martin Mares [Mon, 11 Dec 2006 22:48:31 +0000 (23:48 +0100)]
Merge with git+ssh://cvs.ucw.cz/projects/sherlock/GIT/sherlock.git
(After the threading infrastructure has been merged to main.)
Martin Mares [Mon, 11 Dec 2006 22:46:52 +0000 (23:46 +0100)]
Updated various programs and Makefiles to use the threading infrastructure.
Martin Mares [Mon, 11 Dec 2006 22:46:28 +0000 (23:46 +0100)]
Updated libucw threading notes.
Martin Mares [Mon, 11 Dec 2006 22:46:18 +0000 (23:46 +0100)]
Logging functions are thread-safe.
Martin Mares [Mon, 11 Dec 2006 22:45:56 +0000 (23:45 +0100)]
Fixed thread safety of signal handling.
Signals delivery is generally not deterministic in multi-threaded programs,
but SIGSEGV is always sent by the kernel to the thread which caused the fault.
Replaced the global signal handler array by a pointer in the per-thread
context and replaced saving of original handles (which was wrong even in
some non-threaded cases) by locked use counters.
Also moved logging of the SIGSEGV error message out of the signal handler
to be sure there are no clashes.
When libucw is compiled without threading, everything is nearly as simple
as before, because the thread context struct is static and all locks
disappear.
Martin Mares [Mon, 11 Dec 2006 22:44:55 +0000 (23:44 +0100)]
Export temp_file_name().
Martin Mares [Mon, 11 Dec 2006 22:44:43 +0000 (23:44 +0100)]
Creation of temporary files is now thread-safe (ugh).
Martin Mares [Mon, 11 Dec 2006 22:43:37 +0000 (23:43 +0100)]
Added threading infrastructure to libucw and CONFIG_UCW_THREADS.
Finally decided that we need threading support in too many libucw modules,
so the only sane thing is to link all programs with -lpthread. On the
other hand, I would like to keep the possibility of building non-threaded libucw,
so I've introduced a new config switch, which is always set for Sherlock.
Martin Mares [Mon, 11 Dec 2006 22:39:22 +0000 (23:39 +0100)]
Trivial cleanups.
Martin Mares [Mon, 11 Dec 2006 22:38:05 +0000 (23:38 +0100)]
Added a library module for distributing work between threads.
(Ported from the dev-sorter branch.)
Martin Mares [Mon, 11 Dec 2006 22:24:28 +0000 (23:24 +0100)]
Removed an old FIXME.
Pavel Charvat [Mon, 11 Dec 2006 20:26:07 +0000 (21:26 +0100)]
size_t != uns
Martin Mares [Sat, 9 Dec 2006 22:24:44 +0000 (23:24 +0100)]
Fixed thread safety of signal handling.
Signals delivery is generally not deterministic in multi-threaded programs,
but SIGSEGV is always sent by the kernel to the thread which caused the fault.
Replaced the global signal handler array by a pointer in the per-thread
context and replaced saving of original handles (which was wrong even in
some non-threaded cases) by locked use counters.
Also moved logging of the SIGSEGV error message out of the signal handler
to be sure there are no clashes.
When libucw is compiled without threading, everything is nearly as simple
as before, because the thread context struct is static and all locks
disappear.
Martin Mares [Sat, 9 Dec 2006 21:39:36 +0000 (22:39 +0100)]
Logging functions are thread-safe.
Martin Mares [Sat, 9 Dec 2006 21:16:51 +0000 (22:16 +0100)]
Use Threads.DefaultStackSize instead of various local stack sizes.
Martin Mares [Sat, 9 Dec 2006 21:10:45 +0000 (22:10 +0100)]
Configure default thread stack size globally.
Martin Mares [Sat, 9 Dec 2006 21:00:38 +0000 (22:00 +0100)]
Use the generic thread context to hold per-thread I/O queue.
Martin Mares [Sat, 9 Dec 2006 20:58:13 +0000 (21:58 +0100)]
Converted asio to use the global ucwlib lock.
Martin Mares [Sat, 9 Dec 2006 20:57:04 +0000 (21:57 +0100)]
Converted the fb-temp module to use threads.h.
Martin Mares [Sat, 9 Dec 2006 20:55:02 +0000 (21:55 +0100)]
Added a simple threading helper module.
Martin Mares [Sat, 9 Dec 2006 19:12:57 +0000 (20:12 +0100)]
Remove extra dependencies on -lpthread.
Martin Mares [Sat, 9 Dec 2006 19:02:48 +0000 (20:02 +0100)]
fb-direct: Implemented temporary files.
Martin Mares [Sat, 9 Dec 2006 19:02:33 +0000 (20:02 +0100)]
Don't forget to build fb-direct.
Martin Mares [Sat, 9 Dec 2006 19:01:12 +0000 (20:01 +0100)]
fb-direct: Name-space cleanup.
Martin Mares [Sat, 9 Dec 2006 19:00:46 +0000 (20:00 +0100)]
Creation of temporary files is now thread-safe (ugh).
Martin Mares [Sat, 9 Dec 2006 18:48:39 +0000 (19:48 +0100)]
Added a direct I/O fastbuf backend.
Martin Mares [Sat, 9 Dec 2006 18:47:24 +0000 (19:47 +0100)]
Added CONFIG_UCW_THREADS.
Finally decided that we need threading support in too many libucw modules,
so the only sane thing is to link all programs with -lpthread. On the other
hand, I would like to keep the possibility of building non-threaded libucw,
so I've introduced a new config switch, which is always set for Sherlock.
Martin Mares [Sat, 9 Dec 2006 18:28:02 +0000 (19:28 +0100)]
asio: Put a lock around maintenance of use-counts.
I want to allow threads creating their own asio queues asynchronously.
Martin Mares [Sat, 9 Dec 2006 18:27:14 +0000 (19:27 +0100)]
asio: Add a couple of user-defined fields.
Martin Mares [Sat, 9 Dec 2006 18:26:58 +0000 (19:26 +0100)]
fb-file: A couple of trivial cleanups.
Martin Mares [Fri, 8 Dec 2006 17:09:22 +0000 (18:09 +0100)]
Merge with git+ssh://cvs.ucw.cz/projects/sherlock/GIT/sherlock.git
Martin Mares [Fri, 8 Dec 2006 17:09:08 +0000 (18:09 +0100)]
Merge with git+ssh://cvs.ucw.cz/projects/sherlock/GIT/sherlock.git#v3.10
(centrum/cz/{cf/local,config} merged manually)
Martin Mares [Fri, 8 Dec 2006 16:47:16 +0000 (17:47 +0100)]
workqueue: Added non-blocking wait functions.
Pavel Charvat [Fri, 8 Dec 2006 16:44:59 +0000 (17:44 +0100)]
CONFIG_INSTALL_API installs libimages headers
Martin Mares [Mon, 4 Dec 2006 12:35:24 +0000 (13:35 +0100)]
Merge with git+ssh://cvs.ucw.cz/projects/sherlock/GIT/sherlock.git
Martin Mares [Fri, 1 Dec 2006 23:00:55 +0000 (00:00 +0100)]
Benchmark of the new asio-test.
Martin Mares [Fri, 1 Dec 2006 23:00:36 +0000 (00:00 +0100)]
A more realistic asio-test, which uses memcpy().
Martin Mares [Fri, 1 Dec 2006 22:25:28 +0000 (23:25 +0100)]
Merge with git+ssh://cvs.ucw.cz/projects/sherlock/GIT/sherlock.git#dev-sorter
Martin Mares [Fri, 1 Dec 2006 22:25:22 +0000 (23:25 +0100)]
Added a couple of ASSERTs more.
Martin Mares [Fri, 1 Dec 2006 21:52:32 +0000 (22:52 +0100)]
Added new benchmarks.
asio-test turned out to be significantly faster when writing and
slightly faster when copying or reading. Good.
Martin Mares [Fri, 1 Dec 2006 21:04:38 +0000 (22:04 +0100)]
Adapted the file-test to use asio.
Martin Mares [Fri, 1 Dec 2006 20:36:22 +0000 (21:36 +0100)]
Simplified the asio module.
Pavel Charvat [Mon, 27 Nov 2006 23:50:00 +0000 (00:50 +0100)]
Merge with git+ssh://git.ucw.cz/projects/sherlock/GIT/sherlock.git#v3.10
Pavel Charvat [Mon, 27 Nov 2006 23:49:09 +0000 (00:49 +0100)]
fixed reading of big jpegs (serious today's bug)
Pavel Charvat [Mon, 27 Nov 2006 12:57:32 +0000 (13:57 +0100)]
Merge with git+ssh://git.ucw.cz/projects/sherlock/GIT/sherlock.git#v3.10
Pavel Charvat [Mon, 27 Nov 2006 12:41:33 +0000 (13:41 +0100)]
fixed deinterlacing of very small GIFs
Pavel Charvat [Mon, 27 Nov 2006 12:11:35 +0000 (13:11 +0100)]
typo
Pavel Charvat [Mon, 27 Nov 2006 12:08:59 +0000 (13:08 +0100)]
Merge with git+ssh://git.ucw.cz/projects/sherlock/GIT/sherlock.git#v3.10
Pavel Charvat [Mon, 27 Nov 2006 12:06:00 +0000 (13:06 +0100)]
according to libjpeg documentation fill_input_buffer should never return zero
Martin Mares [Sat, 25 Nov 2006 22:35:55 +0000 (23:35 +0100)]
Implemented an asynchronous I/O library module.
It's built at the top of the work queue module.
Pavel Charvat [Sat, 25 Nov 2006 21:14:31 +0000 (22:14 +0100)]
ignore libjpeg warnings
Pavel Charvat [Sat, 25 Nov 2006 21:11:15 +0000 (22:11 +0100)]
64bit bug in image signatures
Martin Mares [Sat, 25 Nov 2006 21:10:14 +0000 (22:10 +0100)]
Added a library module for distributing work between threads.
However, I am not sure that libucw is the right place for this, since
it would require all programs to be linked with libpthread as well.
Pavel Charvat [Fri, 24 Nov 2006 23:31:25 +0000 (00:31 +0100)]
fixed segfaulting libjpeg warnings when decoding partially wrong images...
now we reject such images, but it can be easily changed in ifdef
Martin Mares [Fri, 24 Nov 2006 20:32:17 +0000 (21:32 +0100)]
The first idea of an async I/O interface.
Martin Mares [Fri, 24 Nov 2006 18:52:58 +0000 (19:52 +0100)]
More benchmark results.
Martin Mares [Fri, 24 Nov 2006 18:07:03 +0000 (19:07 +0100)]
Much better parallel copy benchmark.
Martin Mares [Fri, 24 Nov 2006 15:30:01 +0000 (16:30 +0100)]
Updated the sorter usage map.
Martin Mares [Fri, 24 Nov 2006 00:04:31 +0000 (01:04 +0100)]
Improved the file benchmark slightly.
Martin Mares [Thu, 23 Nov 2006 23:33:24 +0000 (00:33 +0100)]
Added a simple experiment with parallel reads/writes.
Martin Mares [Thu, 23 Nov 2006 23:22:11 +0000 (00:22 +0100)]
Use big_alloc().
Martin Mares [Thu, 23 Nov 2006 23:18:08 +0000 (00:18 +0100)]
Added a couple of notes.
Martin Mares [Thu, 23 Nov 2006 23:17:17 +0000 (00:17 +0100)]
Added big_alloc() for allocating large, page-aligned buffers.
Martin Mares [Thu, 23 Nov 2006 18:06:26 +0000 (19:06 +0100)]
Moved tests related to the sorter to debug/sorter/.
Pavel Charvat [Sat, 11 Nov 2006 20:11:11 +0000 (21:11 +0100)]
partial YCCK colorspace support
Pavel Charvat [Mon, 6 Nov 2006 11:29:11 +0000 (12:29 +0100)]
fixed Bug 3188 - libimages supports shared libraries;
it depends on libsh only with CONFIG_SHERLOCK
Pavel Charvat [Mon, 6 Nov 2006 10:34:38 +0000 (11:34 +0100)]
hacked libimages tests dependencies
Pavel Charvat [Mon, 6 Nov 2006 09:52:49 +0000 (10:52 +0100)]
fixed color.test compilation
Martin Mares [Fri, 3 Nov 2006 19:41:28 +0000 (20:41 +0100)]
Moved the update hook script to a separate repository.
Pavel Charvat [Thu, 2 Nov 2006 23:06:50 +0000 (00:06 +0100)]
added support for some color conversions; we should be able to load cmyk
jpegs now...
Pavel Charvat [Wed, 1 Nov 2006 13:52:57 +0000 (14:52 +0100)]
image-tool uses RGB automatically when converting non-RGB jpegs
to gif/png
Pavel Charvat [Wed, 1 Nov 2006 13:38:11 +0000 (14:38 +0100)]
slightly changed dealing with color spaces
(I will add CMYK -> RGB conversion soon ... bug #2819)
Robert Spalek [Sat, 28 Oct 2006 01:20:44 +0000 (18:20 -0700)]
enable dynamic linking on Darwin
Robert Spalek [Sat, 28 Oct 2006 00:54:26 +0000 (17:54 -0700)]
auto-detect CONFIG_LFS
Robert Spalek [Fri, 27 Oct 2006 03:51:43 +0000 (20:51 -0700)]
make the Perl Ulimit module compilable on Darwin
Robert Spalek [Fri, 27 Oct 2006 03:10:36 +0000 (20:10 -0700)]
update the code so that it compiles both on Linux and Darwin
Robert Spalek [Fri, 27 Oct 2006 03:08:09 +0000 (20:08 -0700)]
fdatasync is not supported on Darwin ===> work-around
Robert Spalek [Fri, 27 Oct 2006 03:05:16 +0000 (20:05 -0700)]
added a wrapper for POSIX semaphores that works also on Darwin
Robert Spalek [Fri, 27 Oct 2006 03:03:32 +0000 (20:03 -0700)]
separate the support of large files from using LFS versions of file functions
Robert Spalek [Thu, 26 Oct 2006 01:56:57 +0000 (18:56 -0700)]
ALIGN renamed to ALIGN_TO
Pavel Charvat [Sun, 22 Oct 2006 14:45:49 +0000 (16:45 +0200)]
fixed forgotten text :)
Pavel Charvat [Thu, 19 Oct 2006 08:34:16 +0000 (10:34 +0200)]
Completed merge with dev-img branch.
- libimages library
- gatherer uses libimages instead of GraphicsMagick
- added indexation of image signatures and support
for similar images to search server (IMAGESIM)
- CZ indexation split to text and images
- ... and more small changes
Pavel Charvat [Thu, 19 Oct 2006 08:13:19 +0000 (10:13 +0200)]
Partial merge with dev-img - added libimages.
Pavel Charvat [Wed, 18 Oct 2006 13:14:16 +0000 (15:14 +0200)]
rewriting PL timetables... incomplete
Martin Mares [Fri, 13 Oct 2006 09:40:04 +0000 (11:40 +0200)]
Merge with git+ssh://cvs.ucw.cz/projects/sherlock/GIT/sherlock.git
Martin Mares [Fri, 13 Oct 2006 09:28:59 +0000 (11:28 +0200)]
stk_printf() has been fixed.
Pavel Charvat [Thu, 12 Oct 2006 14:59:36 +0000 (16:59 +0200)]
genconfig can include program's output (should be deterministic)
Robert Spalek [Mon, 9 Oct 2006 17:56:06 +0000 (19:56 +0200)]
conf: improve the format of the error message issued on invalid -S setting
Pavel Charvat [Mon, 9 Oct 2006 08:21:56 +0000 (10:21 +0200)]
thread-safe stk_printf
Martin Mares [Thu, 5 Oct 2006 17:41:56 +0000 (19:41 +0200)]
Replaced the SORTER_DECLARE_ONLY hack by lib/sorter-globals.h.
Martin Mares [Tue, 26 Sep 2006 14:00:16 +0000 (16:00 +0200)]
Define NO_INLINE, which can be helpful when profiling.
Martin Mares [Fri, 22 Sep 2006 19:15:23 +0000 (21:15 +0200)]
Merge with git+ssh://cvs.ucw.cz/projects/sherlock/GIT/sherlock.git
Martin Mares [Fri, 22 Sep 2006 14:38:06 +0000 (16:38 +0200)]
A better comments on character set names.
Pavel Charvat [Fri, 22 Sep 2006 14:33:10 +0000 (16:33 +0200)]
note that we use RCF names for supported charsets
Martin Mares [Wed, 20 Sep 2006 14:35:12 +0000 (16:35 +0200)]
Documented thread safety of ucwlib functions.
Pavel Charvat [Mon, 18 Sep 2006 10:03:56 +0000 (12:03 +0200)]
Merge with git+ssh://git.ucw.cz/projects/sherlock/GIT/sherlock.git
Martin Mares [Fri, 15 Sep 2006 19:14:59 +0000 (21:14 +0200)]
Guard against calls of random_max() with too large range.
Martin Mares [Fri, 15 Sep 2006 19:00:12 +0000 (21:00 +0200)]
Added random_u64() and random_max_u64().
Martin Mares [Thu, 14 Sep 2006 11:44:04 +0000 (13:44 +0200)]
Avoid unnecessary include of bbuf.h in fastbuf.h.