]> mj.ucw.cz Git - libucw.git/log
libucw.git
17 years agosize_t != uns
Pavel Charvat [Mon, 11 Dec 2006 20:26:07 +0000 (21:26 +0100)]
size_t != uns

17 years agoFixed thread safety of signal handling.
Martin Mares [Sat, 9 Dec 2006 22:24:44 +0000 (23:24 +0100)]
Fixed thread safety of signal handling.

Signals delivery is generally not deterministic in multi-threaded programs,
but SIGSEGV is always sent by the kernel to the thread which caused the fault.

Replaced the global signal handler array by a pointer in the per-thread
context and replaced saving of original handles (which was wrong even in
some non-threaded cases) by locked use counters.

Also moved logging of the SIGSEGV error message out of the signal handler
to be sure there are no clashes.

When libucw is compiled without threading, everything is nearly as simple
as before, because the thread context struct is static and all locks
disappear.

17 years agoLogging functions are thread-safe.
Martin Mares [Sat, 9 Dec 2006 21:39:36 +0000 (22:39 +0100)]
Logging functions are thread-safe.

17 years agoUse Threads.DefaultStackSize instead of various local stack sizes.
Martin Mares [Sat, 9 Dec 2006 21:16:51 +0000 (22:16 +0100)]
Use Threads.DefaultStackSize instead of various local stack sizes.

17 years agoConfigure default thread stack size globally.
Martin Mares [Sat, 9 Dec 2006 21:10:45 +0000 (22:10 +0100)]
Configure default thread stack size globally.

17 years agoUse the generic thread context to hold per-thread I/O queue.
Martin Mares [Sat, 9 Dec 2006 21:00:38 +0000 (22:00 +0100)]
Use the generic thread context to hold per-thread I/O queue.

17 years agoConverted asio to use the global ucwlib lock.
Martin Mares [Sat, 9 Dec 2006 20:58:13 +0000 (21:58 +0100)]
Converted asio to use the global ucwlib lock.

17 years agoConverted the fb-temp module to use threads.h.
Martin Mares [Sat, 9 Dec 2006 20:57:04 +0000 (21:57 +0100)]
Converted the fb-temp module to use threads.h.

17 years agoAdded a simple threading helper module.
Martin Mares [Sat, 9 Dec 2006 20:55:02 +0000 (21:55 +0100)]
Added a simple threading helper module.

17 years agoRemove extra dependencies on -lpthread.
Martin Mares [Sat, 9 Dec 2006 19:12:57 +0000 (20:12 +0100)]
Remove extra dependencies on -lpthread.

17 years agofb-direct: Implemented temporary files.
Martin Mares [Sat, 9 Dec 2006 19:02:48 +0000 (20:02 +0100)]
fb-direct: Implemented temporary files.

17 years agoDon't forget to build fb-direct.
Martin Mares [Sat, 9 Dec 2006 19:02:33 +0000 (20:02 +0100)]
Don't forget to build fb-direct.

17 years agofb-direct: Name-space cleanup.
Martin Mares [Sat, 9 Dec 2006 19:01:12 +0000 (20:01 +0100)]
fb-direct: Name-space cleanup.

17 years agoCreation of temporary files is now thread-safe (ugh).
Martin Mares [Sat, 9 Dec 2006 19:00:46 +0000 (20:00 +0100)]
Creation of temporary files is now thread-safe (ugh).

17 years agoAdded a direct I/O fastbuf backend.
Martin Mares [Sat, 9 Dec 2006 18:48:39 +0000 (19:48 +0100)]
Added a direct I/O fastbuf backend.

17 years agoAdded CONFIG_UCW_THREADS.
Martin Mares [Sat, 9 Dec 2006 18:47:24 +0000 (19:47 +0100)]
Added CONFIG_UCW_THREADS.

Finally decided that we need threading support in too many libucw modules,
so the only sane thing is to link all programs with -lpthread. On the other
hand, I would like to keep the possibility of building non-threaded libucw,
so I've introduced a new config switch, which is always set for Sherlock.

17 years agoasio: Put a lock around maintenance of use-counts.
Martin Mares [Sat, 9 Dec 2006 18:28:02 +0000 (19:28 +0100)]
asio: Put a lock around maintenance of use-counts.

I want to allow threads creating their own asio queues asynchronously.

17 years agoasio: Add a couple of user-defined fields.
Martin Mares [Sat, 9 Dec 2006 18:27:14 +0000 (19:27 +0100)]
asio: Add a couple of user-defined fields.

17 years agofb-file: A couple of trivial cleanups.
Martin Mares [Sat, 9 Dec 2006 18:26:58 +0000 (19:26 +0100)]
fb-file: A couple of trivial cleanups.

17 years agoMerge with git+ssh://cvs.ucw.cz/projects/sherlock/GIT/sherlock.git
Martin Mares [Fri, 8 Dec 2006 17:09:22 +0000 (18:09 +0100)]
Merge with git+ssh://cvs.ucw.cz/projects/sherlock/GIT/sherlock.git

17 years agoMerge with git+ssh://cvs.ucw.cz/projects/sherlock/GIT/sherlock.git#v3.10
Martin Mares [Fri, 8 Dec 2006 17:09:08 +0000 (18:09 +0100)]
Merge with git+ssh://cvs.ucw.cz/projects/sherlock/GIT/sherlock.git#v3.10

(centrum/cz/{cf/local,config} merged manually)

17 years agoworkqueue: Added non-blocking wait functions.
Martin Mares [Fri, 8 Dec 2006 16:47:16 +0000 (17:47 +0100)]
workqueue: Added non-blocking wait functions.

17 years agoCONFIG_INSTALL_API installs libimages headers
Pavel Charvat [Fri, 8 Dec 2006 16:44:59 +0000 (17:44 +0100)]
CONFIG_INSTALL_API installs libimages headers

17 years agoMerge with git+ssh://cvs.ucw.cz/projects/sherlock/GIT/sherlock.git
Martin Mares [Mon, 4 Dec 2006 12:35:24 +0000 (13:35 +0100)]
Merge with git+ssh://cvs.ucw.cz/projects/sherlock/GIT/sherlock.git

17 years agoBenchmark of the new asio-test.
Martin Mares [Fri, 1 Dec 2006 23:00:55 +0000 (00:00 +0100)]
Benchmark of the new asio-test.

17 years agoA more realistic asio-test, which uses memcpy().
Martin Mares [Fri, 1 Dec 2006 23:00:36 +0000 (00:00 +0100)]
A more realistic asio-test, which uses memcpy().

17 years agoMerge with git+ssh://cvs.ucw.cz/projects/sherlock/GIT/sherlock.git#dev-sorter
Martin Mares [Fri, 1 Dec 2006 22:25:28 +0000 (23:25 +0100)]
Merge with git+ssh://cvs.ucw.cz/projects/sherlock/GIT/sherlock.git#dev-sorter

17 years agoAdded a couple of ASSERTs more.
Martin Mares [Fri, 1 Dec 2006 22:25:22 +0000 (23:25 +0100)]
Added a couple of ASSERTs more.

17 years agoAdded new benchmarks.
Martin Mares [Fri, 1 Dec 2006 21:52:32 +0000 (22:52 +0100)]
Added new benchmarks.

asio-test turned out to be significantly faster when writing and
slightly faster when copying or reading. Good.

17 years agoAdapted the file-test to use asio.
Martin Mares [Fri, 1 Dec 2006 21:04:38 +0000 (22:04 +0100)]
Adapted the file-test to use asio.

17 years agoSimplified the asio module.
Martin Mares [Fri, 1 Dec 2006 20:36:22 +0000 (21:36 +0100)]
Simplified the asio module.

17 years agoMerge with git+ssh://git.ucw.cz/projects/sherlock/GIT/sherlock.git#v3.10
Pavel Charvat [Mon, 27 Nov 2006 23:50:00 +0000 (00:50 +0100)]
Merge with git+ssh://git.ucw.cz/projects/sherlock/GIT/sherlock.git#v3.10

17 years agofixed reading of big jpegs (serious today's bug)
Pavel Charvat [Mon, 27 Nov 2006 23:49:09 +0000 (00:49 +0100)]
fixed reading of big jpegs (serious today's bug)

17 years agoMerge with git+ssh://git.ucw.cz/projects/sherlock/GIT/sherlock.git#v3.10
Pavel Charvat [Mon, 27 Nov 2006 12:57:32 +0000 (13:57 +0100)]
Merge with git+ssh://git.ucw.cz/projects/sherlock/GIT/sherlock.git#v3.10

17 years agofixed deinterlacing of very small GIFs
Pavel Charvat [Mon, 27 Nov 2006 12:41:33 +0000 (13:41 +0100)]
fixed deinterlacing of very small GIFs

17 years agotypo
Pavel Charvat [Mon, 27 Nov 2006 12:11:35 +0000 (13:11 +0100)]
typo

17 years agoMerge with git+ssh://git.ucw.cz/projects/sherlock/GIT/sherlock.git#v3.10
Pavel Charvat [Mon, 27 Nov 2006 12:08:59 +0000 (13:08 +0100)]
Merge with git+ssh://git.ucw.cz/projects/sherlock/GIT/sherlock.git#v3.10

17 years agoaccording to libjpeg documentation fill_input_buffer should never return zero
Pavel Charvat [Mon, 27 Nov 2006 12:06:00 +0000 (13:06 +0100)]
according to libjpeg documentation fill_input_buffer should never return zero

17 years agoImplemented an asynchronous I/O library module.
Martin Mares [Sat, 25 Nov 2006 22:35:55 +0000 (23:35 +0100)]
Implemented an asynchronous I/O library module.

It's built at the top of the work queue module.

17 years agoignore libjpeg warnings
Pavel Charvat [Sat, 25 Nov 2006 21:14:31 +0000 (22:14 +0100)]
ignore libjpeg warnings

17 years ago64bit bug in image signatures
Pavel Charvat [Sat, 25 Nov 2006 21:11:15 +0000 (22:11 +0100)]
64bit bug in image signatures

17 years agoAdded a library module for distributing work between threads.
Martin Mares [Sat, 25 Nov 2006 21:10:14 +0000 (22:10 +0100)]
Added a library module for distributing work between threads.

However, I am not sure that libucw is the right place for this, since
it would require all programs to be linked with libpthread as well.

17 years agofixed segfaulting libjpeg warnings when decoding partially wrong images...
Pavel Charvat [Fri, 24 Nov 2006 23:31:25 +0000 (00:31 +0100)]
fixed segfaulting libjpeg warnings when decoding partially wrong images...
now we reject such images, but it can be easily changed in ifdef

17 years agoThe first idea of an async I/O interface.
Martin Mares [Fri, 24 Nov 2006 20:32:17 +0000 (21:32 +0100)]
The first idea of an async I/O interface.

17 years agoMore benchmark results.
Martin Mares [Fri, 24 Nov 2006 18:52:58 +0000 (19:52 +0100)]
More benchmark results.

17 years agoMuch better parallel copy benchmark.
Martin Mares [Fri, 24 Nov 2006 18:07:03 +0000 (19:07 +0100)]
Much better parallel copy benchmark.

17 years agoUpdated the sorter usage map.
Martin Mares [Fri, 24 Nov 2006 15:30:01 +0000 (16:30 +0100)]
Updated the sorter usage map.

17 years agoImproved the file benchmark slightly.
Martin Mares [Fri, 24 Nov 2006 00:04:31 +0000 (01:04 +0100)]
Improved the file benchmark slightly.

17 years agoAdded a simple experiment with parallel reads/writes.
Martin Mares [Thu, 23 Nov 2006 23:33:24 +0000 (00:33 +0100)]
Added a simple experiment with parallel reads/writes.

17 years agoUse big_alloc().
Martin Mares [Thu, 23 Nov 2006 23:22:11 +0000 (00:22 +0100)]
Use big_alloc().

17 years agoAdded a couple of notes.
Martin Mares [Thu, 23 Nov 2006 23:18:08 +0000 (00:18 +0100)]
Added a couple of notes.

17 years agoAdded big_alloc() for allocating large, page-aligned buffers.
Martin Mares [Thu, 23 Nov 2006 23:17:17 +0000 (00:17 +0100)]
Added big_alloc() for allocating large, page-aligned buffers.

17 years agoMoved tests related to the sorter to debug/sorter/.
Martin Mares [Thu, 23 Nov 2006 18:06:26 +0000 (19:06 +0100)]
Moved tests related to the sorter to debug/sorter/.

17 years agopartial YCCK colorspace support
Pavel Charvat [Sat, 11 Nov 2006 20:11:11 +0000 (21:11 +0100)]
partial YCCK colorspace support

17 years agofixed Bug 3188 - libimages supports shared libraries;
Pavel Charvat [Mon, 6 Nov 2006 11:29:11 +0000 (12:29 +0100)]
fixed Bug 3188 - libimages supports shared libraries;
it depends on libsh only with CONFIG_SHERLOCK

17 years agohacked libimages tests dependencies
Pavel Charvat [Mon, 6 Nov 2006 10:34:38 +0000 (11:34 +0100)]
hacked libimages tests dependencies

17 years agofixed color.test compilation
Pavel Charvat [Mon, 6 Nov 2006 09:52:49 +0000 (10:52 +0100)]
fixed color.test compilation

17 years agoMoved the update hook script to a separate repository.
Martin Mares [Fri, 3 Nov 2006 19:41:28 +0000 (20:41 +0100)]
Moved the update hook script to a separate repository.

17 years agoadded support for some color conversions; we should be able to load cmyk
Pavel Charvat [Thu, 2 Nov 2006 23:06:50 +0000 (00:06 +0100)]
added support for some color conversions; we should be able to load cmyk
jpegs now...

17 years agoimage-tool uses RGB automatically when converting non-RGB jpegs
Pavel Charvat [Wed, 1 Nov 2006 13:52:57 +0000 (14:52 +0100)]
image-tool uses RGB automatically when converting non-RGB jpegs
to gif/png

17 years agoslightly changed dealing with color spaces
Pavel Charvat [Wed, 1 Nov 2006 13:38:11 +0000 (14:38 +0100)]
slightly changed dealing with color spaces
(I will add CMYK -> RGB conversion soon ... bug #2819)

17 years agoenable dynamic linking on Darwin
Robert Spalek [Sat, 28 Oct 2006 01:20:44 +0000 (18:20 -0700)]
enable dynamic linking on Darwin

17 years agoauto-detect CONFIG_LFS
Robert Spalek [Sat, 28 Oct 2006 00:54:26 +0000 (17:54 -0700)]
auto-detect CONFIG_LFS

17 years agomake the Perl Ulimit module compilable on Darwin
Robert Spalek [Fri, 27 Oct 2006 03:51:43 +0000 (20:51 -0700)]
make the Perl Ulimit module compilable on Darwin

17 years agoupdate the code so that it compiles both on Linux and Darwin
Robert Spalek [Fri, 27 Oct 2006 03:10:36 +0000 (20:10 -0700)]
update the code so that it compiles both on Linux and Darwin

17 years agofdatasync is not supported on Darwin ===> work-around
Robert Spalek [Fri, 27 Oct 2006 03:08:09 +0000 (20:08 -0700)]
fdatasync is not supported on Darwin ===> work-around

17 years agoadded a wrapper for POSIX semaphores that works also on Darwin
Robert Spalek [Fri, 27 Oct 2006 03:05:16 +0000 (20:05 -0700)]
added a wrapper for POSIX semaphores that works also on Darwin

17 years agoseparate the support of large files from using LFS versions of file functions
Robert Spalek [Fri, 27 Oct 2006 03:03:32 +0000 (20:03 -0700)]
separate the support of large files from using LFS versions of file functions

17 years agoALIGN renamed to ALIGN_TO
Robert Spalek [Thu, 26 Oct 2006 01:56:57 +0000 (18:56 -0700)]
ALIGN renamed to ALIGN_TO

17 years agofixed forgotten text :)
Pavel Charvat [Sun, 22 Oct 2006 14:45:49 +0000 (16:45 +0200)]
fixed forgotten text :)

17 years agoCompleted merge with dev-img branch.
Pavel Charvat [Thu, 19 Oct 2006 08:34:16 +0000 (10:34 +0200)]
Completed merge with dev-img branch.

- libimages library
- gatherer uses libimages instead of GraphicsMagick
- added indexation of image signatures and support
  for similar images to search server (IMAGESIM)
- CZ indexation split to text and images
- ... and more small changes

17 years agoPartial merge with dev-img - added libimages.
Pavel Charvat [Thu, 19 Oct 2006 08:13:19 +0000 (10:13 +0200)]
Partial merge with dev-img - added libimages.

17 years agorewriting PL timetables... incomplete
Pavel Charvat [Wed, 18 Oct 2006 13:14:16 +0000 (15:14 +0200)]
rewriting PL timetables... incomplete

17 years agoMerge with git+ssh://cvs.ucw.cz/projects/sherlock/GIT/sherlock.git
Martin Mares [Fri, 13 Oct 2006 09:40:04 +0000 (11:40 +0200)]
Merge with git+ssh://cvs.ucw.cz/projects/sherlock/GIT/sherlock.git

17 years agostk_printf() has been fixed.
Martin Mares [Fri, 13 Oct 2006 09:28:59 +0000 (11:28 +0200)]
stk_printf() has been fixed.

17 years agogenconfig can include program's output (should be deterministic)
Pavel Charvat [Thu, 12 Oct 2006 14:59:36 +0000 (16:59 +0200)]
genconfig can include program's output (should be deterministic)

17 years agoconf: improve the format of the error message issued on invalid -S setting
Robert Spalek [Mon, 9 Oct 2006 17:56:06 +0000 (19:56 +0200)]
conf: improve the format of the error message issued on invalid -S setting

17 years agothread-safe stk_printf
Pavel Charvat [Mon, 9 Oct 2006 08:21:56 +0000 (10:21 +0200)]
thread-safe stk_printf

17 years agoReplaced the SORTER_DECLARE_ONLY hack by lib/sorter-globals.h.
Martin Mares [Thu, 5 Oct 2006 17:41:56 +0000 (19:41 +0200)]
Replaced the SORTER_DECLARE_ONLY hack by lib/sorter-globals.h.

17 years agoDefine NO_INLINE, which can be helpful when profiling.
Martin Mares [Tue, 26 Sep 2006 14:00:16 +0000 (16:00 +0200)]
Define NO_INLINE, which can be helpful when profiling.

17 years agoMerge with git+ssh://cvs.ucw.cz/projects/sherlock/GIT/sherlock.git
Martin Mares [Fri, 22 Sep 2006 19:15:23 +0000 (21:15 +0200)]
Merge with git+ssh://cvs.ucw.cz/projects/sherlock/GIT/sherlock.git

17 years agoA better comments on character set names.
Martin Mares [Fri, 22 Sep 2006 14:38:06 +0000 (16:38 +0200)]
A better comments on character set names.

17 years agonote that we use RCF names for supported charsets
Pavel Charvat [Fri, 22 Sep 2006 14:33:10 +0000 (16:33 +0200)]
note that we use RCF names for supported charsets

17 years agoDocumented thread safety of ucwlib functions.
Martin Mares [Wed, 20 Sep 2006 14:35:12 +0000 (16:35 +0200)]
Documented thread safety of ucwlib functions.

17 years agoMerge with git+ssh://git.ucw.cz/projects/sherlock/GIT/sherlock.git
Pavel Charvat [Mon, 18 Sep 2006 10:03:56 +0000 (12:03 +0200)]
Merge with git+ssh://git.ucw.cz/projects/sherlock/GIT/sherlock.git

17 years agoGuard against calls of random_max() with too large range.
Martin Mares [Fri, 15 Sep 2006 19:14:59 +0000 (21:14 +0200)]
Guard against calls of random_max() with too large range.

17 years agoAdded random_u64() and random_max_u64().
Martin Mares [Fri, 15 Sep 2006 19:00:12 +0000 (21:00 +0200)]
Added random_u64() and random_max_u64().

17 years agoAvoid unnecessary include of bbuf.h in fastbuf.h.
Martin Mares [Thu, 14 Sep 2006 11:44:04 +0000 (13:44 +0200)]
Avoid unnecessary include of bbuf.h in fastbuf.h.

17 years agoDefine the buffer type as both a typedef and a structure.
Martin Mares [Thu, 14 Sep 2006 11:43:49 +0000 (13:43 +0200)]
Define the buffer type as both a typedef and a structure.

17 years agoImplemented the atomic fastbuf backend.
Martin Mares [Thu, 14 Sep 2006 11:39:30 +0000 (13:39 +0200)]
Implemented the atomic fastbuf backend.

17 years agoAtomic fastbufs: the first sketch of the interface.
Martin Mares [Wed, 13 Sep 2006 19:38:05 +0000 (21:38 +0200)]
Atomic fastbufs: the first sketch of the interface.

17 years agoAdded ALWAYS_INLINE.
Martin Mares [Wed, 13 Sep 2006 18:03:34 +0000 (20:03 +0200)]
Added ALWAYS_INLINE.

17 years agoHide the TAGS file from the prying eyes of GIT.
Martin Mares [Mon, 11 Sep 2006 19:23:53 +0000 (21:23 +0200)]
Hide the TAGS file from the prying eyes of GIT.

17 years agoOops, a typo.
Martin Mares [Mon, 11 Sep 2006 19:11:42 +0000 (21:11 +0200)]
Oops, a typo.

17 years agoEnable prefetching on some more CPU's.
Martin Mares [Mon, 11 Sep 2006 19:05:16 +0000 (21:05 +0200)]
Enable prefetching on some more CPU's.

17 years agoAdded automatic configuration for Prescott, Nocona, Pentium-M and amd64 CPU's.
Martin Mares [Mon, 11 Sep 2006 19:04:48 +0000 (21:04 +0200)]
Added automatic configuration for Prescott, Nocona, Pentium-M and amd64 CPU's.

17 years agoMerge with git+ssh://cvs.ucw.cz/projects/sherlock/GIT/sherlock.git
Pavel Charvat [Sun, 10 Sep 2006 20:28:29 +0000 (22:28 +0200)]
Merge with git+ssh://cvs.ucw.cz/projects/sherlock/GIT/sherlock.git

17 years agoSmall customizations moved do a new directory:
Pavel Charvat [Sun, 10 Sep 2006 20:28:18 +0000 (22:28 +0200)]
Small customizations moved do a new directory:
  bare -> customs/bare
  lib/config -> customs/libsonly

17 years agoMerge with git+ssh://cvs.ucw.cz/projects/sherlock/GIT/sherlock.git
Martin Mares [Sun, 10 Sep 2006 20:13:42 +0000 (22:13 +0200)]
Merge with git+ssh://cvs.ucw.cz/projects/sherlock/GIT/sherlock.git

Also cherry-picked some bits of dev-slices.

17 years agoAdded sh_fstat.
Martin Mares [Sat, 9 Sep 2006 19:56:10 +0000 (21:56 +0200)]
Added sh_fstat.