]> mj.ucw.cz Git - libucw.git/log
libucw.git
19 years agoMore work on the caching module: added some debugging messages,
Martin Mares [Mon, 7 Mar 2005 14:01:49 +0000 (14:01 +0000)]
More work on the caching module: added some debugging messages,
moved next block pointers to a separate area.

19 years agoWrote the cache module, not debugged yet.
Martin Mares [Mon, 7 Mar 2005 00:10:50 +0000 (00:10 +0000)]
Wrote the cache module, not debugged yet.

19 years agoFirst steps towards a universal shared memory cache, which will be used
Martin Mares [Sun, 6 Mar 2005 12:26:13 +0000 (12:26 +0000)]
First steps towards a universal shared memory cache, which will be used
in the multiplexer and later probably also in the search server.

19 years agoWarn on mistyped arguments to stk_printf().
Martin Mares [Fri, 4 Mar 2005 21:46:58 +0000 (21:46 +0000)]
Warn on mistyped arguments to stk_printf().

19 years agoMainloop timers are now measured in milliseconds. Will be used by shep-reap one day.
Martin Mares [Fri, 4 Mar 2005 17:09:57 +0000 (17:09 +0000)]
Mainloop timers are now measured in milliseconds. Will be used by shep-reap one day.

19 years agoAvoid "cast of pointer to a smaller integer type" warnings.
Martin Mares [Thu, 3 Mar 2005 19:40:51 +0000 (19:40 +0000)]
Avoid "cast of pointer to a smaller integer type" warnings.

19 years agoIf previous check-customs run failed, run/cf could be empty.
Martin Mares [Wed, 2 Mar 2005 22:24:35 +0000 (22:24 +0000)]
If previous check-customs run failed, run/cf could be empty.

19 years agoFixed building of shared library config,
Martin Mares [Wed, 2 Mar 2005 22:13:08 +0000 (22:13 +0000)]
Fixed building of shared library config,

19 years agoFix incorrect pointer casts.
Martin Mares [Wed, 2 Mar 2005 21:48:47 +0000 (21:48 +0000)]
Fix incorrect pointer casts.

19 years agoBuild full debugging config with shared libraries as well.
Martin Mares [Wed, 2 Mar 2005 21:48:22 +0000 (21:48 +0000)]
Build full debugging config with shared libraries as well.

19 years agotypo fixed
Robert Spalek [Mon, 21 Feb 2005 12:00:21 +0000 (12:00 +0000)]
typo fixed

19 years agoshup up, gcc
Robert Spalek [Sun, 20 Feb 2005 15:57:33 +0000 (15:57 +0000)]
shup up, gcc

19 years agofixed library dependencies
Robert Spalek [Sun, 20 Feb 2005 13:32:06 +0000 (13:32 +0000)]
fixed library dependencies

19 years agocomparison of signed and unsigned encountered without CONFIG_LFS
Robert Spalek [Sat, 19 Feb 2005 22:23:38 +0000 (22:23 +0000)]
comparison of signed and unsigned encountered without CONFIG_LFS

19 years agoAdded clist walking macros with embedded C99 declaration of the iterator
Martin Mares [Sat, 19 Feb 2005 17:11:25 +0000 (17:11 +0000)]
Added clist walking macros with embedded C99 declaration of the iterator
variable.

19 years agoadded yet another utility for processing cvs logs
Robert Spalek [Fri, 18 Feb 2005 16:29:12 +0000 (16:29 +0000)]
added yet another utility for processing cvs logs

19 years agoadded th2
Robert Spalek [Fri, 18 Feb 2005 16:11:28 +0000 (16:11 +0000)]
added th2

19 years agoIf requested by config.mk, install all libraries and their include
Martin Mares [Wed, 16 Feb 2005 17:08:39 +0000 (17:08 +0000)]
If requested by config.mk, install all libraries and their include
files for use by external programs.

I don't expect this mechanism to be used in Sherlock itself, but I need
to use it in a couple of other projects (including Lestrade) and I want
to keep the things consistent.

19 years agoClarified a comment.
Martin Mares [Tue, 15 Feb 2005 17:37:28 +0000 (17:37 +0000)]
Clarified a comment.

19 years agoA better comment.
Martin Mares [Sun, 13 Feb 2005 10:58:52 +0000 (10:58 +0000)]
A better comment.

19 years agoOops, a nasty bug has crept in.
Martin Mares [Thu, 10 Feb 2005 22:31:31 +0000 (22:31 +0000)]
Oops, a nasty bug has crept in.

19 years agoAdded overflow-safe string functions allocating everything on the stack.
Martin Mares [Thu, 10 Feb 2005 22:30:59 +0000 (22:30 +0000)]
Added overflow-safe string functions allocating everything on the stack.
Actually, they are all macros, but passing parameters with side-effects
should be safe, because they are always evaluated exactly once.

19 years agoAdded tests for the mempool string functions.
Martin Mares [Thu, 10 Feb 2005 22:00:31 +0000 (22:00 +0000)]
Added tests for the mempool string functions.

19 years agoAdded printf-like function with output to mempool.
Martin Mares [Thu, 10 Feb 2005 21:57:17 +0000 (21:57 +0000)]
Added printf-like function with output to mempool.

19 years agoAdded fb_wrap_charconv_in().
Martin Mares [Mon, 31 Jan 2005 15:12:58 +0000 (15:12 +0000)]
Added fb_wrap_charconv_in().

19 years agoA minor optimization.
Martin Mares [Mon, 31 Jan 2005 15:12:39 +0000 (15:12 +0000)]
A minor optimization.

19 years agoDon't forget to undefine BUF_T.
Martin Mares [Fri, 28 Jan 2005 21:19:18 +0000 (21:19 +0000)]
Don't forget to undefine BUF_T.

19 years agoWrong alignment fixed.
Tomas Valla [Tue, 18 Jan 2005 15:45:31 +0000 (15:45 +0000)]
Wrong alignment fixed.

19 years agoWe should check the special case.
Tomas Valla [Tue, 18 Jan 2005 11:37:24 +0000 (11:37 +0000)]
We should check the special case.

19 years agouseful macro to align pointer p to size s
Tomas Valla [Mon, 17 Jan 2005 19:41:30 +0000 (19:41 +0000)]
useful macro to align pointer p to size s

19 years agoupdate the copyright; it's been quite a long time until I have found a use
Robert Spalek [Mon, 10 Jan 2005 16:32:37 +0000 (16:32 +0000)]
update the copyright; it's been quite a long time until I have found a use
for this module :))

19 years agoadded TREE_WANT_BOUNDARY for finding the first/last node
Robert Spalek [Mon, 10 Jan 2005 16:03:15 +0000 (16:03 +0000)]
added TREE_WANT_BOUNDARY for finding the first/last node

19 years agoAdded another debugging customization for testing of custom stats and matchers.
Martin Mares [Sun, 9 Jan 2005 16:36:12 +0000 (16:36 +0000)]
Added another debugging customization for testing of custom stats and matchers.

19 years agoFixed a nasty bug in partmap_map(). When called for an item spanning window
Martin Mares [Sat, 8 Jan 2005 21:34:22 +0000 (21:34 +0000)]
Fixed a nasty bug in partmap_map(). When called for an item spanning window
boundary, it miscalculated the memory address and returned the start of the
new window instead.

19 years agoAdded functions for single-character conversions between selected
Martin Mares [Fri, 7 Jan 2005 23:42:11 +0000 (23:42 +0000)]
Added functions for single-character conversions between selected
character sets and Unicode, with no interpolation.

19 years ago.cvsignore no longer needed here.
Martin Mares [Mon, 27 Dec 2004 13:04:22 +0000 (13:04 +0000)]
.cvsignore no longer needed here.

19 years agoResurrected CONFIG_LARGE_DB.
Martin Mares [Sat, 11 Dec 2004 13:22:50 +0000 (13:22 +0000)]
Resurrected CONFIG_LARGE_DB.

Large database format and LFS really should be different switches --
small DB combined with LFS gives a 4GB limit, small with no LFS gives
2GB limit.

CONFIG_LFS is now always on (it's supported by all current Linux libc's
and the performance penalty for using 64-bit sh_off_t is negligible),
CONFIG_LARGE_DB is controlled by config.mk.

19 years agoCompilation of Perl and Shell parts of libucw is optional.
Martin Mares [Sat, 11 Dec 2004 13:12:39 +0000 (13:12 +0000)]
Compilation of Perl and Shell parts of libucw is optional.

19 years agoAdjust comments in UCW Library modules.
Martin Mares [Sat, 11 Dec 2004 12:13:25 +0000 (12:13 +0000)]
Adjust comments in UCW Library modules.

19 years agoChanged all references to Sherlock Library by UCW Library.
Martin Mares [Sat, 11 Dec 2004 12:07:00 +0000 (12:07 +0000)]
Changed all references to Sherlock Library by UCW Library.

19 years agoSHERLOCK_HAVE_PREAD -> HAVE_PREAD.
Martin Mares [Sat, 11 Dec 2004 12:03:38 +0000 (12:03 +0000)]
SHERLOCK_HAVE_PREAD -> HAVE_PREAD.

19 years agoCONFIG_LFS has been removed, CONFIG_LARGE_DB got replaced by CONFIG_LARGE_FILES.
Martin Mares [Sat, 11 Dec 2004 12:01:05 +0000 (12:01 +0000)]
CONFIG_LFS has been removed, CONFIG_LARGE_DB got replaced by CONFIG_LARGE_FILES.

19 years agoMoved oid_t to sherlock.h.
Martin Mares [Sat, 11 Dec 2004 11:54:10 +0000 (11:54 +0000)]
Moved oid_t to sherlock.h.

19 years agoMoved the lizard-fb module to Sherlock library, because it's heavily
Martin Mares [Sat, 11 Dec 2004 11:51:35 +0000 (11:51 +0000)]
Moved the lizard-fb module to Sherlock library, because it's heavily
dependent on the bucket types. The rest of LiZaRd should better remain
in libucw, it's very useful outside Sherlock.

19 years agoConfigure libucw according to Sherlock config.
Martin Mares [Sat, 11 Dec 2004 11:44:19 +0000 (11:44 +0000)]
Configure libucw according to Sherlock config.

19 years agoMoved CGI.pm and Query.pm to Sherlock library.
Martin Mares [Sat, 11 Dec 2004 11:41:06 +0000 (11:41 +0000)]
Moved CGI.pm and Query.pm to Sherlock library.

19 years agoSplit library functions to libsh and libucw.
Martin Mares [Sat, 11 Dec 2004 11:30:41 +0000 (11:30 +0000)]
Split library functions to libsh and libucw.

19 years agoIntroduced `sherlock/config.mk' which contains non-customizable parts
Martin Mares [Sat, 11 Dec 2004 10:48:44 +0000 (10:48 +0000)]
Introduced `sherlock/config.mk' which contains non-customizable parts
of the configuration. Moved version and config file name there.

19 years agoMade DEFAULT_CONFIG optional.
Martin Mares [Sat, 11 Dec 2004 10:47:49 +0000 (10:47 +0000)]
Made DEFAULT_CONFIG optional.

19 years agofb-charconv now not closing wrapped stream, only flushing it
Tomas Holusa [Wed, 8 Dec 2004 10:44:14 +0000 (10:44 +0000)]
fb-charconv now not closing wrapped stream, only flushing it
updated all places, when used this wrapper and close wrapped stream manually

19 years agoA minor bug fix to the installer (when installing `dict/cs', `dict'
Martin Mares [Fri, 3 Dec 2004 21:07:35 +0000 (21:07 +0000)]
A minor bug fix to the installer (when installing `dict/cs', `dict'
needn't exist).

19 years agoAdded the `extras' target (initially empty) and INSTALL_RUNDIRS.
Martin Mares [Fri, 3 Dec 2004 20:52:22 +0000 (20:52 +0000)]
Added the `extras' target (initially empty) and INSTALL_RUNDIRS.
`lib' and `bin' are now handled as INSTALL_RUNDIRS.

19 years agoPartial inlining of bskip().
Martin Mares [Sat, 20 Nov 2004 15:14:39 +0000 (15:14 +0000)]
Partial inlining of bskip().

19 years agoIntroduced COMPARE_LT and COMPARE_GT for comparison functions for arraysort.
Martin Mares [Sat, 20 Nov 2004 12:55:12 +0000 (12:55 +0000)]
Introduced COMPARE_LT and COMPARE_GT for comparison functions for arraysort.

19 years agoIncrease CARD_POS_SHIFT on Centrum.
Martin Mares [Sat, 20 Nov 2004 11:38:06 +0000 (11:38 +0000)]
Increase CARD_POS_SHIFT on Centrum.

19 years agoIf "Run" is omitted from a test, keep the value from the previous test.
Martin Mares [Fri, 19 Nov 2004 22:30:12 +0000 (22:30 +0000)]
If "Run" is omitted from a test, keep the value from the previous test.

19 years agoenlarge MAX_ATTR_SIZE
Robert Spalek [Mon, 15 Nov 2004 16:38:34 +0000 (16:38 +0000)]
enlarge MAX_ATTR_SIZE

19 years agoMove all explicit extern declarations of logf() [which is apparently missing
Martin Mares [Sun, 14 Nov 2004 12:12:29 +0000 (12:12 +0000)]
Move all explicit extern declarations of logf() [which is apparently missing
from system includes while present in the library; does anybody know, why?]
to lib/math.h.

19 years agoUpdated test rules.
Martin Mares [Sun, 14 Nov 2004 11:57:25 +0000 (11:57 +0000)]
Updated test rules.

19 years agoAdded tests for the hash table module.
Martin Mares [Sun, 14 Nov 2004 11:57:07 +0000 (11:57 +0000)]
Added tests for the hash table module.

19 years agoAdded support for dynamically allocated hash tables. Closes Bug #250.
Martin Mares [Sun, 14 Nov 2004 11:56:42 +0000 (11:56 +0000)]
Added support for dynamically allocated hash tables. Closes Bug #250.

19 years agoFinally I decided to change the syntax of INDEX_VERSION to better distinguish
Martin Mares [Sun, 14 Nov 2004 11:54:27 +0000 (11:54 +0000)]
Finally I decided to change the syntax of INDEX_VERSION to better distinguish
between different customizations.

19 years agoCorrected INDEX_VERSION, documented the rules and added CUSTOM_INDEX_VERSION.
Martin Mares [Sun, 14 Nov 2004 11:45:15 +0000 (11:45 +0000)]
Corrected INDEX_VERSION, documented the rules and added CUSTOM_INDEX_VERSION.

20 years agoif SORT_PRESORT and SORT_UP_TO are both on, compute the initial number of
Robert Spalek [Tue, 9 Nov 2004 17:48:52 +0000 (17:48 +0000)]
if SORT_PRESORT and SORT_UP_TO are both on, compute the initial number of
runs properly so that we do not run a superfluous pass of sorting

20 years agojust a bit more funny initialization for the SORT_UP_TO loop
Robert Spalek [Tue, 9 Nov 2004 15:46:39 +0000 (15:46 +0000)]
just a bit more funny initialization for the SORT_UP_TO loop

20 years agoactually, the number of runs is halved during each pass, so take it into
Robert Spalek [Tue, 9 Nov 2004 15:39:39 +0000 (15:39 +0000)]
actually, the number of runs is halved during each pass, so take it into
account in the stopping condition

20 years agoFixed a bug in parsing of replies -- the parse tree of each card was trimmed
Martin Mares [Tue, 9 Nov 2004 14:09:00 +0000 (14:09 +0000)]
Fixed a bug in parsing of replies -- the parse tree of each card was trimmed
at the first ")". Affected only the free front-end.

20 years agobfilesize() returns sh_off_t
Robert Spalek [Tue, 9 Nov 2004 13:16:20 +0000 (13:16 +0000)]
bfilesize() returns sh_off_t

20 years agoSORT_ONLY_PRESORT feature improved into SORT_UP_TO (stop when average run
Robert Spalek [Mon, 8 Nov 2004 17:36:48 +0000 (17:36 +0000)]
SORT_ONLY_PRESORT feature improved into SORT_UP_TO (stop when average run
length reaches a given limit), which is independent on presorting

20 years agoSplit type_flags to 4/4 bits for FILETYPE and LANG
Tomas Holusa [Fri, 5 Nov 2004 15:07:26 +0000 (15:07 +0000)]
Split type_flags to 4/4 bits for FILETYPE and LANG

20 years agoRemember that DEBUG has been renamed.
Martin Mares [Thu, 4 Nov 2004 22:22:59 +0000 (22:22 +0000)]
Remember that DEBUG has been renamed.

20 years agoAdded "pre-sort only" mode as Robert suggested.
Martin Mares [Thu, 4 Nov 2004 22:22:21 +0000 (22:22 +0000)]
Added "pre-sort only" mode as Robert suggested.

20 years agoOne more round of changes to the assert code -- I didn't realize that CONFIG_DEBUG
Martin Mares [Fri, 29 Oct 2004 15:10:21 +0000 (15:10 +0000)]
One more round of changes to the assert code -- I didn't realize that CONFIG_DEBUG
is already used to control compilation of debugging utilities. Introduced
DEBUG_ASSERTS as a separate switch and as a bonus, you can use assertions
selectively (previously, if you have built the library without assertions,
ASSERT couldn't work anywhere, because assert_failed() was incompatible).

20 years agoAlways define the memory allocation primitives with the `sh_' prefix,
Martin Mares [Fri, 29 Oct 2004 08:56:06 +0000 (08:56 +0000)]
Always define the memory allocation primitives with the `sh_' prefix,
so that the basic names (xmalloc etc.) can be modified when needed.

20 years agoChanged DEBUG to CONFIG_DEBUG to avoid conflicts with various libraries.
Martin Mares [Fri, 29 Oct 2004 08:41:04 +0000 (08:41 +0000)]
Changed DEBUG to CONFIG_DEBUG to avoid conflicts with various libraries.
(BTW we were probably slowing down the regex code by defining DEBUG.)

20 years agoTagged current sources as rel-3-3 (bug fixes only)
Martin Mares [Mon, 25 Oct 2004 14:32:34 +0000 (14:32 +0000)]
Tagged current sources as rel-3-3 (bug fixes only)
and moved mainline to v3.4.

20 years agoDouble oops.
Martin Mares [Mon, 4 Oct 2004 16:45:56 +0000 (16:45 +0000)]
Double oops.

20 years agoOops.
Martin Mares [Mon, 4 Oct 2004 16:45:24 +0000 (16:45 +0000)]
Oops.

20 years agoAdded sh_file_size() (stat() isn't reliable on large files on some systems).
Martin Mares [Mon, 4 Oct 2004 16:43:14 +0000 (16:43 +0000)]
Added sh_file_size()  (stat() isn't reliable on large files on some systems).

20 years agoIntroduced relative counterparts of url_canon_split() and url_auto_canonicalize().
Martin Mares [Sat, 2 Oct 2004 10:52:59 +0000 (10:52 +0000)]
Introduced relative counterparts of url_canon_split() and url_auto_canonicalize().

Also added parameter names to all prototypes.

20 years agoLet bskip() return success.
Martin Mares [Mon, 27 Sep 2004 19:49:00 +0000 (19:49 +0000)]
Let bskip() return success.

20 years agoobuck_slurp_pool() is now able to skip unwanted buckets. Some day we can
Martin Mares [Sun, 26 Sep 2004 16:09:18 +0000 (16:09 +0000)]
obuck_slurp_pool() is now able to skip unwanted buckets. Some day we can
improve it by sizing the buffer adaptively, but not now.

20 years agoA couple of minor improvements to the generic hash tables:
Martin Mares [Mon, 20 Sep 2004 10:03:23 +0000 (10:03 +0000)]
A couple of minor improvements to the generic hash tables:

o  Comment on HASH_GIVE_ALLOC corrected, the automatic choice between
   normal and pooled allocation was never implemented, because we don't
   have enough information to decide the right pool size. HASH_AUTO_POOL
   has been implemented instead.
o  Pooled allocation no longer conflicts with remove/delete, it just
   produces memory leaks within the pool, which are usually harmless.
o  Added HASH_TABLE_ALLOC switch.
o  Internal decisions to enable HASH_CONSERVE_SPACE were made too late
   and didn't influence hash node layout. Fixed.

20 years agoThoroughly tested and fixed a couple of bugs.
Martin Mares [Thu, 9 Sep 2004 11:52:09 +0000 (11:52 +0000)]
Thoroughly tested and fixed a couple of bugs.

20 years agoFixed a couple of bugs.
Martin Mares [Thu, 9 Sep 2004 10:47:05 +0000 (10:47 +0000)]
Fixed a couple of bugs.

20 years agoNo exceptions for url-equiv.
Martin Mares [Thu, 9 Sep 2004 10:46:12 +0000 (10:46 +0000)]
No exceptions for url-equiv.

20 years agotested MJ's patches on charconv. they successfully converted everything
Robert Spalek [Thu, 26 Aug 2004 12:52:15 +0000 (12:52 +0000)]
tested MJ's patches on charconv.  they successfully converted everything
I tried, including the tests that failed before

20 years ago- bugfix: when disabling compression, change bucket_type
Robert Spalek [Sat, 21 Aug 2004 16:30:02 +0000 (16:30 +0000)]
- bugfix: when disabling compression, change bucket_type
- lizard_bwrite() returns the final bucket_type instead of the number of
  written bytes

20 years agoadded sepsplit() in wordsplit.c
Robert Spalek [Sat, 21 Aug 2004 16:29:06 +0000 (16:29 +0000)]
added sepsplit() in wordsplit.c

20 years agoAdded initial support for areas to the indexer. Merging not restricted yet,
Martin Mares [Fri, 20 Aug 2004 19:38:31 +0000 (19:38 +0000)]
Added initial support for areas to the indexer. Merging not restricted yet,
but propagation of area ID's works.

20 years agoPut debug/custom last, so that one more manual recompile won't be needed after
Martin Mares [Fri, 20 Aug 2004 19:05:14 +0000 (19:05 +0000)]
Put debug/custom last, so that one more manual recompile won't be needed after
check-customs when debugging.

20 years agoCheck more configurations.
Martin Mares [Fri, 20 Aug 2004 19:04:17 +0000 (19:04 +0000)]
Check more configurations.

20 years agoif b?get_attr() returns 0, it clears attr->attr too
Robert Spalek [Fri, 20 Aug 2004 13:17:49 +0000 (13:17 +0000)]
if b?get_attr() returns 0, it clears attr->attr too

20 years agoa really essential bugfix
Robert Spalek [Fri, 20 Aug 2004 12:38:28 +0000 (12:38 +0000)]
a really essential bugfix

20 years agoUse GET_UTF8 instead of GET_UTF8_CHAR (this costs us an extra unnecessary
Martin Mares [Fri, 20 Aug 2004 11:44:08 +0000 (11:44 +0000)]
Use GET_UTF8 instead of GET_UTF8_CHAR (this costs us an extra unnecessary
test for character < 0x80, but it is worth the simplification).

20 years agoAdded unit tests for UTF8 macros.
Martin Mares [Fri, 20 Aug 2004 11:43:10 +0000 (11:43 +0000)]
Added unit tests for UTF8 macros.

20 years agoOptimized and simplified UTF8 macros. In fact, turned most of them
Martin Mares [Fri, 20 Aug 2004 11:42:43 +0000 (11:42 +0000)]
Optimized and simplified UTF8 macros. In fact, turned most of them
to inline functions.

This resulted in a couple of const/non-const problems, hence the casts
in GET_UTF8{,_32}.

20 years agorenamed attr_set_type() to put_attr_set_type()
Robert Spalek [Fri, 20 Aug 2004 09:41:00 +0000 (09:41 +0000)]
renamed attr_set_type() to put_attr_set_type()

20 years ago- added b?get_attr()
Robert Spalek [Fri, 20 Aug 2004 09:39:00 +0000 (09:39 +0000)]
- added b?get_attr()
- added {get,put}_attr_set_type()

20 years ago- added get_attr() and bget_attr() with get_attr_set_type()
Robert Spalek [Fri, 20 Aug 2004 09:36:53 +0000 (09:36 +0000)]
- added get_attr() and bget_attr() with get_attr_set_type()
- use get_utf8_32()