X-Git-Url: http://mj.ucw.cz/gitweb/?a=blobdiff_plain;f=lib%2Fsorter%2FTODO;h=c2b653d5b96f4b2e5a3861befdb1cbbeddc88cd8;hb=90afcc18dbf7cb6c682e1efb994007f03e304422;hp=f36cc1cebcdc477c0a38054eae02576c2df730ea;hpb=cd5c8bf5fbdb894ec44c130488c5e74eaef440a9;p=libucw.git diff --git a/lib/sorter/TODO b/lib/sorter/TODO index f36cc1ce..c2b653d5 100644 --- a/lib/sorter/TODO +++ b/lib/sorter/TODO @@ -5,13 +5,20 @@ o Empty files. Cleanups: o Clean up data types and make sure they cannot overflow. (size_t vs. u64 vs. sh_off_t vs. uns) +o Clean up log levels. +o Clean up introductory comments. o Log messages should show both original and new size of the data. The speed should be probably calculated from the former. o Automatically tune ASORT_MIN_RADIX, ASORT_MIN_SHIFT and especially ASORT_RADIX_BITS. -o Check undefs in sorter.h and array.h. +o Buffer sizing in shep-export. Improvements: o Switching between direct and normal I/O. Should use normal I/O if the input is small enough. o How does the speed of radix splitting decrease with increasing number of hash bits? Does it help to use more bits than we need, so that we sort less data in memory? -o Add automatic joining to the custom presorter interface? + +Users of lib/sorter/array.h which might use radix-sorting: +indexer/chewer.c +indexer/lexfreq.c +indexer/mkgraph.c +indexer/reftexts.c