Commit Graph

63 Commits

Author SHA1 Message Date
Gilles Darold d05a2205e9 Apply fix of 0xflotus to main documentation file doc/SquidAnalyzer.pod 2018-10-11 07:02:23 +02:00
0xflotus 17638e0e58
fixed some small errors 2018-10-11 01:27:46 +02:00
Gilles Darold e7f986e44e Update year in copyright. 2018-01-28 15:54:27 +01:00
Gilles Darold 4f0b3a713b Add two new command line options to force file to be parsed from begining even
if an history file is present:
    --skip-history             : used to not take care of the history file. Log
                                 parsing offset will start at 0 but old history
                                 file will be preserved at end. Useful if you
                                 want to parse and old log file.
    --override-history         : when skip-history is used the current history
                                 file will be overriden by the offset of the
                                 last log file parsed.
Thanks to zeft2016 for the feature request.
2018-01-28 15:37:32 +01:00
Gilles Darold 8380ea4392 Resolve merge conflict 2017-10-19 10:46:37 +02:00
Darold Gilles 58bdeda870 Add --with-month-stat command line to force compute month statistics when --no-year-stat is used. 2017-08-06 12:21:42 +02:00
Amish e55c4b9769 Add feature to mention date range for reports.
Add feature to mention a different output directory.
Add feature to have CustomTitle just like CustomHeader.
Some bug fixes and optimization.
Ignore SIGHUP signal too.
2017-06-22 15:24:07 +05:30
Gilles Darold bc2bfa22a6 Update documentation to clarify the use of space character in aliases files. Thanks to Darren Spruell for the report. 2017-04-03 11:20:22 +02:00
Gilles Darold 31467ff936 Fix explanation of UserAlias file format about ip address vs DNS name. Thanks to Darren Spruell for the report. 2017-03-31 10:03:16 +02:00
Gilles Darold 40cfb1f87c Add TopStorage configuration directive to limit the storage of url to
a certain quantity in data file and sorted by OrderUrl. On huge access
log it will improve a lot the performances but you will have less
precision in the top url. Default to 0, all url will be stored.

Here are the performances of SquidAnalayzer on a 1.4 GB access log
file to parse and compute full reports over one week:

UrlReport | UserReport | Duration
----------+------------+---------
    0     |     0      |  2m30s
    0     |     1      |  3m00s
    1     |     1      | 18m15s
    1     |     1      |  9m55s when TopStorage is set to 100
2017-02-18 18:51:24 +01:00
Darold Gilles 899a04b13b Add TimeStart and TimeStop configuration directives to allow to
specify a start and stop time. Log line out of this time range
will not be parsed. The format of the value is HH:MM. These
directives can be overriden with the -s | --start and -S | --stop
command line options. Thanks to Louis-Berthier Soulliere for the
feature request.
2017-02-12 17:18:02 +01:00
Darold Gilles a927181ca9 Update year in copyrights. 2017-01-09 08:13:02 +01:00
Darold Gilles 77d2177cb1 - Add UpdateAlias configuratio directive to apply immediately the changes
made in aliases files to avoid duplicates. You still have to use
    --rebuild to recreate previous reports with new aliases. Enabling
    this will imply a lost of performances with huges log files.
2017-01-09 08:04:26 +01:00
Darold Gilles 153cbe4c73 - Add UseUrlPort configuration directive to be able to include port number
into Url statistics. Default is to remove the port information from the Url.
  Thanks to Tobias Wigand for the feature request.
2017-01-07 10:39:08 +01:00
Darold Gilles 0d67250931 Change Perl install directory from vendor to site to avoid well know issue on BSD. Thanks to dspruell for the report. 2016-08-28 12:20:40 +02:00
Darold 7fdb6d00a0 Merge pull request #126 from sathieu/manpages
Manpages fixes
2016-03-02 15:23:39 +01:00
Mathieu Parent f6f90b7b7a Use FHS for manpages path 2016-03-02 13:15:42 +01:00
Mathieu Parent f5b273c5cd Spellchecking 2016-03-02 13:14:48 +01:00
Darold Gilles 410e36aac2 Update ChangLog, copyright and version to 6.5 2016-01-03 16:22:00 +01:00
Darold Gilles bcc2e7a0f2 Add -t | --timezone and TimeZone configuration directive to be able to change the timezone. When set, SquidAnalyzer will read time from log file as UTC time and will add the hours specified in the timezone option. This is usefull if the log file is not parsed on a computer with the same timezone thant the squid server. Thanks to Anderson - BR Suporte for the feature request. 2015-12-13 16:31:14 +01:00
Darold Gilles 810e0b9a8d Try to fix bad characters in mime_type field and add MaxFormatError to not exit immediatly when a bad format error is encountered. SquidAnalyzer will wait MaxFormatError before exiting. 2015-08-29 10:19:00 +02:00
Darold Gilles 32b8607e61 Add information about how to parse SquidGuard log together with Squid access log file. 2015-07-27 22:50:06 +02:00
Darold Gilles 79a470932c Add UrlHitsOnly configuration directive to be able to disable the generation of tables ordered per byte and duration in Top Urls and Domains report. Thanks to Cesar Vazquez for the feature request. 2015-04-06 18:27:22 +02:00
Darold Gilles 8c97ae6e6f Add documentation about UserReport configuration directive. 2015-02-21 17:45:08 +01:00
Darold Gilles 5bb7ffcadb Update year in copyright 2015-02-21 16:15:22 +01:00
Darold Gilles f21d7cdd55 Add documentation about log format. 2015-02-20 16:23:04 +01:00
Darold Gilles 33b4f4d05e Add support to common and combined (http like) log format 2015-02-14 16:54:50 +01:00
Darold Gilles 9455f8cd8e Add ExcludedCodes configuration directive to be able to remove some log entries from statistics based on the TCP code. For example: TCP_DENIED/403, which are generated when a user accesses a page the first time without authentication. Thanks to Peter C. Ndikuwera for the feature request. 2014-11-30 11:30:36 +01:00
Darold Gilles 262f49e61b Add --no-week-stat to disable weekly reports generation. Thanks to Mang0uste for the feature request. 2014-10-13 11:28:41 +02:00
Darold Gilles 54006cf367 Release announcement will be done on twitter now, see https://twitter.com/SquidAnalyzer 2014-08-29 22:40:14 +02:00
Darold Gilles c13bf6a642 Add support to parse multiple access log file at a time. Fix infinite waiting of child when multiprocess is not used. 2014-08-15 18:29:35 +02:00
Darold Gilles ca34fb915c Add documentation about multiprocess usage. 2014-08-14 22:38:14 +02:00
Darold Gilles ce266f4484 Add ExcludedMimes configuration directive to allow exclusion fron statistics of a comma separated list of mimetype fullname or using regex like text/.*. Thanks to Ajayaks for the feature request. 2014-05-15 19:54:15 +02:00
Darold Gilles ddf635ca17 Add ExcludedMethods configuration directive to allow exclusion fron statistics of a comma separated list of HTTP methods. Thanks to Ajayaks for the feature request. 2014-05-15 19:34:12 +02:00
Darold Gilles f007f5839b Update documentation with copyright date and new feature 2014-05-04 19:08:57 +02:00
Darold Gilles b3ff727a55 Add CustomHeader to allow custom definition of the logo and title. See squidanalyzer.conf or documentation for more explanation and example. Thanks to Raktim Chatterjee. 2014-03-15 18:22:37 +01:00
Darold Gilles 7739e35840 Replace logrotate example that was too simplistic. Thanks to Gaetan Slongo for the patch 2014-03-03 09:29:10 +01:00
Darold Gilles 956d39d398 Update documentation about -P option. 2014-02-28 15:47:43 +01:00
Darold Gilles 8fe09bbe27 Add documentation about the new "Include" configuration directive. 2014-01-31 18:26:37 +01:00
Darold Gilles c556c9b384 Remove special hidden character from documentation that prevent pod2man from working. Thanks to David Walser for the report. 2013-12-23 22:17:24 +01:00
Darold Gilles 6cc9a81d4b Add advice about parsing access.log after logrotate. Thanks to James Harper for the report. 2013-12-01 18:45:30 +01:00
Darold Gilles b1810b233b Set default timeout for DNS lookup to 100ms, default value for DNSLookupTimeout is now 0.0001 second. 2013-12-01 16:22:46 +01:00
Darold Gilles 39051280a8 Add new directive DNSLookupTimeout to change the default timeout for DNS lookup. Add one second timeout when SquidAnalyzer look for an DNS name. Thanks to alex for the patch. 2013-11-26 19:42:21 +01:00
Darold Gilles b0c7bfe690 Allow ip addresses on usernames to be replaced by their DNS name, this feature is activated by a new directive: UseClientDNSName. Thanks to Pfisztner Tamas for the patch. 2013-09-04 21:54:55 +02:00
Darold Gilles f4e9b65acc Add missing description of --no-year-stat option to documentation and squid-analyzer usage. 2013-09-01 21:42:33 +02:00
Darold Gilles bded7721e9 Fix pod2man error with perl 5.18 about non-ascii character. Thanks to David Walser for the report. 2013-09-01 20:53:39 +02:00
Darold Gilles a3c6807ffd Add -b | --build_date command line option to limit rebuilt to the given date, the format of its value can be yyyy-mm-dd, yyyy-mm or yyyy. This should be used to prevent rebuilding all html file from all data file. 2013-05-27 22:27:18 +02:00
Darold Gilles 736b6c2d97 New feature to show the top N users that look at an url or a domain. Add a new configuration directive, TopUrlUser, to control the number of users to show. Thanks to Mr-Ed for the feature resquest. 2013-05-26 17:20:55 +02:00
Darold Gilles 63d2664447 Allow CIDR notation in exclude file to skip line matching the given xxx.xxx.xxx.xxx/n network. Thanks to the MangOuste for the patch. 2013-05-25 19:09:59 +02:00
Darold Gilles f9f6e71b1d Add usage information into documentation. 2013-01-30 00:06:48 +01:00