80 Commits

Author SHA1 Message Date
Gergely Szasz
8d847eff19 You can install SquidAnalyzer.pm into custom LIB directory, so you can keep all files together (e.g. /opt/squidanalyzer) 2024-12-28 19:53:44 +00:00
Gilles Darold
43ba618e01 Merge branch 'master' of github.com:darold/squidanalyzer 2020-11-06 08:00:07 +01:00
Gilles Darold
647ebb1f4e Allow new value to TimeZone with "auto", in this case SquidAnalyzer will
autodetect the timezone and apply it.
2020-11-06 07:58:27 +01:00
Gilles Darold
d42f10804a Change DNSLookupTimeout unit, must now be set in milliseconds. Thanks to Jo Deref fotr the report. 2020-11-06 07:18:12 +01:00
Gilles Darold
2b8a4f3c66 Update documentation about logrotate configuration. Thanks to Gill Bates for the report. 2020-11-06 07:02:02 +01:00
Gilles Darold
143dc649d1 Add TopDenied configuration directive to be able to show more denied URL
than in other reports.
2019-01-01 22:37:08 +01:00
Gilles Darold
46e74146ae Add UrlAlias configuration directive (default: /etc/squidanalyzer/url-aliases)
used to set path to the file containing url alias name. You may want to group
URL under a single alias to agregate statistics, in this case create a file
with this format :

	URL_ALIAS     URL_REGEXP1,URL_REGEXP2,...

For example:

	VIDEO           .*\.googlevideo\.com.*,.*\.youtube\.com.*,.*\.viadeo.com.*
	FACEBOOK        .*\.fbcdn\.net.*,.*\.facebook\.com.*
	GOOGLE          .*\.google[\-\.].*

Regexp must use the Perl regular expression. Thanks to Gergely Szasz for
the feature request.
2019-01-01 21:35:07 +01:00
Gilles Darold
90a1306fc9 Update year in copyright 2019-01-01 18:15:21 +01:00
Gilles Darold
b2f4e6695d Add RefreshTime configuration directive and -R | --refresh command line
options:

        Insert a html Refresh tag into all index.html files. The value is
        the refresh intervalle in minutes. Default to 5 minutes. Can be
        overridden at command line with option -R | --refresh

To avoid loading index.html pages with incomplete content when SquidAnalyzer
is writing into the file, SquidAnalyzer first write into a index.html.tmp
file and once it is written it rename it into index.html.

Thanks to Weverton Everaldo Lubask and Pablo Ariel Tofano for the feature
request.
2018-12-04 09:17:37 +01:00
Gilles Darold
22cef48251 Change TimeZone configuration comment and behavior. It is not defined as
follow:

        Adjust timezone to use when SquidAnalyzer reports different time
        than graphs in your browser. The value must follow format: +/-HH.
        Default is to use local time. This must be considered as real
        timezone but the number of hours to add remove from log timestamp to
        adjust graphs times. For example:

                TimeZone       +01

        will append one hour to all graphs time series to match squid server
        timestamp.

Be warn that if you have enabled this directive before this commit the
graphs might display the wrong time. If your browser is at the same
timezone as the squid server you might want to comment this directive as
SquidAnalyzer will adjust the graphs to the right timezone by default.

Thanks to Weverton Everaldo Lubask for the report.
2018-12-03 22:27:38 +01:00
Gilles Darold
7da3a57831 Add information about Upgrade process and especially to upgrade to last development code. 2018-10-13 11:27:21 +02:00
Gilles Darold
d05a2205e9 Apply fix of 0xflotus to main documentation file doc/SquidAnalyzer.pod 2018-10-11 07:02:23 +02:00
Gilles Darold
e7f986e44e Update year in copyright. 2018-01-28 15:54:27 +01:00
Gilles Darold
4f0b3a713b Add two new command line options to force file to be parsed from begining even
if an history file is present:
    --skip-history             : used to not take care of the history file. Log
                                 parsing offset will start at 0 but old history
                                 file will be preserved at end. Useful if you
                                 want to parse and old log file.
    --override-history         : when skip-history is used the current history
                                 file will be overriden by the offset of the
                                 last log file parsed.
Thanks to zeft2016 for the feature request.
2018-01-28 15:37:32 +01:00
Gilles Darold
8380ea4392 Resolve merge conflict 2017-10-19 10:46:37 +02:00
Darold Gilles
58bdeda870 Add --with-month-stat command line to force compute month statistics when --no-year-stat is used. 2017-08-06 12:21:42 +02:00
Amish
e55c4b9769 Add feature to mention date range for reports.
Add feature to mention a different output directory.
Add feature to have CustomTitle just like CustomHeader.
Some bug fixes and optimization.
Ignore SIGHUP signal too.
2017-06-22 15:24:07 +05:30
Gilles Darold
bc2bfa22a6 Update documentation to clarify the use of space character in aliases files. Thanks to Darren Spruell for the report. 2017-04-03 11:20:22 +02:00
Gilles Darold
31467ff936 Fix explanation of UserAlias file format about ip address vs DNS name. Thanks to Darren Spruell for the report. 2017-03-31 10:03:16 +02:00
Gilles Darold
40cfb1f87c Add TopStorage configuration directive to limit the storage of url to
a certain quantity in data file and sorted by OrderUrl. On huge access
log it will improve a lot the performances but you will have less
precision in the top url. Default to 0, all url will be stored.

Here are the performances of SquidAnalayzer on a 1.4 GB access log
file to parse and compute full reports over one week:

UrlReport | UserReport | Duration
----------+------------+---------
    0     |     0      |  2m30s
    0     |     1      |  3m00s
    1     |     1      | 18m15s
    1     |     1      |  9m55s when TopStorage is set to 100
2017-02-18 18:51:24 +01:00
Darold Gilles
899a04b13b Add TimeStart and TimeStop configuration directives to allow to
specify a start and stop time. Log line out of this time range
will not be parsed. The format of the value is HH:MM. These
directives can be overriden with the -s | --start and -S | --stop
command line options. Thanks to Louis-Berthier Soulliere for the
feature request.
2017-02-12 17:18:02 +01:00
Darold Gilles
a927181ca9 Update year in copyrights. 2017-01-09 08:13:02 +01:00
Darold Gilles
77d2177cb1 - Add UpdateAlias configuratio directive to apply immediately the changes
made in aliases files to avoid duplicates. You still have to use
    --rebuild to recreate previous reports with new aliases. Enabling
    this will imply a lost of performances with huges log files.
2017-01-09 08:04:26 +01:00
Darold Gilles
153cbe4c73 - Add UseUrlPort configuration directive to be able to include port number
into Url statistics. Default is to remove the port information from the Url.
  Thanks to Tobias Wigand for the feature request.
2017-01-07 10:39:08 +01:00
Darold Gilles
0d67250931 Change Perl install directory from vendor to site to avoid well know issue on BSD. Thanks to dspruell for the report. 2016-08-28 12:20:40 +02:00
Darold
7fdb6d00a0 Merge pull request #126 from sathieu/manpages
Manpages fixes
2016-03-02 15:23:39 +01:00
Mathieu Parent
f6f90b7b7a Use FHS for manpages path 2016-03-02 13:15:42 +01:00
Mathieu Parent
f5b273c5cd Spellchecking 2016-03-02 13:14:48 +01:00
Darold Gilles
410e36aac2 Update ChangLog, copyright and version to 6.5 2016-01-03 16:22:00 +01:00
Darold Gilles
bcc2e7a0f2 Add -t | --timezone and TimeZone configuration directive to be able to change the timezone. When set, SquidAnalyzer will read time from log file as UTC time and will add the hours specified in the timezone option. This is usefull if the log file is not parsed on a computer with the same timezone thant the squid server. Thanks to Anderson - BR Suporte for the feature request. 2015-12-13 16:31:14 +01:00
Darold Gilles
810e0b9a8d Try to fix bad characters in mime_type field and add MaxFormatError to not exit immediatly when a bad format error is encountered. SquidAnalyzer will wait MaxFormatError before exiting. 2015-08-29 10:19:00 +02:00
Darold Gilles
32b8607e61 Add information about how to parse SquidGuard log together with Squid access log file. 2015-07-27 22:50:06 +02:00
Darold Gilles
79a470932c Add UrlHitsOnly configuration directive to be able to disable the generation of tables ordered per byte and duration in Top Urls and Domains report. Thanks to Cesar Vazquez for the feature request. 2015-04-06 18:27:22 +02:00
Darold Gilles
8c97ae6e6f Add documentation about UserReport configuration directive. 2015-02-21 17:45:08 +01:00
Darold Gilles
5bb7ffcadb Update year in copyright 2015-02-21 16:15:22 +01:00
Darold Gilles
f21d7cdd55 Add documentation about log format. 2015-02-20 16:23:04 +01:00
Darold Gilles
33b4f4d05e Add support to common and combined (http like) log format 2015-02-14 16:54:50 +01:00
Darold Gilles
9455f8cd8e Add ExcludedCodes configuration directive to be able to remove some log entries from statistics based on the TCP code. For example: TCP_DENIED/403, which are generated when a user accesses a page the first time without authentication. Thanks to Peter C. Ndikuwera for the feature request. 2014-11-30 11:30:36 +01:00
Darold Gilles
262f49e61b Add --no-week-stat to disable weekly reports generation. Thanks to Mang0uste for the feature request. 2014-10-13 11:28:41 +02:00
Darold Gilles
54006cf367 Release announcement will be done on twitter now, see https://twitter.com/SquidAnalyzer 2014-08-29 22:40:14 +02:00
Darold Gilles
c13bf6a642 Add support to parse multiple access log file at a time. Fix infinite waiting of child when multiprocess is not used. 2014-08-15 18:29:35 +02:00
Darold Gilles
ca34fb915c Add documentation about multiprocess usage. 2014-08-14 22:38:14 +02:00
Darold Gilles
5309d93908 Fix issue on calendar when days of a month are over 6 week. Thanks to Michael Gauthier for the report. 2014-07-10 07:15:49 +02:00
Darold Gilles
ce266f4484 Add ExcludedMimes configuration directive to allow exclusion fron statistics of a comma separated list of mimetype fullname or using regex like text/.*. Thanks to Ajayaks for the feature request. 2014-05-15 19:54:15 +02:00
Darold Gilles
ddf635ca17 Add ExcludedMethods configuration directive to allow exclusion fron statistics of a comma separated list of HTTP methods. Thanks to Ajayaks for the feature request. 2014-05-15 19:34:12 +02:00
Darold Gilles
f007f5839b Update documentation with copyright date and new feature 2014-05-04 19:08:57 +02:00
Darold Gilles
b3ff727a55 Add CustomHeader to allow custom definition of the logo and title. See squidanalyzer.conf or documentation for more explanation and example. Thanks to Raktim Chatterjee. 2014-03-15 18:22:37 +01:00
Darold Gilles
7739e35840 Replace logrotate example that was too simplistic. Thanks to Gaetan Slongo for the patch 2014-03-03 09:29:10 +01:00
Darold Gilles
956d39d398 Update documentation about -P option. 2014-02-28 15:47:43 +01:00
Darold Gilles
8fe09bbe27 Add documentation about the new "Include" configuration directive. 2014-01-31 18:26:37 +01:00