AwStats Added

[hoobastank68]

Hi,

Maybe add awstats to DA instead of having Webalizer only?
THat be great :)

[ProWebUK]

Moved to feature requests forum.

[outpernet]

agree... a needed feature

[twv]

Yes, please, this would be great.

Great things about awstats:
Separate categories for referring sites and referring search engines.
Full list of search phrases and search words.
Browser and OS summary as well as details.
Shows visiting spiders.
Doesn't waste space with irrelevant (for me, at least) list of referrals from internal pages.

Compared to webalizer, awstats just seems much more "with it" and in keeping with the image that DA conveys: solid, professional, user-friendly.

Please add it!!

[ProWebUK]

Originally posted by twv
and in keeping with the image that DA conveys: solid, professional, user-friendly.

Not sure, we use webalizer which is fine for some simple hits/uniques stats by the user then urchin for advanced analysis, for the majority webalizer is fine.

I personally think an AwStats add-on may be better than having it as a forced feature, give me 'til early next week see if i can get it automated and setup for all sites on a script (i know its been done as a manual how-to.. I mean a script) :)

Chris

[twv]

Thanks for the offer. I have tried to install awstats for my clients, but have not succeeded. As a reseller, I don't seem to have the necessary permissions. But then my host tried, and I don't think she was able to, either.

If possible, please make a script that will work for both resellers and admins.

Also, what happens when the next version of DA comes out? Does the add-on get overwritten?

And finally, how will my users get access to awstats? Will they be able to see it from their control panel?

Thanks,
Tobey

[ProWebUK]

I dont think it would be easy for reseller level, it would probably run using a shell script also, and require access to the DA "upon domain creation/removal" scripts to automate it...

Chris

[twv]

I dont think it would be easy for reseller level

To my mind this is a good argument for just adding it to DirectAdmin, rather than going the add-on route.

[ProWebUK]

Well unless a reseller has shell access and access to the DA configs, you cant since it would uitilise them.. once you have done the initial install its simply a case of create an account in DA and its done for you, whether your admin OR reseller.

Just because you cant compile (replace with any compiled software) as a reseller doesnt mean it has to be implemented into the DA panel.... slow down a bit :)

Chris

[twv]

Originally posted by ProWebUK
slow down a bit

Oh, all right. :)

It's just that I've been struggling to install awstats off and on for about 6 months and I'm really tired of webalizer's limitations. (not only DA's fault--I was already annoyed at webalizer years ago on my first site, where I was also stuck with it.)

It almost makes me want to go back to cPanel, just to have good stats. (:

[twv]

Originally posted by ProWebUK

I personally think an AwStats add-on may be better than having it as a forced feature, give me 'til early next week see if i can get it automated and setup for all sites on a script

Any luck on this?

[ProWebUK]

To be honest with you not even looked at it yet..... have numerous things which unfortunately take priority at the moment (ok that doesn't include reading these forums :D)

Got a few things to do right now , since I said early this week I might have a look at it later tonight (if i dont get dragged away with even more work :rolleyes: )

Chris

[twv]

Originally posted by ProWebUK
To be honest with you not even looked at it yet..... have numerous things which unfortunately take priority at the moment (ok that doesn't include reading these forums :D)

Believe me I know the feeling!

[sbchasin]

Originally posted by twv
Thanks for the offer. I have tried to install awstats for my clients, but have not succeeded. As a reseller, I don't seem to have the necessary permissions. But then my host tried, and I don't think she was able to, either.

If possible, please make a script that will work for both resellers and admins.

Also, what happens when the next version of DA comes out? Does the add-on get overwritten?

And finally, how will my users get access to awstats? Will they be able to see it from their control panel?

awstats installs very nicely and easily per domain, at least on the host that I use. I have a reseller account at my web host and have 6 domains that I play with, and have awstats installed on 4 of them and it works great.

What isn't working for you?

[twv]

Originally posted by sbchasin
awstats installs very nicely and easily per domain, at least on the host that I use. I have a reseller account at my web host and have 6 domains that I play with, and have awstats installed on 4 of them and it works great.

What isn't working for you?

To be honest it's been several months since I tried and I don't remember at this point.

I'm sure that with enough effort and persistence and help from this forum I could get it to work. But right now I don't have the time or the inclination. And frankly, I don't think I should have to. Awstats is a great free package; it blows webalizer out of the water. It should, IMO, come with DA by default.

This forum is the place for requesting features, and to my mind this is a feature that is well worth adding to the default DA installation. So I'm requesting it!

If you're interested, here is the (never answered) post that my admin made when she was trying to install it:
http://www.directadmin.com/forum/showthread.php?s=&postid=14521#post14521

[jmstacey]

I like the idea of it being integrated though and not a external thing that must be maintained seperatly and modding the control panel to make it look like its integrated. It might also cause problems during upgrades if to much of the skin changes with the control panel.

So I vote for it to replace webalizer.

-Jon-

[nobaloney]

Originally posted by jmstacey
So I vote for it to replace webalizer.
And I disagree vehemently. Never replace something that clients are already using with something they're not used to.

If you replace webalizer with AW Stats how will site-owners see their old stats? Or are you volunteering to write the conversion?

Even if you give them the conversion, those who like the simplicity of webalizer could change hosting providers.

There's no reason not to leave it on and give people a choice.

If DA adds it, I'd hope they add it as an add-on, not as a replacement, as they added squirrelmail in addition to Uebimaiu.

Jeff

[jmstacey]

I never said you could only have one, just saying I'd rather have awstats than webalizer, but both are a good idea, but it will require more space as each program will have its own data files.

Both would be excellent, or maybe the option of the client chosing which one is wanted.

[lnguyen]

i'll throw in my vote to have awstats added to DA.. or at least have it as an optional install.

I find it provides more stats and it's a little friendlier in presentation I think.

[outpernet]

agree!

but, preference:

1- full backup server
2- configurable from panel antispam/antivirus solution
3- awstats

[interfasys]

+1

[vandal]

i 2nd this...


Originally posted by outpernet
agree!

but, preference:

1- full backup server
2- configurable from panel antispam/antivirus solution
3- awstats

[DAdmin_lover]

I think that DirectAdmin really need AWstats, because webalizer last release is more than 4 years old...

[DamnSkippy]

I will throw my hat in on this one also and say that I would much appriciate it if the DA team would add AWstats.

[outpernet]

Agree:


1- full backup server (like we have with user_backups. Actual system backup is a painfull when you have to restore a site)
2- configurable from panel antispam/antivirus solution (optional clamd configuration)
3- awstats (and a better log rotation system, how we are actually using wich is a plugin posted here in the forum)


Points 2 & 3 exist but with plugins and manual work. One of the greater things of DA always was the easy install. Now, to install DA and put it working, we lost 1 to 2 hours when before was like 15'

[directuser]

DirectAdmin support, is there any chance that DirectAdmin will include this feature?

[dan35]

+1

[rldev]

+3

[GranTW]

I would like to see it included too.

[jlandes]

You have my vote on this one. :)


Originally posted by outpernet
agree!

but, preference:

1- full backup server
2- configurable from panel antispam/antivirus solution
3- awstats

[rldev]

#2 is half done. Am I missing something. Your priority 1 has been ignored too long though.

[IT_Architect]

Oh yeah! No doubt. ClayRabbit's AWStats is fantastic, but AwStats should be part of the install. It's the defacto standard for stats just like Apache is for web servers.
Originally posted by outpernet
1- full backup server
2- configurable from panel antispam/antivirus solution
3- awstats

[directuser]

Hey, staff, where are you? :)

[redesb]

In reply to DAdmin_lover,

Yes, webalizer is more than 4 years old, but now exist one new fork, AWFFull (http://www.stedee.id.au/awffull) that it seems quite interesting.

The AWFFull Description!

AWFFull - A Webalizer Fork, Full o' Features!

Webalizer is a great weblog analysis program but hasn't been going anywhere in recent years. AWFFull takes that base and starts to fix the niggles and annoyances and hopefully become a useful enhancement.

As a base, weblizer has a stated goal of producing web server analysis. AWFFull on the other hand, will gradually focus more on the business intelligence contained within those logs - and not specifically limited just to web server logs. I have an interest in whole of site analytics, and that is rarely contained solely in webserver log files.

Extracted from README.FIRST

Upgrade information from Webalizer Version 2.01 to AWFFull v3.00
----------------------------------------------------------------

If you are already using The Webalizer Version 2.01, you should not experience
any problems with using AWFFull. The changes to history and current files are
explicitly able to cope with the older version and will automatically upgrade.

[rldev]

Maybe DA could chime in on this. Webalizer needs to be supplanted one way or another. This may be the easiest way.

[hci]

Just an FYI

http://www.idefense.com/intelligence/vulnerabilities/display.php?id=185

Matthew

[IT_Architect]

Webalizer needs to be supplanted one way or another. Amen! AWStats is the defacto standard and is very active. As hci has shown, when there are problems, they are fixed.

[redesb]

VIII. DISCLOSURE TIMELINE

10/21/2004 Initial vendor notification
01/02/2005 Initial vendor response
01/17/2005 Public disclosureTwo months to patch a vulnerability when they say to you like doing it, it does not seem too fast to me.

Very active? :D

[IT_Architect]

Two months to patch a vulnerability when they say to you like doing it, it does not seem too fast to me. :D I'll give you that one. It's still the defacto standard and there are lots of add-ons and information on how to leverage its abilities. It's an expectation of many people with web sites and the lack of built-in support has most definitely cost DirectAdmin sales. :D

[sullise]

Originally posted by redesb
In reply to DAdmin_lover,

Yes, webalizer is more than 4 years old, but now exist one new fork, AWFFull (http://www.stedee.id.au/awffull) that it seems quite interesting.




Looks like an improvement on number of stats, but like webalizer,the presentations is still "AWFUL"!

[DamnSkippy]

Agreed, looks just as yucky as the original.

[redesb]

I agree in which the graphs have not improved too much and personally I prefer AWStats, the only thing that bothers me is that it charge so much the server when run.

[DirectAdmin Support]

Hello,

That's likely the main reason we haven't implemented it yet. If there was a static version that could be computed via cron, like for webalizer, then I would be more willing. Dynamic scripts that have to be setup and process the data for each display are less appealing to me (from a setup and usage standpoint). DA aslo uses some of the webalizer stats to show the bandwidth usage for subdomains.

If there is a a daily command for awstats that will generate the html as for webalizer that I'm not seeing, let me know.

Running a command nightly isn't difficult. Setting up an entire new script enviroment is, (if it needs an modules, multiplied by however many OS's we support, etc)

John

[DamnSkippy]

I am no awstats expert but from what I have seen in the way hsphere implements it awstats only runs once a day to calculate totals.

I do want awstats but I do not want it to calculate totals each time the page is refreshed. I seem to remember seeing that as an option the one time I looked at installing it. You could have it run at each update or not.

Leave webalizer there for your underlying needs but give us the option to enable it in the plan or something. I really only want them running one stats program.

[smtalk]

DirectAdmin Support, is it possible that AWstats will be added to DirectAdmin this year?

[twv]

Originally posted by DirectAdmin Support
If there is a a daily command for awstats that will generate the html as for webalizer that I'm not seeing, let me know.
Wouldn't this do it?
perl awstats.pl -config=mysite -output -staticlinks > awstats.mysite.html
http://awstats.sourceforge.net/docs/awstats_setup.html#READ

There's also this:
http://awstats.sourceforge.net/docs/awstats_tools.html#awstats_buildstaticpages

[Ryders]

Originally posted by DirectAdmin Support
if there is a a daily command for awstats that will generate the html as for webalizer that I'm not seeing, let me know.

Hi,

Have a look at the /tools/awstats_buildstaticpages.pl script... I run this, nightly;

/usr/local/awstats/tools/awstats_buildstaticpages.pl
-update -config=empire -dir=/home/empire/public_html/stats/

For I've work with AWStats for quite a while now I'm pretty sure it could take care of all configurations (not only one, from the -config flag).

I've been looking into getting this into DA for a while now but my two concerns are;

- don't ask me why, but I was under the impression DA was using Webalizer for some aspect of its daily processes...???!
- Awstats can easily have one config per domain... and to implement it properly into DA you would require to keep that functionality.



Originally posted by redesb
the only thing that bothers me is that it charge so much the server when run.

What kind of logs are you precessing? I crunge between 100 and 450MB Log files within 20 seconds on a shared PIII/256MB....! if your taling about browsing the processed stats, you're quite right (my monthly stats files (.txt) are close to 18MB), it can be slow-ish so just use the above technique...!

@DA: I've been working quite a bit with AWStats... I'm not linux expert... but I still know what I do. If you need assistance, I'll be more than happy to help out getting this up and running properly - at last!

Cheers,

Seb.

[smtalk]

AWstats is available now (from DirectAdmin version 1.322): http://www.directadmin.com/features.php?id=894

[twv]

OMG!

I'd long since given up.

[dannygoh]

how do i migrate my 3rd party awstat to DA Beta awstat?

[smtalk]

Uninstall 3rd party plug-in, and do:


cd /usr/local/directadmin/scripts
./awstats.sh

[dannygoh]

Uninstall 3rd party plug-in, and do:


cd /usr/local/directadmin/scripts
./awstats.sh


would it retain old awstats logs?

[smtalk]

No it won't. P.S. DA is using static pages instead of dynamic (used by 3rd party plugins).

[chriswb]

How do we force AWStats to run immediately to generate statistics for today?

[smtalk]

service directadmin restart
echo 'action=tally&value=all' >> /usr/local/directadmin/data/task.queue
/usr/local/directadmin/dataskq d


Good luck! :)

[Henrik]

How does Awstats installed via DirectAdmin differ from the Awstats in the third party module?

Will awstats still be available at domain.com/awstats and being able to be password protected?

[smtalk]

1. It's more secure.
2. It runs together with tally process.
3. You have static pages instead of dynamic.

You can set-up /stats to go to AWstats in DA interface. And of course you can password protect it too.

[chriswb]

Martynas,

Thank you! As always, you are incredibly helpful.

[Henrik]

Isn't the third party plugin with the tally as well?

Regarding password protecting, will the alias be the same?

Also, what would be the best way to un-install the thirdparty module, in your opinion?

[smtalk]

chriswd, thank you for these words :)

Henrik, no, you must run this command for the 3rd party plugins:


/usr/local/directadmin/plugins/awstats/hooks/cgi-bin/awstats_updateall.pl now -awstatsprog=/usr/local/directadmin/plugins/awstats/hooks/cgi-bin/awstats.pl
And only then tally. You can set up any alias (redirect) (in /etc/httpd/conf/extra/httpd-alias.conf) you want, by default /stats is used for it (but you can change that too, just write /awstats in "Set selected domains to be publicly viewable from" field (in "Site Summary / Statistics / Logs")), and you can redirect e.g. /awstats to /stats if you want :) Good luck!

[Henrik]

Hello again,


I have installed DA's awstats over the 3rd party plugin (now disabled), but I run into some trouble when it comes to the fact that the IP-addresses doesn't want to resolve now.

I am running CentOS 4.6 currently, and I'd like the global settings to be "resolve on", but also if available some kind of geoip-setting. (what is this module? Does it exist and how do I enable it?)

I went here (http://www.directadmin.com/forum/showpost.php?p=135744&postcount=5) and saw something about this.

So my main questions are;

How do I set a "default" awstats.conf files that apply for all users?
Where do I find this global conf file?
Is it safe to run the commands listed below to delete all the current users' conf-files?



find . -name "awstats.*.conf" -exec rm -rf {} \;

Thank you in advance :)

[Henrik]

Also, could someone print out a "default" tally from /etc/cron.d/directadmin_cron? (CentOS 4.6, with awstats enabled)

Mine looks like this;

* * * * * root /usr/local/directadmin/dataskq
2 0-23/6 * * * root echo 'action=vacation&value=all' >> /usr/local/directadmin/data/task.queue;
#5 5 * * 0 root /sbin/quotaoff -a; /sbin/quotacheck -augm; /sbin/quotaon -a;
10 0 * * * echo 'action=tally&value=all' >> /usr/local/directadmin/data/task.queue
20 4 1 * * root echo 'action=reset&value=all' >> /usr/local/directadmin/data/task.queue
0 4 * * * root echo 'action=check&value=license' >> /usr/local/directadmin/data/task.queue

Thank you :)

[smtalk]

You can edit the main awstats configuration file here: /usr/local/awstats/wwwroot/cgi-bin/awstats.model.conf. You can run the command if you want to remove all awstats.anyword.conf files. And the directadmin_cron file in your 2nd post is the default that comes with DA. Good luck! :)

[Henrik]

You can edit the main awstats configuration file here: /usr/local/awstats/wwwroot/cgi-bin/awstats.model.conf. You can run the command if you want to remove all awstats.anyword.conf files. And the directadmin_cron file in your 2nd post is the default that comes with DA. Good luck! :)

Thanks Martynas, you're a star :)

Follow-up question: How would one go ahead to put in geo-ip targeting/results, and how to enable resolving ip-addresses by default?

[smtalk]

Enable that in awstats.model.conf :) http://www.antezeta.com/awstats/geoip.html, http://awstats.sourceforge.net/docs/awstats_contrib.html

[Henrik]

(Thank you again)

Regarding resolving IP-addresses, in the awstats.conf file, the following is listed that is relevant I'd think:




# If you want to have hosts reported by name instead of ip address, AWStats
# need to make reverse DNS lookups (if not already done in your log file).
# With DNSLookup to 0, all hosts will be reported by their IP addresses and
# not by the full hostname of visitors (except if names are already available
# in log file).
# If you want/need to set DNSLookup to 1, don't forget that this will reduce
# dramatically AWStats update process speed. Do not use on large web sites.
# Note: Reverse DNS lookup is done on IPv4 only (Enable ipv6 plugin for IPv6).
# Note: Result of DNS Lookup can be used to build the Country report. However
# it is highly recommanded to enable the plugin 'geoip' or 'geoipfree' to
# have an accurate Country report with no need of DNS Lookup.
# Possible values:
# 0 - No DNS Lookup
# 1 - DNS Lookup is fully enabled
# 2 - DNS Lookup is made only from static DNS cache file (if it exists)
# Default: 2
#
DNSLookup=2

# AWStats can do reverse DNS lookups through a static DNS cache file that was
# previously created manually. If no path is given in static DNS cache file
# name, AWStats will search DirData directory. This file is never changed.
# This option is not used if DNSLookup=0.
# Note: DNS cache file format is 'minsince1970 ipaddress resolved_hostname'
# or just 'ipaddress resolved_hostname'
# Change : Effective for new updates only
# Example: "/mydnscachedir/dnscache"
# Default: "dnscache.txt"
#
DNSStaticCacheFile="dnscache.txt"


# AWStats can do reverse DNS lookups through a DNS cache file that was created
# by a previous run of AWStats. This file is erased and recreated after each
# statistics update process. You don't need to create and/or edit it.
# AWStats will read and save this file in DirData directory.
# This option is used only if DNSLookup=1.
# Note: If a DNSStaticCacheFile is available, AWStats will check for DNS
# lookup in DNSLastUpdateCacheFile after checking into DNSStaticCacheFile.
# Change : Effective for new updates only
# Example: "/mydnscachedir/dnscachelastupdate"
# Default: "dnscachelastupdate.txt"
#
DNSLastUpdateCacheFile="dnscachelastupdate.txt"

# You can specify specific IP addresses that should NOT be looked up in DNS.
# This option is used only if DNSLookup=1.
# Note: Use space between each value.
# Note: You can use regular expression values writing value with REGEX[value].
# Change : Effective for new updates only
# Example: "123.123.123.123 REGEX[^192\.168\.]"
# Default: ""
#
SkipDNSLookupFor=""

# If the "DirData" directory (see above) does not exist, AWStats return an
# error. However, you can ask AWStats to create it.
# This option can be used by some Web Hosting Providers that has defined a
# dynamic value for DirData (for example DirData="/home/__REMOTE_USER__") and
# don't want to have to create a new directory each time they add a new user.
# Change : Effective immediatly
# Possible values: 0 or 1
# Default: 0
#
CreateDirDataIfNotExists=0



With the above, there is no resolving being made.

[j.lambers]

Hi,

Can someone please paste the file awstats.model.conf?

[smtalk]

Did you delete it? If yes - just run awstats.sh again at it will create a new file.

[Henrik]

Replying to my own post;

The line
10 0 * * * echo 'action=tally&value=all' >> /usr/local/directadmin/data/task.queue is relevant to the daily tally, right?

The thing is that the system doesn't seem to want to update the statistics with this cron-information.

When I do

echo 'action=tally&value=all' >> /usr/local/directadmin/data/task.queue
/usr/local/directadmin/dataskq d

(Second command on new line) it seem to update user statistics.

Advice please :)

(thanks)


Also, could someone print out a "default" tally from /etc/cron.d/directadmin_cron? (CentOS 4.6, with awstats enabled)

Mine looks like this;

* * * * * root /usr/local/directadmin/dataskq
2 0-23/6 * * * root echo 'action=vacation&value=all' >> /usr/local/directadmin/data/task.queue;
#5 5 * * 0 root /sbin/quotaoff -a; /sbin/quotacheck -augm; /sbin/quotaon -a;
10 0 * * * echo 'action=tally&value=all' >> /usr/local/directadmin/data/task.queue
20 4 1 * * root echo 'action=reset&value=all' >> /usr/local/directadmin/data/task.queue
0 4 * * * root echo 'action=check&value=license' >> /usr/local/directadmin/data/task.queue

Thank you :)

[smtalk]

http://help.directadmin.com/item.php?id=107

[Henrik]

According to the above, all is okay as I can see that 1-minute log-entry, for example.

As I have a server with not many users on it, I have (now) enabled statistics update every 4 hours, according to this link (http://www.etechsupport.net/forum/showthread.php?t=794). (If there is something not right about the format on that entry, do say.)

I will wait and see if both bandwidth, but also statistics update every 4 hours now.

I also managed to enable GeoIP within AwStats (with API) + adding this globally, and it's working quite nicely :) (Thanks for the info!)

[anhpt]

I have installed awstats but now I want to uninstall it and back to webalizer. I don't know how to do it. Can anyone help me?

[smtalk]

perl -pi -e 's|awstats=1|awstats=0|' /usr/local/directadmin/conf/directadmin.conf
perl -pi -e 's|webalizer=0|webalizer=1|' /usr/local/directadmin/conf/directadmin.conf
echo "action=directadmin&value=restart" >> /usr/local/directadmin/data/task.queue
/usr/local/directadmin/dataskq d

[Henrik]

Why would you want to use webalizer over awstats? (curious)

[Henrik]

Should

10 0 * * * echo 'action=tally&value=all' >> /usr/local/directadmin/data/task.queue

be

10 0 * * * root echo 'action=tally&value=all' >> /usr/local/directadmin/data/task.queue

?



I ask because it still won't update as it should.

[smtalk]

Ah, sorry, I didn't see that :) Yes, it must contain the "root" word.

[Henrik]

Ah cheers, I thought I was going nuts here :p

[anhpt]

Thank smtalk for your help!


Why would you want to use webalizer over awstats? (curious)
I think both of them are the same but webalizer is a bit easier than awstats to view!

[Henrik]

I think both of them are the same but webalizer is a bit easier than awstats to view!

Hmm, I personally think that Awstats is far superior to webalizer, especially utilizing the plugins (such as geoIP) that are visible inside the configuration file.