More Visitors, More Stats

I can’t quite believe the growth in vis­it­ors to this site. Since I pos­ted about my vis­itor count passing the quarter of a mil­lion mark on June 1st, I have had another 50,000 vis­it­ors tak­ing the total count to well over 300,000! That’s 25,000 vis­it­ors a month. For little old me, I find that quite impress­ive. I’ve also had over half a mil­lion page views in that time. The page views counter passed three and a half mil­lion a while ago.

I know that being one of the feeds to the WordPress dash­board helps, but the vast major­ity of my vis­it­ors still come from search engines. Eleven of my top fif­teen refer­rers are search engines. Of those, Google accounts for a whop­ping 76% of search engine hits. In fact, as I write this, the last 15 minutes has seen 15 unique vis­it­ors 12 of whom are vis­it­ing old pages via search engines.

With all this vis­itor activ­ity, it cer­tainly seems that my page cach­ing is hold­ing out ok. I still get some weird slow-downs on the server, but I think some of that is down to the stat­ist­ics pack­age I use, Power Pphlog­ger is start­ing to creak at the seams. I doesn’t appear that ver­sion 3 is going to appear any time soon, so I’m start­ing to look elsewhere.

15 thoughts on “More Visitors, More Stats

  1. Hi Mac­ManX
    Unfor­tu­nately, I really need the older stats to track over­all totals and longer term trends. My cur­rent sys­tem is stor­ing around 70MB of data!

    Mike

  2. I use PPhlog­ger also (ver 2.2.4) and have no prob­lems with it. It’s cur­rently hold­ing 122Mb of data and while it’s a little slow it still does the job.

    I also have AWStats, it’s default with my host. I rarely use it but it looks ok.

    I have also used AXS:
    http://www.xav.com/scripts/axs/
    It’s a very good script but you’d need to clear out your records frequently.

  3. Hi AJ,
    Unfor­tu­nately, I also need to record more than just my blog pages, so a WP only stat pack­age won’t do.

    Thanks for all the sug­ges­tions folks, I’m look­ing into a few dif­fer­ent pack­ages at the moment.

    Mike

  4. A typ­ical vir­tual account with real­time PHP stats should be able to man­age 50k visitors/day without a prob­lem – if you are hav­ing dif­fi­culty with 25k/month, some sloppy spa­ghetti code could be the cul­prit, either that or MySQL is slow­ing you down – I per­son­ally prefer flat files, as does WebSideStory.

  5. PJ,
    thanks for your com­ments. I think you are right that pphlog­ger should be able to cope. I remem­ber Matt dropped Power Pphlog­ger last year for per­form­ance reas­ons, but I don’t ima­gine my traffic is any­thing like Matt’s!
    I know that my server is not optim­ized in any way. I should look at that too.

  6. Sorry I’m not too famil­iar with this script – but I looked at the fea­ture list… Here are some things that could be slow­ing it down:

    “traceroutes by above.net” This could be slow­ing it down – traceroutes can take some time. You can prob­ably do the traceroutes from your own server to speed things up, but traceroute info isn’t very use­ful any­way – maybe turn it off.

    Maybe shorten this timeout if it’s more than 1 day by default. “stores IP-adress+cookie to avoid mul­tiple hits by the same user (you can set a timeout)” If this script runs in real­time, it could be wast­ing a lot of time scan­ning a big log file each time a new hit comes in. If you’re set­ting a cookie, why use a timeout at all? If the surfer has your cookie already then don’t count the hit as unique – simple – incre­ment your raw count instead.

    “visitor-path” As with the pre­vi­ous fea­ture, this code could be wast­ing a lot of time scan­ning the entire data­base over and over and over again match­ing IP’s… I’m not sure if this runs in real­time or what, but off the top of my head – you could just keep the hit list sor­ted in a flat file, then as new hits come in, just go down the list in order… if there’s a cookie already, then search for a match, then drop it in. In this man­ner, all the repeat vis­its will usu­ally be right at the top of the list, sav­ing a ton of search time… and you would know ahead of time if this was a repeat visit because you can test for the cookie before doing any­thing, and if there’s no cookie yet, set the cookie then add this hit to the top of your list in case they click some­thing else… in sum­mary, keep­ing your hit lists sor­ted saves your script from hav­ing to do much search­ing at all. I would ima­gine this is a lot faster than using mysql.

  7. PJ,
    Pphlog­ger doesn’t do its ana­lysis in real time, it merely logs the inform­a­tion obtained from the javas­cript routine (or what it can glean from the noscript image request) straight to the database.

    The ana­lysis, col­lat­ing stat­ist­ics, put­ting together page history/visitor path, etc. is done after the fact when you view the vari­ous reports.

  8. well i thought I would com­ment as I found your site through google and now have been read­ing, and let me say its been very enter­tain­ing, its like find­ing a needle in a hay­stack, find­ing a great read­able blog!!!

    thanks for mak­ing my night
    hi and have a great day from Aus­tralia
    xx Nicola

  9. I havent been blog­ging very long, but I was run­ning a web page from my home pc for a while, so I used to pay close atten­tion just to the server logs, then added Ned­stats, and then site­meter, both free, but both add some more load time.

  10. Online stats ser­vices like the paid Site­meter are good and fairly fast. Watch out for awstats which had some ser­i­ous secur­ity holes (recently). My server was com­prom­ised through this stats package.

    Thanks TechniCool(Australia)

Leave a Reply

Your email address will not be published. Required fields are marked *

*

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>