Original Poster Posted September 15, 2014 Share Posted September 15, 2014 hello, I am trying to find the best light weight application to rip the squid access logs to just see the top websites people are visiting.... I could write it my self but there is a lot of data coming in from a single site, and I think someone has spent weeks in building a squid cache analytics rather than the day I want to put into it. so yea any suggestions/reviews on squid access analytical applications? or even a good regular expression I could use in my own program? Link to comment Share on other sites More sharing options...
The_Decryptor Veteran Posted September 15, 2014 Veteran Share Posted September 15, 2014 Parse the log file, normalise the URLs, and sort them by the amount of times they show. Link to comment Share on other sites More sharing options...
Original Poster Posted September 15, 2014 Author Share Posted September 15, 2014 Parse the log file, normalise the URLs, and sort them by the amount of times they show. wont this mess up seeing as links are called from the site to images? this is what I have trouble understanding about the log, I can see the connection and then multiple ad and image links with the same base url appear :( just trying to get the stats of the landing page, and then how do I decide its a unique visit ? 1 person spamming a page would mess up data collection :( Link to comment Share on other sites More sharing options...
ehlo Posted September 15, 2014 Share Posted September 15, 2014 The AWStats web statistics script should do what you want? :) Edit: Also, http://www.squid-cache.org/Misc/log-analysis.html Link to comment Share on other sites More sharing options...
Original Poster Posted September 16, 2014 Author Share Posted September 16, 2014 The AWStats web statistics script should do what you want? :) Edit: Also, http://www.squid-cache.org/Misc/log-analysis.html I decided to write it my self in php....explodes and reg_ex :P lots of regex Link to comment Share on other sites More sharing options...
smooth_criminal1990 Posted September 16, 2014 Share Posted September 16, 2014 There's a nice web GUI called MySAR (MySQL Squid Access Report) if you get bored :D http://sourceforge.net/projects/mysar/ Link to comment Share on other sites More sharing options...
Recommended Posts