Recent Topics
  1. b2evolution CMS Support Forums
  2. b2evolution Support
  3. General Support
  4. [2.x] Hitlog & Session tables FULL in dB

[2.x] Hitlog & Session tables FULL in dB

1 Apr 04, 2009 12:57    

My b2evolution Version: 2.x

How do I prevent the hit and session logs from filling up my sql database?

Some time within the last 12 hours, my blog went from working great to being replaced by this error (dB name and IP removed):

An unexpected error has occured!

If this error persits, please report it to the administrator.

Go back to home page
Additional information about this error:

MySQL error!

INSERT command denied to user 'dBUsername'@'xxx.xxx.xxx.xxx' for table 'evo_sessions'(Errno=1142)

Your query:

INSERT INTO evo_sessions( sess_key, sess_lastseen, sess_ipaddress )
        

VALUES (
          '9pxs2r0px8Qjkx69tvprDoryEhGRuwnT',
          '2009-04-04 03:04:30',
          'xxx.xxx.xxx.xxx'
        )

I recognized that the error meant the dB was NOT accepting new insertions so I checked with my host cP and I discovered that the mySQL dB was 50% (50 MB) over the 100MB limit because the session and hitlog tables were ginormous. The sessions table was 604,733 rows and the hitlog table was 543,103. Each table was taking up about 75 MB EACH, which pushed me over the 100 MB and nuked my dB.

Before I emptied the sessions and hitlog tables, I took a quick look and it seems like my blog was getting hit every 30 secs or less, ever since I switched to 2.4.5 in December (and then 2.4.6 in January). I did the math and it seems like that's about right:

4 (months) x 30 (days) x 24 (hours) x 60 (minutes) x 2 or 3 (times a minute) = 345600 to 518400 hits

Now I don't think my blog is THAT popular so this seems like some sort of bot attack or something.

Thankfully my blog returned to normal about 30 minutes after I emptied the sessions and hitlog tables (which dropped the sql dB down to a measly 3.5 MB), but I want to know how can I prevent this from happening again?

Back to top

2 Apr 04, 2009 13:05

Empty the database table evo-hitlog

It will fill up again but it does no harm to flush it out now and then.

Back to top

3 Apr 04, 2009 13:10

WTF!?!?

OK, so in the 10 minutes between the time my blog started working again and when I posted here, my blog got over 30 hits, mostly from the same IP addresses (again I remove my IP cuz I'm paranoid like that):

-- 
-- Dumping data for table `evo_sessions`
-- 

INSERT INTO `evo_sessions` VALUES (1, '6WPHT5ka5Fqqod5dKvX4gFfnIOtdnIMu', '2009-04-04 03:44:23', '209.85.238.18', NULL, NULL, NULL);
INSERT INTO `evo_sessions` VALUES (2, 'X2QfbzkcPwfMndFup2XaVTGetCW1rbgJ', '2009-04-04 03:44:38', '72.30.161.249', NULL, NULL, NULL);
INSERT INTO `evo_sessions` VALUES (3, 'EIrgK25TPmd311zwNkJXS3pZQJdckmyF', '2009-04-04 03:44:39', '64.1.215.165', NULL, NULL, NULL);
INSERT INTO `evo_sessions` VALUES (4, 'RanHeGuW4x7uF0mqw3vp1yNnuqeRYgLK', '2009-04-04 03:44:45', '72.30.161.252', NULL, NULL, NULL);
INSERT INTO `evo_sessions` VALUES (5, 'J9tX4y6ox1ZOegnFwE3RWlPfGRBAwPlM', '2009-04-04 03:44:59', '72.30.161.249', NULL, NULL, NULL);
INSERT INTO `evo_sessions` VALUES (6, 'vCpJ14sEpw5SPqlxIwG536vwYYprGVPH', '2009-04-04 03:45:37', '64.1.215.164', NULL, NULL, NULL);
INSERT INTO `evo_sessions` VALUES (7, 'j8fkBj7SjEFtrpzZ2sUqkoxNsf2LpKBY', '2009-04-04 03:46:03', '64.1.215.166', NULL, NULL, NULL);
INSERT INTO `evo_sessions` VALUES (8, 'hru6EuKYPmII9dKNTVZKELPWz83qMnJ1', '2009-04-04 03:46:44', '66.249.73.145', NULL, NULL, NULL);
INSERT INTO `evo_sessions` VALUES (9, 'Zvculy2GtkcV6ObqvaCLCf0I8KOuknKV', '2009-04-04 03:47:19', '74.6.8.124', NULL, NULL, NULL);
INSERT INTO `evo_sessions` VALUES (10, 'AtEzbnIJjO0krcVsFOrdnUJLZqMkQrPm', '2009-04-04 03:47:24', '64.1.215.164', NULL, NULL, NULL);
INSERT INTO `evo_sessions` VALUES (11, 'Pu59pdzyiz7KEWrrCKAbyjA32UNIV062', '2009-04-04 03:47:45', '64.1.215.166', NULL, NULL, NULL);
INSERT INTO `evo_sessions` VALUES (12, 'hWv2Z6fbiibCrVhWNRRTI2jkDCs8d2lM', '2009-04-04 03:47:51', '72.30.161.249', NULL, NULL, NULL);
INSERT INTO `evo_sessions` VALUES (13, '6w2HYdLpGkMVZzOuLWhi47zpRyEDrRtj', '2009-04-04 03:55:18', 'xxx.xxx.xxx.xxx', 1, NULL, NULL);
INSERT INTO `evo_sessions` VALUES (14, '8tMlVx3gEqj9s2wgVq2RpJgA2vfcrAB9', '2009-04-04 03:48:37', '66.249.71.212', NULL, NULL, NULL);
INSERT INTO `evo_sessions` VALUES (15, 'XpQWxEuOpvcZQYJ2HbN4Zrx0bVrGM7qt', '2009-04-04 03:49:08', '64.1.215.166', NULL, NULL, NULL);
INSERT INTO `evo_sessions` VALUES (16, '0tt2Whe3PQ3pK2KcUf4QJWC7NREjiYuB', '2009-04-04 03:49:10', '64.1.215.164', NULL, NULL, NULL);
INSERT INTO `evo_sessions` VALUES (17, 'xtnIC24D2U1xfwBlFtKog90wrYVaPYgb', '2009-04-04 03:49:21', '66.249.73.145', NULL, NULL, NULL);
INSERT INTO `evo_sessions` VALUES (18, 'mJMa3yOjzIpmgNr5WZmofxI7z9tzK3CF', '2009-04-04 03:49:23', '66.249.73.145', NULL, NULL, NULL);
INSERT INTO `evo_sessions` VALUES (19, 'b5WbqvPqx6YWW5e9Upt4WSdg8wukUKvE', '2009-04-04 03:49:26', '66.249.73.145', NULL, NULL, NULL);
INSERT INTO `evo_sessions` VALUES (20, 'QK6tENf9GVsYaI3t89D8NQ5aIjmUGJWc', '2009-04-04 03:49:29', '66.249.73.145', NULL, NULL, NULL);
INSERT INTO `evo_sessions` VALUES (21, 'SlLXh516vEjGOU8wOkBL5vMgFM12SIi4', '2009-04-04 03:49:45', '72.30.161.249', NULL, NULL, NULL);
INSERT INTO `evo_sessions` VALUES (22, 'hHqFZPOO8zk5JtobtLiBRBewvsiyVXpQ', '2009-04-04 03:50:04', '66.249.73.145', NULL, NULL, NULL);
INSERT INTO `evo_sessions` VALUES (23, 'aFSUCLqr0Mfzv9vpJCPvru3CMQZKRBUT', '2009-04-04 03:50:32', '66.249.73.145', NULL, NULL, NULL);
INSERT INTO `evo_sessions` VALUES (24, 'vhHU1bFKutGx31cLHNdLvcORUaXXM1nQ', '2009-04-04 03:50:35', '66.249.73.145', NULL, NULL, NULL);
INSERT INTO `evo_sessions` VALUES (25, 'Ee9LWKw59o9x6H3ZDsFDrmdLDy8QINRo', '2009-04-04 03:50:37', '64.1.215.166', NULL, NULL, NULL);
INSERT INTO `evo_sessions` VALUES (26, 'HFCEwcKb98UUP66IGnsBciU2smDxQDR4', '2009-04-04 03:50:48', '64.1.215.164', NULL, NULL, NULL);
INSERT INTO `evo_sessions` VALUES (27, 'pXEiwXqyj5OzoTIAo8Mszj8qnpq62qfX', '2009-04-04 03:51:58', '64.1.215.166', NULL, NULL, NULL);
INSERT INTO `evo_sessions` VALUES (28, 'bWUR1flASu5X1NgKqGjUJxL8ROn2VeHd', '2009-04-04 03:52:08', '66.249.73.145', NULL, NULL, NULL);
INSERT INTO `evo_sessions` VALUES (29, 'CtrAQmsaIASqbqo0l4WbT4DbfcTsM6ZB', '2009-04-04 03:52:27', '64.1.215.164', NULL, NULL, NULL);
INSERT INTO `evo_sessions` VALUES (30, 'TLmIk5yS8ymitS5IFJzzHTd6GTVm6TVF', '2009-04-04 03:53:34', '66.249.73.145', NULL, NULL, NULL);
INSERT INTO `evo_sessions` VALUES (31, 'cTzJResFIT3NPXISOBKBoehJ0OKZ1K9X', '2009-04-04 03:53:46', '66.249.73.145', NULL, NULL, NULL);
INSERT INTO `evo_sessions` VALUES (32, 'oh5p80ptsaRzXplbI0eWDQui5Z20nQ2x', '2009-04-04 03:53:52', '64.1.215.164', NULL, NULL, NULL);
INSERT INTO `evo_sessions` VALUES (33, 'Cin3xKaGrNvpGsJuFduVwx4xrPyp4Q4p', '2009-04-04 03:54:15', '74.125.44.136', NULL, NULL, NULL);
INSERT INTO `evo_sessions` VALUES (34, 'k9vWdQEKmlqydql7VggwGN3jK3drS2x9', '2009-04-04 03:55:06', '72.30.161.249', NULL, NULL, NULL);
INSERT INTO `evo_sessions` VALUES (35, 'odo5hCoFzBOm7QiTgyXC5CGa23u4eYj6', '2009-04-04 03:55:23', '66.249.73.145', NULL, NULL, NULL);
INSERT INTO `evo_sessions` VALUES (36, 'LU8vB2cRsvAhWR84YYBblgftdpNwCYLi', '2009-04-04 03:55:25', '66.249.73.145', NULL, NULL, NULL);
INSERT INTO `evo_sessions` VALUES (37, 'UhUifGTPILxhuhoSkeQq6uIHHOKbjUJV', '2009-04-04 03:55:34', '74.6.8.124', NULL, NULL, NULL);
INSERT INTO `evo_sessions` VALUES (38, 'ZCknqj0tldl3Cw0mDYLDwvGXfQjQOSOF', '2009-04-04 03:56:15', '72.30.161.249', NULL, NULL, NULL);


-- 
-- Dumping data for table `evo_hitlog`
-- 

INSERT INTO `evo_hitlog` VALUES (1, 1, '2009-04-04 03:44:23', '/xmlsrv/atom.php?blog=16', 'direct', '', NULL, 16, '209.85.238.18', 5067);
INSERT INTO `evo_hitlog` VALUES (2, 2, '2009-04-04 03:44:38', '/blog/quotes.php?blog=15&disp=catdir&newstyle=day', 'direct', '', NULL, 15, '72.30.161.249', 9);
INSERT INTO `evo_hitlog` VALUES (3, 3, '2009-04-04 03:44:39', '/blog/index.php/?blog=1&paged=57&newstyle=night', 'direct', '', NULL, 1, '64.1.215.165', 26);
INSERT INTO `evo_hitlog` VALUES (4, 4, '2009-04-04 03:44:45', '/?blog=1&paged=16&newstyle=night', 'direct', '', NULL, 1, '72.30.161.252', 9);
INSERT INTO `evo_hitlog` VALUES (5, 5, '2009-04-04 03:44:59', '/blog/links.php/2009/09/', 'direct', '', NULL, 9, '72.30.161.249', 9);
INSERT INTO `evo_hitlog` VALUES (6, 6, '2009-04-04 03:45:37', '/links.php/1985/10/', 'direct', '', NULL, 9, '64.1.215.164', 26);
INSERT INTO `evo_hitlog` VALUES (7, 7, '2009-04-04 03:46:03', '/blog/life.php/1997/10/?blog=5&m=199710&newstyle=day', 'direct', '', NULL, 5, '64.1.215.166', 26);
INSERT INTO `evo_hitlog` VALUES (8, 8, '2009-04-04 03:46:44', '/index.php/2009/02/05/', 'direct', '', NULL, 1, '66.249.73.145', 6);
INSERT INTO `evo_hitlog` VALUES (9, 9, '2009-04-04 03:47:19', '/blog/index.php/2010/01/', 'direct', '', NULL, 1, '74.6.8.124', 9);
INSERT INTO `evo_hitlog` VALUES (10, 10, '2009-04-04 03:47:24', '/dreams.php?disp=msgform&recipient_id=1&redirect_to=http%3A%2F%2Fblog.joshuajmorgan.com%2Fdreams.php%3Fblog%3D2%26disp%3Darcdir', 'direct', '', NULL, 2, '64.1.215.164', 26);
INSERT INTO `evo_hitlog` VALUES (11, 11, '2009-04-04 03:47:45', '/blog/friends.php/1997/04/?blog=11&m=199704&newstyle=night', 'direct', '', NULL, 11, '64.1.215.166', 26);
INSERT INTO `evo_hitlog` VALUES (12, 12, '2009-04-04 03:47:51', '/blog/life.php/c44/', 'direct', '', NULL, 5, '72.30.161.249', 9);
INSERT INTO `evo_hitlog` VALUES (13, 13, '2009-04-04 03:48:05', '/blog/', 'direct', '', NULL, 1, 'xxx.xxx.xxx.xxx', 5198);
INSERT INTO `evo_hitlog` VALUES (14, 13, '2009-04-04 03:48:10', '/blog/', 'direct', '', NULL, 1, 'xxx.xxx.xxx.xxx', 5198);
INSERT INTO `evo_hitlog` VALUES (15, 14, '2009-04-04 03:48:37', '/blog/links.php/2008/08/?blog=9&m=200808&newstyle=night', 'direct', '', NULL, 9, '66.249.71.212', 6);
INSERT INTO `evo_hitlog` VALUES (16, 15, '2009-04-04 03:49:08', '/blog/filmdiary.php?disp=msgform&recipient_id=1&redirect_to=http%3A%2F%2Fwww.joshuajmorgan.com%2Fblog%2Ffilmdiary.php%2F2005%2F09%2F12%2Ffilm_diary_my_sassy_girl_jae_young_kwak%3Fblog%3D3%26title%3Dfilm_diary_my_sassy_girl_jae_young_kwak%26disp%3Dsin', 'direct', '', NULL, 3, '64.1.215.166', 26);
INSERT INTO `evo_hitlog` VALUES (17, 16, '2009-04-04 03:49:10', '/friends.php/2038/09/', 'direct', '', NULL, 11, '64.1.215.164', 26);
INSERT INTO `evo_hitlog` VALUES (18, 17, '2009-04-04 03:49:21', '/blog/index.php/1915/09/?blog=1&m=191509&posts=100&newstyle=day', 'direct', '', NULL, 1, '66.249.73.145', 6);
INSERT INTO `evo_hitlog` VALUES (19, 18, '2009-04-04 03:49:23', '/life.php/2212/07/?blog=5&m=221207&paged=7&newstyle=day', 'direct', '', NULL, 5, '66.249.73.145', 6);
INSERT INTO `evo_hitlog` VALUES (20, 19, '2009-04-04 03:49:26', '/blog/josh.php/2216/12/?blog=12&m=221612&newstyle=night', 'direct', '', NULL, 12, '66.249.73.145', 6);
INSERT INTO `evo_hitlog` VALUES (21, 20, '2009-04-04 03:49:29', '/rssfeeds.php/2168/01/?blog=16&m=216801&paged=4&newstyle=day', 'direct', '', NULL, 16, '66.249.73.145', 6);
INSERT INTO `evo_hitlog` VALUES (22, 21, '2009-04-04 03:49:45', '/blog/index.php/2005/09/', 'direct', '', NULL, 1, '72.30.161.249', 9);
INSERT INTO `evo_hitlog` VALUES (23, 22, '2009-04-04 03:50:04', '/lux.php', 'direct', '', NULL, 17, '66.249.73.145', 6);
INSERT INTO `evo_hitlog` VALUES (24, 23, '2009-04-04 03:50:32', '/rssfeeds.php/2005/11/03/americablog', 'direct', '', NULL, 16, '66.249.73.145', 6);
INSERT INTO `evo_hitlog` VALUES (25, 24, '2009-04-04 03:50:35', '/blog/dreams.php/2116/08/?blog=2&m=211608&posts=100&newstyle=night', 'direct', '', NULL, 2, '66.249.73.145', 6);
INSERT INTO `evo_hitlog` VALUES (26, 25, '2009-04-04 03:50:37', '/blog/index.php/1994/03/?blog=1&m=199403&newstyle=night', 'direct', '', NULL, 1, '64.1.215.166', 26);
INSERT INTO `evo_hitlog` VALUES (27, 26, '2009-04-04 03:50:48', '/index.php/2004/?blog=1&paged=69', 'direct', '', NULL, 1, '64.1.215.164', 26);
INSERT INTO `evo_hitlog` VALUES (28, 27, '2009-04-04 03:51:58', '/blog/life.php/1993/04/?blog=5&m=199304&newstyle=day', 'direct', '', NULL, 5, '64.1.215.166', 26);
INSERT INTO `evo_hitlog` VALUES (29, 29, '2009-04-04 03:52:27', '/index.php/2036/06/', 'direct', '', NULL, 1, '64.1.215.164', 26);
INSERT INTO `evo_hitlog` VALUES (30, 30, '2009-04-04 03:53:34', '/index.php/2005/11/20/bandwidth_exceeded_selling_out', 'direct', '', NULL, 1, '66.249.73.145', 6);
INSERT INTO `evo_hitlog` VALUES (31, 31, '2009-04-04 03:53:46', '/rssfeeds.php/2314/03/?blog=16&m=231403&paged=3&newstyle=day', 'direct', '', NULL, 16, '66.249.73.145', 6);
INSERT INTO `evo_hitlog` VALUES (32, 32, '2009-04-04 03:53:52', '/filmdiary.php/1999/12/', 'direct', '', NULL, 3, '64.1.215.164', 26);
INSERT INTO `evo_hitlog` VALUES (33, 33, '2009-04-04 03:54:15', '/blog/index.php?tempskin=_rss2', 'direct', '', NULL, 1, '74.125.44.136', 38);
INSERT INTO `evo_hitlog` VALUES (34, 34, '2009-04-04 03:55:06', '/blog/quotes.php?blog=15&disp=comments&newstyle=day', 'direct', '', NULL, 15, '72.30.161.249', 9);
INSERT INTO `evo_hitlog` VALUES (35, 35, '2009-04-04 03:55:23', '/quotes.php/2058/03/?blog=15&m=205803&paged=11&newstyle=day', 'direct', '', NULL, 15, '66.249.73.145', 6);
INSERT INTO `evo_hitlog` VALUES (36, 36, '2009-04-04 03:55:25', '/blog/friends.php/2004/05/?blog=11&m=200405&newstyle=night', 'direct', '', NULL, 11, '66.249.73.145', 6);
INSERT INTO `evo_hitlog` VALUES (37, 37, '2009-04-04 03:55:34', '/blog/life.php/2009/02/', 'direct', '', NULL, 5, '74.6.8.124', 9);
INSERT INTO `evo_hitlog` VALUES (38, 38, '2009-04-04 03:56:15', '/blog/quotes.php/2005/12/13/brian_wilson_gordon_by_barenaked_ladies_2', 'direct', '', NULL, 15, '72.30.161.249', 9);
INSERT INTO `evo_hitlog` VALUES (39, 39, '2009-04-04 03:57:00', '/blog/josh.php?disp=msgform&recipient_id=1&redirect_to=http%3A%2F%2Fblog.joshuajmorgan.com%2Fjosh.php%2F2111%2F04%2F%3Fblog%3D12', 'direct', '', NULL, 12, '66.249.73.145', 6);
INSERT INTO `evo_hitlog` VALUES (40, 40, '2009-04-04 03:57:14', '/quotes.php/2005/09/25/tyler_durden_brad_pitt_in_fight_club_6?blog=15&paged=20', 'direct', '', NULL, 15, '64.1.215.164', 26);
INSERT INTO `evo_hitlog` VALUES (41, 41, '2009-04-04 03:57:20', '/blog/life.php/2003/12/04/?blog=5&m=20031204&newstyle=day', 'direct', '', NULL, 5, '66.249.73.145', 6);
INSERT INTO `evo_hitlog` VALUES (42, 42, '2009-04-04 03:58:17', '/friends.php?tempskin=_rss2&disp=comments&p=58', 'direct', '', NULL, 11, '66.249.73.145', 20);
INSERT INTO `evo_hitlog` VALUES (43, 43, '2009-04-04 03:58:24', '/blog/life.php?blog=5&paged=4&newstyle=night', 'direct', '', NULL, 5, '72.30.161.249', 9);
INSERT INTO `evo_hitlog` VALUES (44, 44, '2009-04-04 03:58:28', '/blog/josh.php/2005/11/15/stick_fighter_at_newgrounds_com', 'referer', 'http://boards.nbc.com/nbc/index.php?showuser=351636', 453, 12, '24.47.125.207', 189);
INSERT INTO `evo_hitlog` VALUES (45, 45, '2009-04-04 03:58:33', '/lux.php/2368/12/?blog=17&m=236812&newstyle=night', 'direct', '', NULL, 17, '66.249.73.145', 6);
INSERT INTO `evo_hitlog` VALUES (46, 46, '2009-04-04 03:58:46', '/blog/josh.php/2009/05/', 'direct', '', NULL, 12, '67.195.37.91', 9);
INSERT INTO `evo_hitlog` VALUES (47, 47, '2009-04-04 03:59:16', '/lux.php/2004/09/', 'direct', '', NULL, 17, '66.249.73.145', 6);
INSERT INTO `evo_hitlog` VALUES (48, 48, '2009-04-04 03:59:28', '/filmdiary.php/1996/12/', 'direct', '', NULL, 3, '64.1.215.164', 26);
INSERT INTO `evo_hitlog` VALUES (49, 49, '2009-04-04 03:59:52', '/blog/links.php/2005/03/22/man_my_brain_is_tired', 'direct', '', NULL, 9, '72.30.161.249', 9);
INSERT INTO `evo_hitlog` VALUES (50, 50, '2009-04-04 04:00:12', '/blog/josh.php?disp=msgform&recipient_id=1&redirect_to=http%3A%2F%2Fblog.joshuajmorgan.com%2Fjosh.php%2F2059%2F10%2F%3Fblog%3D12', 'direct', '', NULL, 12, '66.249.73.145', 6);
INSERT INTO `evo_hitlog` VALUES (51, 51, '2009-04-04 04:00:43', '/blog/life.php?disp=msgform&recipient_id=1&redirect_to=http%3A%2F%2Fjoshuajmorgan.com%2Fblog%2Flife.php%2F2009%2F03%2F%3Fblog%3D5%26m%3D200903', 'direct', '', NULL, 5, '64.1.215.166', 26);
INSERT INTO `evo_hitlog` VALUES (52, 52, '2009-04-04 04:01:11', '/blog/rssfeeds.php/1857/', 'direct', '', NULL, 16, '66.249.73.145', 6);
INSERT INTO `evo_hitlog` VALUES (53, 53, '2009-04-04 04:01:46', '/blog/josh.php?disp=msgform&recipient_id=1&redirect_to=http%3A%2F%2Fblog.joshuajmorgan.com%2Fjosh.php%2F1970%2F05%2F%3Fblog%3D12', 'direct', '', NULL, 12, '66.249.73.145', 6);
INSERT INTO `evo_hitlog` VALUES (54, 54, '2009-04-04 04:01:51', '/life.php/2004/05/?blog=5&m=200405&paged=5&newstyle=night', 'direct', '', NULL, 5, '64.1.215.164', 26);
INSERT INTO `evo_hitlog` VALUES (55, 55, '2009-04-04 04:02:24', '/blog/rssfeeds.php?tempskin=_rss2&disp=comments&p=896', 'direct', '', NULL, 16, '72.30.161.249', 98);
INSERT INTO `evo_hitlog` VALUES (56, 56, '2009-04-04 04:02:38', '/blog/rssfeeds.php/2039/11/?blog=16&m=203911&page=1&disp=posts&newstyle=day',

This is clearly going to just keep happening unless I can stop these spam bots and/or I can constantly clear my hitlog and sessions (a cronjob maybe?).

Back to top

4 Apr 04, 2009 13:13

John wrote:

Empty the database table evo-hitlog

It will fill up again but it does no harm to flush it out now and then.

Yeah, I did that but it's already filling at a rapid rate.

Can I ban these IPs?

Back to top

5 Apr 04, 2009 13:19

Bugger.... I've found that they come and then they go....

It's a bit like a storm...
Have you done anything with banning via the anti spam settings

life.php, josh.php etc etc

Back to top

6 Apr 04, 2009 13:21

OK, so I definitely can't ban these IPs because I just looked up addresses and they are all search engine spider crawl bots for google, yahoo, msn, cuil, etc.

So what can I do?

Back to top

7 Apr 04, 2009 13:26

Well, sit back and wait... if it's simply a huge search engine crawl, it will/should/might subside.

Back to top

8 Apr 04, 2009 13:33

Hi StayPuft,

This is all 'normal behaviour'. Please don't panic.
The hitlog table in the DB may grow large / hughe over time. You can empty it through command line or tool (PHPMyAdmin).
Also you can try to set up a cron job to do so. Go to dashboard -> System -> Schedule and look for something like this:

http://www.blog.hemminga.net/B2evoforum/prune.png

You may also be able to set up a cron job through the Administration Panel of your host.

Good luck

Back to top

9 Apr 04, 2009 14:05

Yeah, sorry to panic. It's just that I was on my way to bed when I checked my blog and saw that it was bustimicated so my tired brain kinda freaked out. 88|

The weird thing is I already had a repeating "Prune old hits & sessions" job scheduled for every 30 days, but it never ran. Even when I check "Finished" in the filter, it just lists the "pending" planned job from 3 months ago.

And when I clicked "[Execute pending jobs in a popup window now!]", it said it was successful, but the hitlog and sessions are all still there. Is there something I'm missing about the way the scheduler works?

When I first started using b2evo 5 years ago, I was running cron jobs on my my server, but my current host / plan doesn't support them.

Oh well, I guess I'll just have to remember to manually empty the tables in phpmyadmin if I can't get the Scheduler to work...

Thanks for talking me down guys!

:D

Now that the sun is about to come up, I should probably go to bed...

Back to top

10 Apr 04, 2009 16:48

The hit log table also cleans itself after the amount of time specified for for how many days of hit logging you want to see in your stats. I forget where to set that though. It's in the back office though.

Sessions unfortunately don't clean automagically unless you have the ability to run a cron job through the scheduler. basedomains is another one that will slowly and perpetually fill with junk.

Seems to me both sessions and basedomains should clear with the hitlog table on the timeline effected by the "save this many days of hits" ... but it doesn't. I do it via phpmyadmin because the scheduler simply doesn't work for me.

Back to top

11 Apr 04, 2009 22:25

Oops! My bad! In v2.4.6 the sessions table and hitlog table are pruned based on the number of days you opt to keep hits for on one of the sub-tabs under "Global settings". So if you have that set to 0 then you are telling it to never prune. And if you want a cron job to handle it every 30 days why not just tell the Global settings "prune after" feature to prune after 30 days?

It should work?

Back to top

12 Apr 04, 2009 22:59

Thanks EdB. I found the "Hit & session logging" setting under "Global settings > Features" and I had it set to:

Log hits:
* on every public page

Auto pruning:
* With a scheduled job

Prune after:
* 15 days

I thought I had the Scheduler set up to prune every 30 days, but after reading the Scheduler help (http://manual.b2evolution.net/Scheduler) it looks like b2evo itself doesn't ever automatically execute "cron/cron_exec.php" at scheduled times, it merely keeps a queue a of scheduled jobs to execute IF you have a cron manually configured elsewhere to execute "cron/cron_exec.php". This detail should be made very explicit in the Scheduler settings in future versions because I saw "Scheduler" and thought all I had to do was create a new job to make it work automatically.

As much as I'd like to get the Scheduler working automatically, I'm going to change the "Hit & session logging > Auto pruning" back to the default "On every page" but I'm curious, just how much "extra resources" does this setting use?

Thanks again guys.

Back to top

13 Apr 05, 2009 00:43

StayPuft wrote:

... just how much "extra resources" does this setting use?

Thanks again guys.

Dunno. There used to be a hack that made it happen only "on every page load during a certain time of day", and I thought that somehow that is what it did now. Meaning when the day rolled over it would finally look and purge out older stuff.

Not much help I guess, but maybe an astute observer could see if their hits are being pruned minute-by-minute, or if they only go away in full-day blocks when the setting+1 day happens.

Back to top

14 Apr 05, 2009 09:07

Yay!

I can now confirm that hitlog and sessions get pruned after midnite local time. At that point the N+1 day of logging begins, meaning here it is one minute after midnite and I have 15 full days of stats traffic, with the 16th day beginning to collect data.

Back to top

15 Apr 05, 2009 09:16

Awesome, thanks for confirming how the hit & session log auto pruning works, EdB!

Back to top


Form is loading...