store | blogs | forums | twitter | facebook | wiki | mailing lists | downloads | support portal
Atomic Secure Linux
It is currently Sun May 26, 2013 5:35 am

» Feed - Atomicorp

All times are UTC - 5 hours [ DST ]




Post new topic Reply to topic Share/Bookmark  [ 53 posts ]  Go to page Previous  1, 2, 3, 4
Author Message
 Post subject: Re: Apache bus error with mod_security, httpd-debuginfo miss
Unread postPosted: Sat Oct 22, 2011 8:57 pm 
Offline
Forum User
Forum User

Joined: Mon Jan 09, 2006 4:02 pm
Posts: 38
faris wrote:
I don't think it is an FD limit issue.

Also VZ here, and have also had the same problems.

If you reduce the size of the malware blacklist and domain blacklist you'll find the problem will also go away (or at least not happen very often). [ note -- you have to copy your reduced files to /var/asl/rules/modsec or some similar place as they get copied from there into /etc/httpd/modsecurity.d every so often, overwriting any modifications you might make]

Interestingly, since ASL 3.x seems to have improved the situation in some mysterious way. I've not seen a single one since I updated (but I still reduce the malware/domain blacklists).

It appears to therefore be the amount of data in memory that triggers the "bug" - the more there is, the more likely it is to trigger.

In the past I had been looking for some way to use a dnsbl instead of those files, thus removing them from memory, but unfortunately it isn't possible since mod_sec basically has to lookup every single domain in both lists against an url in the request, and this can't be done using adnsbl.

I thought the bug had been narrowed down to APR, anyway? I can't update it on my systems (all Centos 4)


Yeah, it's a memset operation that apr is doing that's failing though - a memory mapped file being created while approaching your FD limit could explain it (but it's a longshot).

Further up this thread it was reported that there is a bug report in the apache bugtracker for this, but I can't find it anywhere. Does anyone know where this is?


Top
 Profile  
 
 Post subject: Re: Apache bus error with mod_security, httpd-debuginfo miss
Unread postPosted: Sat Oct 22, 2011 10:03 pm 
Offline
Atomicorp Staff - Site Admin
Atomicorp Staff - Site Admin
User avatar

Joined: Thu Feb 07, 2008 7:49 pm
Posts: 3249
Location: Chantilly, VA
Quote:
In the past I had been looking for some way to use a dnsbl instead of those files, thus removing them from memory, but unfortunately it isn't possible since mod_sec basically has to lookup every single domain in both lists against an url in the request, and this can't be done using adnsbl.


Actually, we added in that capability into this weekends updates. We'll be pushing that this week. The first DNSBL to be supported is urirbl.com.

And the spam parallel search blocklists will be forked into their own ruleset this week too, so if you dont want to use them you can just disable the entire set. Keep in mind that the parallel search blocklists will always be faster than any DNS lookup and memory is cheap. So always use a cached option over a network lookup options if you can.

All DNSBLs implementations (spamassassin, etc.) suffer from DNS performance and throughput bottlenecks. A DNS lookup will always be much slower than an in memory lookup. Speed of the DNS lookup will be dependent on your DNS servers location and performance (how fast it replies to a query), how fast it asks for information from the authoritative server(s), and of course how quickly the RBL operators system replies.

Therefore, as always, if you use an RBL keep in mind the DNS performance penalty. And make sure you have a fast local DNS server, and if possible a mirror of the zone locally.

These rules will be disabled by default.

We are also working on an RBL for all the malware and spam domains in our blocklists. In our case though we will likely bundle an rbldnsd setup to host the zones locally so you can do rapid lookups on your own system (although not as fast as the current parallel lookup system, theres nothing we can do about that as a network stack is always slower than memory on the system).

_________________
Michael Shinn
Atomicorp - Security For Everyone

Co-Author of Troubleshooting Linux Firewalls.


Top
 Profile  
 
 Post subject: Re: Apache bus error with mod_security, httpd-debuginfo miss
Unread postPosted: Sun Oct 23, 2011 10:48 am 
Offline
Long Time Forum Regular
Long Time Forum Regular

Joined: Thu Dec 09, 2004 11:19 am
Posts: 1846
We already have an rbldnsd installation locally, which we use in conjunction with mod_sec (and spamassassin).

All this sounds extremely exciting! I can't wait to fiddle with some of this, especially if I can just rsync some of the data into our own dnsbl to avoid having multiple installs.

Faris.

_________________
--------------------------------
<advert>
If you want to rent a UK-based VPS that comes with friendly advice and support from a fellow ART fan, please get in touch.
</advert>


Top
 Profile  
 
 Post subject: Re: Apache bus error with mod_security, httpd-debuginfo miss
Unread postPosted: Sun Oct 23, 2011 8:15 pm 
Offline
Atomicorp Staff - Site Admin
Atomicorp Staff - Site Admin
User avatar

Joined: Thu Feb 07, 2008 7:49 pm
Posts: 3249
Location: Chantilly, VA
Quote:
All this sounds extremely exciting! I can't wait to fiddle with some of this, especially if I can just rsync some of the data into our own dnsbl to avoid having multiple installs.


We're going to push the new rule DNSBL rules tomorrow, but they wont be active in the GUI yet. The new rule file is:

31_asl_urispam.conf

If you want to try it before the rule manager and GUI support it, you'll need to manually install it.

_________________
Michael Shinn
Atomicorp - Security For Everyone

Co-Author of Troubleshooting Linux Firewalls.


Top
 Profile  
 
 Post subject: Re: Apache bus error with mod_security, httpd-debuginfo miss
Unread postPosted: Fri Jun 08, 2012 7:12 pm 
Offline
Long Time Forum Regular
Long Time Forum Regular

Joined: Sat Aug 20, 2005 9:30 am
Posts: 2812
Location: The Netherlands
mikeshinn wrote:
The art builds all have the debug-info, I seem to recall the centos project was missing theirs.


Only just now did I notice /etc/yum.repos.d/CentOS-Debuginfo.repo where one can enable the repository with *-debuginfo packages.

If you install the yum-utils repository you should also be able to run debuginfo-install httpd to install all required *-debuginfo packages, but because of a bug this command does not automatically enable the correct repository (since its name doesn't end in '-debuginfo', I'll report this to CentOS), so that's why you'll need to enable the repository in /etc/yum.repos.d/CentOS-Debuginfo.repo manually for now.

_________________
Lemonbit Internet Dedicated Server Management


Top
 Profile  
 
 Post subject: Re: Apache bus error with mod_security, httpd-debuginfo miss
Unread postPosted: Fri Jun 08, 2012 7:23 pm 
Offline
Long Time Forum Regular
Long Time Forum Regular

Joined: Sat Aug 20, 2005 9:30 am
Posts: 2812
Location: The Netherlands
breun wrote:
I'll report this to CentOS


For those interested: http://bugs.centos.org/view.php?id=5768

_________________
Lemonbit Internet Dedicated Server Management


Top
 Profile  
 
 Post subject: Re: Apache bus error with mod_security, httpd-debuginfo miss
Unread postPosted: Fri Jun 08, 2012 7:39 pm 
Offline
Long Time Forum Regular
Long Time Forum Regular

Joined: Sat Aug 20, 2005 9:30 am
Posts: 2812
Location: The Netherlands
There's no php-debuginfo package in atomic?

_________________
Lemonbit Internet Dedicated Server Management


Top
 Profile  
 
 Post subject: Re: Apache bus error with mod_security, httpd-debuginfo miss
Unread postPosted: Sat Jun 09, 2012 9:20 am 
Offline
Atomicorp Staff - Site Admin
Atomicorp Staff - Site Admin

Joined: Wed Dec 31, 1969 8:00 pm
Posts: 7429
Location: earth
I dont normally do the debuginfo packages for space reasons


Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic Share/Bookmark  [ 53 posts ]  Go to page Previous  1, 2, 3, 4

» Feed - Atomicorp

All times are UTC - 5 hours [ DST ]


Who is online

Users browsing this forum: No registered users and 2 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group