OK, to capture all this feedback as features, heres what I have so far:
1) Support older versions of ASL for longer. ( i.e. rules only - for 7 to 14 days ) (Comment from Mike: I think the solution on this one is to make it possible for people to run older versions. If you are running an older version, thats your business. Maybe we fork the rules if we need to put something out thats ASL version specific. Point taken.)
2) Option to update rules, but not ASL automatically. Another request was to make this the default behavior. (Comment: Done, we are adding this in as we speak and it will be in a future version of ASL soon)
3) On detection of "old/incompatible" asl version<->rules send an e-mail notification to admin informing them of the update instead of running it. (and extension of #1 and #2 above?) (Comment: a little more work... something we need to think about how to manage, forking will tie into this at some point, see #4 below)
4) Fork the rules when new versions require features in newer version of ASL. (Original request: When a new ASL version or component comes out, do not immediately release rules that only work with it. Wait 7 to 14 days before doing so. In the meantime continue to release rules that work with both old and new.) I think forking might make more sense. (Comment on this one: Not all rules will work with older version of mod_security, for example, so running older versions will mean that some features will not work, so keep that in mind: old = potentially vulnerable if we fork - nevertheless, yep, we will do this too).
5) Allow ASL to be configured to not only allow root logins but to not warn or send any alerts that the system is configured in this way. (Comment: This one makes me nervous, I dont want someone to disable an alert without some work... feedback appreciated on this one, I can see this potentially backfiring)
6) Allow ASL to be configured to hide specific vulnerabilities and to report the system as not vulnerable (for example, if you are running a vulnerable kernel allow the user to disable the alert and hide the vulnerability). (Comment: See #5, I think I know whats being asked for, basically an ignore button... )
7) add a weekly cron job that updates components, timed to happen when ASL support is officially open (i.e. not a weekend). Note: Delay ASL releases to only happen during the week, presumably on a Monday. (comment: done, we'll delay ASL releases to Mondays or something like that. We'll probably make the final available right away on the testing channels for those that prefer to use the final build when it comes out of Beta)

Delay release of new rules 7 to 14 days later that require new ASL features, start to release rules that require the new version. (Comment: Appreciate the sentiment on this, but I dont think its necessary. Forking makes more sense to me where, theres no need to delay new feature that closes a serious vulnerability, if users want to keep running older versions forking makes more sense rather than forcing everything to stay vulnerable for two weeks)
Anything else?