In my experience (IPFire 64 bit), you need 3GB RAM to run ClamAV & Web Proxy/URL Filter - so as not to page to storage. System will run on 2GB, but paging slows responsiveness a lot.
I have most of mine on 4GB (2x 2GB matching pair to take advantage of memory interleaving).