Best home security appliance or Linux distro

I want to get control of my home network. I would like a device that can sit between my cable modem and the wifi router so that I can log all traffic without configuring clients. Ideally it would have standard full range of proxy server features and have the ability to detect malware or learn standard network activity and detect anomolies.

I'm willing to drop some coin thought there might be a linux distro that can do all this.

The search engines are a mess and only return irrellevent results and cheap "easy to use" parental control garbage in the results.