I, too, have started w/GENERIC and commented out h/w I don't have; these days, I don't bother, because we have plenty of memory & disk (relatively on modern machines). AND, if you (can) stick w/GENERIC -- then you can compare against the Official Release if there are problems.
Another reason I don't often mess w/GENERIC config is: the whole 'config' mechanism seems kinda brittle. I often break a config by doing things that seem obvious to me, but don't work.
My advice: Stick with GENERIC, if you can; and add in / uncomment lines for the extra support you need.