I find there's near enough zero idiots on TF at the 'ring these days mate, so please don't let that put you off. Even driving round the 'ring at slow speeds is enjoyable. That way you get to experience the sheer pace at which some cars come past you and disappear off into the distance! It still takes me by surprise now and I've been going there for the past 10 years!
I think that with the constant price hikes the majority of idiots have been priced out of it too. When I started going it was circa €8 per lap - for 2014 it's €27! Try and avoid German and Uk bank holidays as well if you go as it's always stupidly busy at those times.
Not just the ring itself that is dearer too, when I started going about 10 years ago it was 5 euros for the pizza I like in pinnochios, at something like 1.5 to a pound at the time that mean it was only about 3 and a bit quid, now its 9 euros which is more like 8 quid, so more than double the price in pounds compared to then.
Similar increases most places to eat over there, although still great value if you are used to london!