I took my 40D, 70-200, 12-24 and 24-105 out for a day on my back on my board without a problem.
I would say that it is 100% dependant on your bag. Mine has very thick straps, solid back support and good waist straps so I really did not have any troubles with it. Chair lifts are a pain though as you are pushed right to the edge.