It can get tedious to set up forum permissions if you have a lot of groups and/or a lot of forum categories. Perhaps an extra checkbox that when toggled checks or unchecks every group in permission columns. Mock up here...
Try clicking the group name in the left-most column, it will assign all permissions for that group. I can look into adding similar functionality vertically in the table.