I believe that the brawler should only be either man or dwarf(stoutaxe included), and maybe hobbits but not to elves or high elves. This is not due to any gameplay issues but rather lore issues. I may be wrong but i dont believe any elf would lower themselves to "brawling" as they are too dignifed. The would see "brawling" as inelegant, too unrefined, too uncivilised.