As attractive as having your own brokerage firm might be, the sad fact is that many fail. To ensure that your business isn't doomed from the start, avoid these mistakes when opening your own brokerage.