GMB CAPITAL MANAGEMENT, a hedge fund firm run by a Massachusetts Institute of Technology professor, is shutting a fund after losing more than $50 million on bad bets that included putting money with accused swindler Bernard Madoff, people familiar with the matter said