Illegal sub letter, the tenant is threatening to throw us out in 2 weeks. What are my options?

My brother and I signed a contract with him for two months and were not aware that we would be illegally subletting. This apartment has 5 people subletting at the moment put apparently the maximum is 3. We've been given a two week deadline to get out. Do we have any rights? What are my options? Can our stuff get thrown out?