Allow me to give you an answer, as unpleasant as it may be, and then discuss some of the other replies.
In regards to yourself, if you don't like people and all you are good at is math, that's not the fault of any college. Nor was your situation caused by the higher education system. You, not the system, have some problems which need to be fixed. You can choose to work on your personality and academic weaknesses if you so desire. I would hope you would follow that path. , Conversely, you can continue to blame vague societal institutions for your shortcomings. I hope you make the right choice.
In regards to many of the other responses, don't believe them. There are 2 kinds of political extremists. There are a small group of con men, and a large group of their gullible followers. The leaders of the extremists don't really believe what they say about education. They hate higher education because college students are taught to think critically. People who think critically are the biggest threat to extremists and their nonsense. Those who don't think for themselves gleefully parrot the lies they hear from their favorite pundits.