Oil gets contaminated after a few thousand miles. Moisture from condensation, gasses from the combustion, dirt, small fragments of metal from normal engine wear, and so on. If not changed regularly, the dirt and metal fragments cause accelerated engine wear. Also, with all this contamination, the oil isn't lubricating things like it should.
The oil filter can't catch everything.