You're right, this is a good thing to check. I take it then it wasn't backfiring out the exhaust but up the carb.
A smaller filter is OK, even a more restrictive filter is OK like those built into some carbs. The one on your car was probably needing replacement. They are supposed to be changed every year (but no one does ...)