I'm inclined to agree. I'm seeing a lot of, "we'll be getting revenge/redemption against Oregon" and that's far from automatic. It may not be 50/50, but there's still a chance that we lose again to Oregon or could even lose to Utah.
As to conference/playoff defensive match-ups, that's exactly the problem... in order to get to the playoff, we have to be able to stop physical running teams in The Game (I guess, now?) and against Wisky in Indy, but then have to deal with teams Clemson (not this year, obviously) and Alabama, and possibly USC in the future, who torch us. That's not going away so it needs to be somehow worked out strategically in recruiting and scheme.