Who Needs Factoring?