Factoring Is The Right Tool