New York City Police Commissioner Edward Caban will step down Thursday, a highly placed police source tells CBS News New York’s Marcia Kramer.