Police started making arrests Thursday afternoon at a makeshift encampment that pro-Palestinian protesters had set up on Columbia’s quad.