What should I do about this guy's behavior?

He seems insensitive, immature, and inconsiderate of your feelings. Take the high road and don't quarrel or hold a grudge, but do tell him calmly that you don't think you're right for one another and no hard feelings.