Chapter 2 of "Skylight". Kosuzu starts a fight, and Koishi returns to finish it. The series seems to really start from here.

If I had to guess, the guy had something to say that Kosuzu didn't like (thrilling 500 IQ theory), but what that was, I haven't a clue.