Does this chat system use PHP sessions, a database, or any other third party system? Also, what kind of responses does it send to the clients?
There are a myriad of concerns when creating an AJAX-based chat system, especially when you start to get a lot of users. Most of which requires intimate knowledge about the way all systems involved function, potential bottlenecks, optimization tweaks, and (most importantly) being able to properly profile your code.
I've made an AJAX-based chat system which supported a few hundred users. I had to tweak everything including the PHP session handler (or rather circumvent it completely, to maintain the responsiveness and keep the system resource utilization to a minimum.
You should perhaps also consider hiring someone who knows what they're doing, if this is a project which is either commercial (in other words, making you money), or if don't have a few weeks to get to grips with everything.
As for how to use and configure APC, I recommend
reading the PHP manual page. Though, as
Requinix already pointed out, you shouldn't have to do anything to use it.
When it comes to what it caches... That's a whole different question, and one which would take a lot of time to explain properly. Thus I recommend a search for "opcode cache" on Wikipedia, or similar, and read about how they work in general. After you've done that, the PHP manual should give you the necessary details for that particular implementation.
Edited by Christian F., 24 January 2013 - 12:19 PM.
Keeping it simple.