Some memory management aspects of X server support for the X
Windows protocol only can be handled correctly using garbage-collection.
Some objects are used in such a way that there is not well-defined point
at which the server explicitly can release the memory associated with
them.  You probably are encountering one of these cases.

David