Huge Retained Heap for JAXB-CXF Binding

CXF is abstracting the generation of JAXB classes from an XSD , the shallow size (for 4 objects) is 352 but retained size is 104,009,896.
This is happening for every service we have - we have 7 services .