We derive kinetic equations covering coagulation and fragmentation of granular gases including a combined dynamics of the mass spectrum and the velocity distribution. We will focus on coagulation; that can only occur at low impact velocities where attractive forces and dissipation prevent a post-collisional separation. We calculate an impact speed-dependent threshold velocity g(c) for coagulation to occur based on binary collision dynamics of viscoelastic Iranular particles including adhesive forces and determined by the masses, and the material of the colliding particles. Growth processes are immensely slowed down due to g(c) and the resulting restriction in phase space, and do furthermore depend on the ratio of threshold and thermal velocity of a considered particle ensemble. The Smoluchowski equation emerges from the general kinetic approach as a special case.