Matter Growth in Imperfect Fluid Cosmology