The activity of a substance (which is approximately the concentration of a substance in dilute solutions) is actually defined as a ratio of the substance's activity to 1. Because all activities are ratios, there are no units. In a ratio all units cancel.
An equilibrium constant defined in terms of activities is called the "thermodynamic equilibrium constant", and is always unitless.