Let be a set and a collection of subsets of . A subset is shattered by if each subset of can be expressed as the intersection of with a subset in . Symbolically, then, is shattered by if for all , there exists some for which .
If is shattered by , one says that shatters .
There are a number of equivalent ways to define shattering. One can easily verify that the above definition is equivalent to saying that shatters if
where denotes the power set of . Yet another way to express this concept is to say that a set of cardinality is shattered by a set if where here,
In the field of machine learning theory, one usually considers the set to be a sample of outcomes drawn according to a distribution with the set representing a collection of "known" concepts or laws. In this context, saying that is shattered by intuitively means that all of the constituent outcomes in can be known by knowing only the laws in .