In probability theory and statistics, a collection of random variables is independent and identically distributed (i.i.d., iid, or IID) if each random variable has the same probability distribution as the others and all are mutually independent.[1] IID was first defined in statistics and finds application in many fields, such as data mining and signal processing.