One-Hot Encoding transforms categorical variables into binary vectors, where each category corresponds to a single bit being 1 (and the rest 0). It prevents imposing an ordinal relationship among categories. However, high-cardinality features can dramatically increase dimensionality.