Bag of Words is a simple representation of text that disregards grammar and word order, counting the occurrences of each word. Despite its simplicity, it can be surprisingly effective in tasks like text classification. However, it loses semantic relationships between words.