How do generative models work?

A generative model takes into account the distribution of the data and informs you how probable a certain occurrence is. Models that predict the next word in a series, for example, are generally generative models (far simpler than GANs) since they can assign a probability to a sequence of words.