Seems to me that minimalist music gives people a similiar impression as they look at fractal images -- some simple patterns repeat themselves, and somehow convey a sense of beauty.
And like fractal images, I can understand that minimalist music can drive some people nuts.