Oh, you should definitely head towards Kreis 4, most of the good record shops are located there.

Sonic at Anwandstrasse is one of them, the owner shows you at least two even better vinyls for every one you like. Not much different is Crazy Beat at Badenerstrasse: one could spend hours in there!

Other tips are: Hum Records, 16 Tons or Jamarico.