Indeed, I basically just have a desktop background picture so so there's something pretty slightly showing through translucent windows.
I used to just turn all icons off on the desktop, but recently I've started to use XFCE's desktop-icons-represent-running-applications mode - to switch between applications, I can hit the "show desktop" and select a different app. So my "desktop" is pretty much just a very spacious and pretty hiding task bar. Since I seldom have more than 10 or so GUI things running at once, the desktop is still mostly empty of icons so doesn't look like crap when it shows through.
I used to just turn all icons off on the desktop, but recently I've started to use XFCE's desktop-icons-represent-running-applications mode - to switch between applications, I can hit the "show desktop" and select a different app. So my "desktop" is pretty much just a very spacious and pretty hiding task bar. Since I seldom have more than 10 or so GUI things running at once, the desktop is still mostly empty of icons so doesn't look like crap when it shows through.