I've taken a similar approach to some wispy bits of "pre-cloud" that can form when conditions are not conducive to full blown cumulus production but there is some few/scattered spotty condensation at a particular altitude. If I can see all the way through I am comfortable flying through it and since I can see at least three miles through it it must be legal VFR. Basically the same approach I'd take with an isolated shower reducing visibility. The regs specify certain distances away from "clouds" but don't define cloud nor is there a definition for "cloud" in the definitions section of the FARs. Hopefully my interpretation isn't too out of line.
The spirit of the regs is to make sure you can see an IFR aircraft appearing out of an area of reduced visibility in time to avoid. Let that be your guiding principle.