Sometimes I wonder if hypothetically countless Dyson spheres could explain both Fermi paradox and the spooky lack of mass all over the place (the one usually explained with dark energy)?

I mean, if according to Fermi paradox there should be so many advanced civilizations out there, wouldn't there be many Dyson spheres? Wouldn't Dyson spheres make those stars invisible (occluded) to us?