From Images to Dark Matter: End-To-End Inference of Substructure From Hundreds of Strong Gravitational Lenses