Crystalline-electromagnetic responses of topological semimetals and insulators