You make some valid observations. People had the same concerns 250 years ago, so they wrote the 10th amendment into the Bill of Rights.
10th Amendment “The powers not delegated to the United States by the Constitution, nor prohibited by it to the States, are reserved to the States respectively...