Agreed 1000%. Also don't forget that unlike actual slaves, indentured servants had terrible living conditions, and their "bosses" really didn't care if you lived or died while working off your debt. And if you died, your family was still on the hook to pay that debt (from my understanding anyway). Whereas actual slaves that cost actual money were taken much better care of because they were an investment.
There was also the mass influx of the Chinese, to build the transcontinental railroad system.
People today want to paint over the dark times in our history, and pretend we all sat around campfires and sang Kumbaya before bed every night. Nothing could be further from the actual truth. And the more we bury it, the more we are destined to repeat it.