I'm pretty sure they could. Back then, slaves were seen as property basically, so they could what they want. People were against slavery or that simply frowned upon slavery didn't like when slave owners did that, but they didn't like that fact that they had slaves at all. Of course, that's just what I'm thinking it was, regardless of how inhumane the idea is and how much you would hope it wasn't like that.