It is a great point and the subject of new research called machine unlearning (the opposite of machine learning which is used to train the models). Nevertheless it is very tedious, it is not easy to separate information baked into the model the same way that they can be separated, say from a word document. We will not see a lot of development in this field until regulatory bodies that deal with data privacy exercise a stricter control.