Should statues of dictators be removed?

In the USA, some are calling for the removal of Confederate symbols, reminiscent of the slaveholding South. The question also arose in the former USSR with regard to statues of Lenin. What should be done with these disturbing symbols? Leave them as a testimony to an era, or remove them out of respect for the victims?