Silver wiped out most of its meteoric price gains this year that was in part driven by Chinese demand.