A commission recommended the memorial's removal last year after reviewing names of military bases commemorating Confederate leaders.
The Army had planned to remove the memorial this week.
A Confederate memorial is to be removed from Arlington National Cemetery in northern Virginia in the coming days, a cemetery official said.
Cannonballs, a sword blade and a wagon wheel are among the artifacts found in the Congaree River.
