Conner was drafted by the Colts in the seventh round out of Clemson when Chargers general manager Tom Telesco was working in the Colts' personnel department.
Conner, 27, had 21 tackles in 10 games last season with no starts.
Conner had a career-high 104 tackles and a forced fumble in 2011.
He has 236 career tackles, one sack and two forced fumbles.
Conner is a 6-foot, 245-pounder from Richmond, Va.
Follow me on Twitter: @RavensInsider
Aaron Wilson covers the Ravens for The Baltimore Sun