Richards, 23, who made 33 appearances for the Seagulls in his two loan stints with the club last season, will stay at the Withdean Stadium until the end of December.
Albion boss Micky Adams told the club's official website: "My coaching staff spoke very highly of Matt when he was here last season.
"He knows the football club and I think it will be a decent signing."