He has featured just once for the Lions since joining on a free transfer from the Spanish sice Elche last month.
The Millwall manager Kenny Jackett said it was a good chance for Noel-Williams, 28, to get some match fitness.
"Gifton has not broken into the team so he is going to go to Yeovil on loan," he said.
"He needs games to get himself fit and the move will achieve that."