The protest brings to 146 the number of self-immolations by Tibetans calling for freedom in China.
The pilgrims, most of them elderly, had hoped to attend the Kalachakra teachings scheduled for January in India.
Those who remain stay secluded in their rooms as authorities paste posters on dwellings around the complex.
The Tibetan spiritual leader's visit is religious and not political in nature, government officials say.
The unidentified protesters call out in support of exiled spiritual leader the Dalai Lama.
The move appears aimed at preventing attendance at the Dalai Lama's Kalachakra teachings next year.
Detained in 2012 for opposing Chinese rule in Tibetan areas, Lobsang Sangye was tortured in custody, a source says.
Authorities ban the prayer and teaching event as they work to reduce the Tibetan Buddhist study center's size, sources say.
Some will be held for up to six months until the classes end, sources say.
Many are forced to leave without being allowed to gather their belongings, a local source says.
They also promise not to interfere with government policy in the area and to uphold 'national unity.'
He is freed a month after his sentence ends on his family's assurance they will not publicize the release.
He is hospitalized in critical condition after being assaulted by police while in detention.
Accused of 'illegal activities,' he was given 15 months at hard labor.
The opening of a residence for the abbot, who lives in India, draws hundreds, sources say.
Many had received advanced degrees in India, and returned to Tibetan areas to teach in local monasteries.
Monks and nuns coming from Larung Gar's Serthar county may now also be forced to leave, sources say.