Perpetrators of anti-religious violence are not being punished in Sri Lanka and this impunity could lead to religious intolerance, despite the present climate of tolerance on the Indian Ocean island, a United Nations human rights monitor said today.