The Elders job is to give out all the rules and jobs, and also takes away all memories and pain away.
The story would be different if the Elders were more present. They could have found out about Jonas giving memories to Gabriel and his plan to escape. The elders could have made him have serious punishment but not release because if they did then all the memories would have been released to the community and created chaos.
