The effective management of crowded events such as the Muslim Hajj in Saudi Arabia and the Hindu Kumbh in India continues to remain a challenge mainly due to uncontrollable buildup of crowds or mismanagement. Despite regular occurrence of catastrophes such as stampedes and fires, resulting in significant loss of lives, there are no international binding standards for controlling and managing large crowds. Indeed, the use of advanced technology, including tracking and monitoring tools, and sensor and biometric identification methods, can assist towards better crowd management but technology alone cannot be a solution to overcrowding. Because of the congestion, resulting from overcrowding, timely cleaning and sanitation becomes unmanageable, which causes spread of diseases. This article discusses some factors which are critically important and provide an architecture for better management of Hajj.