The Victoria and Albert Halls were gifted to the village of Ballater by Mr Alexander Gordon of Glen Girnoc, who made his fortune as a brewer in London. The Albert Hall was opened in 1875, followed by the Victoria Hall and the Gordon Institute in 1895—all constructed by the local building firm William Duguid and Sons.

Originally, the Halls were managed by a board of trustees made up of key local figures: the ministers, doctor, headmaster, bank manager, and four elected ratepayers. The complex provided a range of facilities for the community, including a reading room, billiard room, function rooms, council chamber, and an armoury. For over 100 years, the ground floor of the Albert Hall served as the village post office.

The Trust continued to manage the Halls until 1984, when it became the landlord to the newly formed Victoria and Albert Halls Development Association. This group undertook much-needed refurbishments, and the buildings were officially reopened in 1987 by Her Majesty Queen Elizabeth II. For the next 30 years, the Halls remained central to village life, hosting meetings, community events, the public library and an office for the Cairngorms National Park Authority.

By the early 2010s, extensive repairs and upgrades were required. To better access funding and grants, the Trust restructured as a Scottish Charitable Incorporated Organisation (SCIO) in 2012, combining building ownership with accountable management. Since then, significant improvements have been made, including upgraded heating and insulation, ensuring the Halls remain fit for modern use.

Today, the Victoria and Albert Halls continue to play a vital role in the community, hosting a wide variety of local activities such as meetings, playgroups, indoor bowls, the local history group, clubs, music and arts events, craft fairs, and horticultural shows.

With Aberdeenshire Library having moved to the Old Station, the former library space now houses the Ballater Community and Heritage Hub, which supports and coordinates village events and activities.