The Bailudong Academy is located at the southern foot of Houping Mountain, 10 kilometers south of the Wulao Peak of Lushan Mountain, Jiangxi Province.

During the Tang Dynasty (618-907), Li Bo and his brother settled there in seclusion. After being appointed governor of Jiangzhou Prefecture, Li revisited the site and ordered the construction of buildings and pavilions. The site then became a tourist attraction named Bailudong. During the early Song Dynasty (960-1279) it was extended to include an academy and was formally called Bailudong Academy. As the first comprehensive academy in Chinese history, the Bailudong Academy was reputed as one of the Four Academies Under Heaven along with the Yuelu Academy, Juyang Academy and Shigu Academy. It was destroyed in wars during the late Northern Song Dynasty (960-1127) and then restored in 1179 in the Southern Song Dynasty (1127-1279). Many renowned scholars of the Song Dynasty, such as Zhu Xi, gave classes at the academy. The present construction was built during Emperor Daoguang's reign of the Qing Dynasty (1644-1911).

Main constructions at the academy include the Lingxing Gate, Banchi, Lisheng Gate, Lisheng Hall, Zhuzi Temple, Bailudong and the Imperial Writing Pavilion. The Zhuzi Temple was built to commemorate Zhu Xi. In the back of the temple was a cave with a stone white deer lying in it. Over 120 stone tablets were erected in the Zhuzi Temple. Inscriptions carved on the tablets include the handwriting of Zhu. The inscriptions are not only examples of precious calligraphy but also include rare historical data. In front of the Zhuzi Temple, a two-storied pavilion was built across from the Lisheng Hall. The pavilion was built after Emperor Kangxi bestowed a horizontal tablet to the academy named the Imperial Writing Pavilion. To the northwest of the Lingxing Gate is a winding path leading to a peaceful place full of hills, forests and springs.