Vocabulary is one of the crucial factors for students' academic comprehension (Anderson, 2008; Grabe, 2009; Laufer, 1992; Nation, 2001; Qian, 2002). Thus, academic vocabulary lists have been created for research and materials of English as a foreign language (EFL) and English for specific purpose (ESP). Although the academic vocabulary lists have been widely used, few studies have probed into the reliability of the lists. Miller and Biber (2015) pointed out this gap and suggested that the reliability of word lists would be investigated by simply dividing a corpus into random smaller sub-corpora. A thirty-million-word corpus was created with 900 academic articles across nine disciplines of humanity, social sciences and sciences. Then the corpus was divided into two sub-corpora and sixteen criteria sets of register frequency, range, discipline measurement and dispersion were applied to each sub-corpus for vocabulary list creation. The replicability of the vocabulary lists was examined to find a set of criteria extracting the most reliable vocabulary list. The results showed that the combination of the lenient register frequency and discipline measurement, and the strict dispersion was the most desirable condition to create a reliable academic vocabulary list. This result was similar to Gardner and Davies (2012)' methodology to create their vocabulary list called Academic Vocabulary List, but does not show the impact of range on the replicability of an academic vocabulary list. The implications and limitations were also addressed.