Prior work has shown a “natural” preference in the Verb Phrase for direct object Nouns to linearly precede the Verb. There is also evidence of a “natural” preference in the Noun Phrase to order Nouns before Adjectives. Given this, we asked how domain-general biases like regularization and language-specific biases like the preference for “natural” orders could jointly contribute to the emergence of these two common word orders cross-linguistically. Using a silent gesture paradigm (in which we presented iconic gestures without speech), we exposed different participants to competing Verb Phrase (NounVerb vs. VerbNoun) and Noun Phrase (NounAdj vs. AdjNoun) word orders at varying frequencies. In Noun Phrase contrast conditions, we found that regularization was greatest when the domain-general bias towards regularization and the linguistic bias to order Nouns before Adjectives were aligned. In Verb Phrase conditions, participants regularized to the same extent regardless of input: They opted for greater regularity, even at the expense of aligning with underlying word order biases. We discuss the implications of our work for understanding the effects of domain-general biases on language