Abstract: Ecological communities are shaped by biotic interactions as well as environmental forces, and both must be incorporated to obtain models capable of forecasting realistic community dynamics. Many community models first specify pairwise biotic interactions and then secondarily examine how extrinsic factors such as abiotic conditions affect species abundances. A disadvantage of this approach is that the species interactions themselves are often environment and context specific, making parameterization difficult. We propose an alternative approach, interaction neutral models (INMs), which are sets of structured population models linked by an assumption of aggregate density dependence. INMs incorporate detailed species autecology but are neutral with respect to pairwise species interactions, instead allowing interactions, including competitive exclusion, facilitation, and interference competition, to be revealed from the model structure via sensitivity analysis. We develop a framework for building INMs using vital rates in a stochastic, multispecies framework. Single-species matrix population models are connected via an assumption of aggregate density dependence, pairwise species interactions are estimated with sensitivity analysis, and community trajectories are analyzed under different environmental regimes using standard statistical tools and network analysis. INMs have the advantage that pairwise species interactions need not be specified a priori, and that mechanistic demographic-environment linkages permit forecasting of community dynamics under novel, non-stationary environmental regimes. A challenge is that species’ autecological vital rates, such as fecundity, growth and survivorship, must be measured under a diverse range of environmental conditions to parameterize the models. We illustrate the approach with examples and discuss prospects for future theoretical and empirical developments. On balance, we suggest that pairwise species interactions are best viewed as context-dependent, second-order phenomena arising from species’ autecologies playing out in the context of variable, and finite, environments.