We use a survey of small rural enterprises from Tanzania to identify subjective as well as objective obstacles to expansion and productivity of the country's rural non-farm sector. Our results suggest that infrastructure constraints significantly reduce participation in the sector and investment and productivity by existing enterprises. Such constraints are particularly harmful for small enterprises, suggesting that policies to improve delivery of key public services can provide a basis for rural non-farm development, with possible knock-on effects on poverty reduction.