Builders, legislators express frustration at state agency