Engineering oxygen octahedra rotation patterns in ABO3 perovskites is a powerful route to design functional materials. Here we propose a strategy that exploits point defects that create local electric dipoles and couple to the oxygen sublattice, enabling direct actuation on the rotational degrees of freedom. This approach, which relies on substituting an A site with a smaller ion, paves a way to couple dynamically octahedra rotations to external electric fields.