The Virginia Military Institute’s board of visitors voted Friday morning not to renew the contract of retired Maj. Gen.