Automate migration

When redeploying the recent changes made by @mraerino, I had to perform a by hand migration:

```
ALTER TABLE test_invoice_numbers DROP COLUMN id;
ALTER TABLE test_invoice_numbers ADD PRIMARY KEY (instance_id);
```

We should automate this if we can.  Close this issue by doing that, or deciding not to and documenting it somewhere. 