Enums use varint, so if the value is negative it should end up being longer.

This was caught my new conformance test cases.