The way that HID class avoids separate device drivers is to make a protocol that is completely self describing, and centered on the data that will be passed back and forth between the PC and the USB HID-class peripheral.

That is, you start by exhaustively defining the data: which direction each data item goes (Peripheral -> PC, PC -> Peripheral, or both ways), the size of each item in bits, and so on.