Here is a proof-of-concept that should get you started : https://github.com/jean-emmanuel/osc-keyboard