At what point does a side business need a proper booking system?

doing this alongside full-time work. 50 clients at the moment. currently managing through a paper diary which is fine. getting more enquiries and wondering at what point the volume justifies a proper system. is there a magic number or is it more about when the chaos becomes unsustainable?