It is good to take some time off for sadhana. Without your activity, the world will not end.