Once you're well again, if you decide not to return to skating, then know that that is a completely rational choice, and one that's okay to make. I know you love skating, but if it's time to move on from it for whatever reason, that's okay to do. It'd be great if you can find another activity that you can do that's also physical, that perhaps even would benefit from your skating experience, and which is less likely to cause falls for you, and focus on that.
And there are activities that would benefit from your past in figure skating, and which you can continue to do until you're quite elderly, which you can get good at if you want to, and which aren't as prone to injury as figure skating might be for you. Once you're well again, you might try out various activities and see if you can find one that you like, and which gives you some or all of what you get from skating. The one that springs to mind right off is ballroom dance. I know several skaters who have transitioned into ballroom.
If you want to continue skating, or even if you don't, you might work with a physical therapist on things like stability and falling more safely, and see if that helps. You could also consider doing ice dance (partnered with a coach) rather than singles, although that won't help if you fall while practicing on your own. For confidence and to prevent injury, you might wear roller derby style knee/wrist/elbow/helmet, even if that means you aren't doing all the moves you do now. But regardless, an option might be for your first sessions back on the ice to be done with a coach, rather than on your own, for the confidence boost.
If I were you, I'm not sure I'd continue in skating. You've had two significant injuries (the elbow being IMO catastrophic), you were going to stop in a couple of years, your husband advises you to stop. I'd probably stop in your position. Move on to something else.
Again, if you feel it's time to stop, then stop. Yes, it's a couple of years earlier than you'd thought. And you'll grieve and miss the sport. But focus on doing something else, to help ease the transition, and perhaps you'll fall in love with that thing as well, with time.