I've been doing this for years
And most people have never known the difference. But the bottom line is - does it sound good to YOU and/ or your clients - if you have clients
Of course I do a lot of contemporary music, so when I need to do some more eleborate acoustic ensemble stuff, then I usually use the real deal - just because for really sophisticated and exposed acoustic music, it doesn't make sense to spend your life programming one 10 minute piece - and it's pretty hard to fake the really exposed stuff - although it can be done. It OBVIOUSLY depends on who your market is, also.
I'm not a real drummer, but I do play enough to understand what I want from the grooves (I do play lot of other instruments) - I've also spent loads of time programming with extraordinary drummers/ programmers/ percussionists at my side. It REALLY helps having the players who understand the instruments working with you.
There are so many options available at this point, library-wise, and with all the software - chances are (no offense to any drummers), if you're a really good musician, and have some decent gear, you may end up with a track that sounds better than it would if you HAD used an actual drummer.
People have been asking me for years who plays bass on my stuff - well, Marcus Miller and Abe Laboriel (sample collections) : ) have been VERY present. I've tracked some of my favorite bass players and couldn't come CLOSE to the sounds that serious clinical recording professionals have been able to get when they set up for some of these libraries - the process can be pretty intense (and EXPENSIVE) to get these libaries together. There's a lot of attention to detail - most folks don't have TIME/ BUDGET to get that kind of care happening in these days - it's not like the 70s (where, as Skunk Baxter said, you could spend hours just finding the most comfortable chair to sit in - all at the cost of the label - doesn't necessarily sound like smart business on the part of the label - but those records sound KILLIN').
Disclaimer - of course you'll have a harder time fooling the SERIOUS recording engineers (like some of the gearslutz here) - but, unless THEY are your audience, you shouldn't have much to worry about. Check it out, and see for yourself!!
Lots of luck.