Amazon offers The Office: The Complete Series on DVD for $39.49 with free shipping. That's $3 under our March mention and the lowest price we've seen. (It's the best deal now by $12.) This set includes all 201 episodes.
If you're one for having shows and movies on actual physical media, then I'd say go for it, especially as this includes a lot of bonus features such as the entire Lazy Scranton music video. (As for me, I'm one of those horrible people who streams everything.) Sadly, I started to lose interest around season 7, but seasons 2 to 5 are absolutely brilliant. As pmurray63 says, though, YMMV.