How I build-in Tumblr in my Drupal install is already very close to what I want to do with Tumblr on my homepage. Now I just need to write a minimal widget and stuff the code in there and instead of the regular posts, only go to the photos. And I'll have Tumblr photos on the homepage again.
Update: those who look to the right can see the Tumblr photos again. So on the homepage. It works quite well and doesn't take up any more time. Someday I'll put together the plugin that I built there, at the moment it's still a bit raw.