activitypub: more robustly handle object-to-actor associations