activitypub: always track following state for async reasons