When you invite someone, it should 'provisionally' add them to your contacts so you can start sharing tasks / lists with them.
When they accept, it should automatically share all tasks / lists that you have already shared with them.
If they decline, should notify and remove the shares.