Add post_process_tokens and post_process_ids methods#1944

ArthurZucker wants to merge 1 commit intomainhuggingface/tokenizers:mainfrom

feature/post-process-tokenshuggingface/tokenizers:feature/post-process-tokensCopy head branch name to clipboard