Set the metadata for parallel conversion later - av_frame_make_writable() may actually alter that (at least pointer but perhaps also linesize), those old values might have been invalidated by that lavc call.