so only use our passed in link flags, and so avoid failing under oss-fuzz with
linker problem

https://github.com/google/oss-fuzz/issues/1789

and revert the interim hackery to narrow down the problem

Change-Id: Ic92f65ac3895d36a2917281c260e177caf2d31f5
Reviewed-on: https://gerrit.libreoffice.org/60216
Tested-by: Jenkins
Reviewed-by: Caolán McNamara <caolanm@redhat.com>
Tested-by: Caolán McNamara <caolanm@redhat.com>