tnn figured out the problem, it was pkgsrc wrappers, and adding:
GNU_CONFIGURE_PREFIX= ${PREFIX}/love0.10
BUILDLINK_PASSTHRU_DIRS+= ${GNU_CONFIGURE_PREFIX}/lib
BUILDLINK_PASSTHRU_RPATHDIRS+= ${GNU_CONFIGURE_PREFIX}/lib
Fixed it, with no change to the package :-)