I see from your translation where I was going astray.
Ólafur bað Gunnar vera varan um sig og kvað hann marga (masc acc pl,
agrees with öfundarmenn) eiga öfundarmenn "þar
Ólaf bade Gunnar to be aware about himself (on his guard) and declared
him to have many ill-wishers 'there