Leonardo DiCaprio is annoyed by comments about age restrictions in his relationships