Kanye West told to step back from venture that caused him ‘harm’ before