I suppose that’s fair, but there are a number of alarming things done in the name of the empire, especially after it fell. The whole latin influence on Europe was a net negative in my opinion. However, I can agree that blaming them for what happened later is a bit harsh.