Immaterial has different meanings. That which is immaterial has no relevance and is irrelevant in the conversation.
Also, that which is immaterial has no physical substance. Thoughts would be immaterial as would concepts and imagination and the spiritual realm.