That won't work, because that would catch any query on a table which happens to have the string "select" in a table, index or column name.
I don't believe what you are asking is possible using only pg_stat_activity. One thought that comes to mind is to identify, via pg_locks, sessions that hold non-read-only locks and then exclude the rows in pg_stat_activity that match up with those sessions.