If you left-click and hold, trying to move the map with the mouse on a square with a terrain attachment on it, you can't move the map. You have to find an empty spot. In some quests (like Descent to the Core or Order of the Core, with geomancers on it) this could become difficult.
