Out of Memory, then crash

  • 2
  • Problem
  • Updated 4 years ago
  • Solved
OK, I seem to be pushing some sort of limit in MindManager. I have several layers of backup redundancies to save my a$$, but I am running into more and more frequent file corruptions, for varied reasons.

I was just working merrily along, and I got an Out of Memory error, followed by the two attached messages, then MindManager crashed. The map is now corrupted, and I had to go back to the automatically saved backup version.

I will have recovered fully from what I lost by the time this is even read, so no emergency action is required but this is starting to get tiresome.

My maps has over 2100 topics, and utilizes a couple hundred icons, with most topics having at least 6 of them, and as many as 30. I get the sneaking suspicion that the failure is somehow related to that, but have no way of proving it.

I'll give you the stats of this monster machine I am working on. I have noticed that the largest the MindManager process gets is about 800MB. I have 64 GB of RAM, a crazy fast disk array (multiple, actually) and 8 core i7 Intel processors. At no point does my machine use more than 40% of the available memory. I am running on Windows 8, 64-bit edition. You're going to be hard-pressed to find someone using a beefier machine for editing mind maps.

I am including the error messages here:

Photo of Mike Danielski

Mike Danielski

  • 191 Posts
  • 6 Reply Likes
  • frustrated

Posted 4 years ago

  • 2
Photo of Mike Danielski

Mike Danielski

  • 191 Posts
  • 6 Reply Likes
I just did a test and *just opening* the map jumps the MindManager process size to 575 MB.... FWIW.
Photo of Mike Danielski

Mike Danielski

  • 191 Posts
  • 6 Reply Likes
I just tried to push out my glossary to another linked map (and remove a few hundred topics from the main map) and as it created the new map (which I can see in the background) I got this error, below.

Photo of Mike Danielski

Mike Danielski

  • 191 Posts
  • 6 Reply Likes
The more I look at this, I think that the problem is the Marker List. I tried to update my Marker List template, from the current map, and got the same XML processing error above.
Photo of Mike Danielski

Mike Danielski

  • 191 Posts
  • 6 Reply Likes
I exported my Glossary (Map Index) to a new map and it has 465+ topics.. so that is the density of my icon and tag collection at this point. By the time this is read, i twill probably have 20 or so more.
Photo of Nick Duffill

Nick Duffill, Champion

  • 512 Posts
  • 170 Reply Likes
Are you using custom icons, stock icons, or some other type of marker? Custom icons are very expensive in terms of internal memory for the XML document, as I have a suspicion that their image data is replicated in every node that uses them. If you can use tags (text labels) instead of custom icons, strain on the XML data model would be considerably less.
Photo of Mike Danielski

Mike Danielski

  • 191 Posts
  • 6 Reply Likes
I am using almost all custom icons. If that is the problem, then I am in real trouble. There is no practical way I can replace all these icons with text nodes at this point. It would take me weeks worth of work :( I'm not sure what to do, as I still have a lot of icon usage ahead of me at this point....
Photo of Nick Duffill

Nick Duffill, Champion

  • 512 Posts
  • 170 Reply Likes
It is fairly efficient to replace icon markers with tag markers. The custom icon markers already have a unique text name. A tag marker is like an icon marker but without a graphic - it is just a text label instead of a text label and a graphic. The custom icon graphics are likely to be contributing substantially to memory requirements. To swap a custom marker for a tag marker:
  1. Create a replacement tag marker (note that you won't be able to use identical text)
  2. Use the power filter to select all topics with the custom icon marker.
  3. Click on the icon in the index to remove it from those topics.
  4. Click on its replacement tag marker to apply to the selected topics.
  5. Delete the custom icon marker from the index. MM will allow you to delete it when it is not present on any topics.
This would need to be repeated for each individual custom icon marker definition only. It is the power filter that does the heavy lifting here. You are probably looking at 1 minute tops for each marker.

P.S. the other advantage of Tag markers is that you can turn their display on or off (in View > Show/Hide) which you can't do with regular icon markers. This would clean up the visual display of the map for when you only want to work with the text.
(Edited)
Photo of Mike Danielski

Mike Danielski

  • 191 Posts
  • 6 Reply Likes
Well, that is an interesting option, though I am still quite leary of all the text it is going to introduce here. It is rather remarkable how easy it is to "read" such a complex map once you know what each icon represents. Scanning becomes really fast and easy.

That said, I did a test a moment ago on a copy of the map. I removed all of the topics, except the central one, then saved and exited. The map dropped exactly half in size (to 22MB) with nothing in it, so that goes to show how much space these icons are taking up.

One thing I need to look into is to see if the icon images themselves are very big, and if I can optimize them somehow. That could make a significant difference in total size if there were some big icons in there.

Do you know where the Map Index actually physically stores the icons themselves? Is it all in the .mmap file only? Where are the Library contents stored - because that would allow me to see the relative size of each icon if I could find that location on disk.
Photo of Mike Danielski

Mike Danielski

  • 191 Posts
  • 6 Reply Likes
My copying of the map to an emptied index file did allow me to create a new map marker template, so at least I can periodically update that - at this point that is where a lot of my time gets taken up, in coming up with organizational methods for this map.. and losing that means a lot of headache later. The application of the tags/icons is relatively quick in comparison.
Photo of Mike Danielski

Mike Danielski

  • 191 Posts
  • 6 Reply Likes
OK, so here is an important question Nick - I have two main 2nd level topics that literally have half of the content each. Here is my thought on a way to keep the icons, and work around this problem. My main goal at the very end of this process is to have a single map, with the combined map index to use in power filtering.

Here is what I am thinking of doing:

Export each of the two main topics to separate linked maps.

Edit the separate maps as necessary, adding icons and tags as needed.

Periodically update the map marker template (so they all use it eventually).

When I am done authoring, import the linked maps back into the main map (no more editing is needed).

The questions is this: would topics that I tagged in the linked maps be recognized by the master map at the end? Here is the sequence: Master.mmap, Link Map A.mmap, Linked Map B.mmap all start out with the same Map Template (same icon and tag list).

OK, I was typing out the process and realized I am not sure how I would get the few new icons I created in each separate linked map into the master map template. In other words, I need to merge their content.

Thoughts?
Photo of Mike Danielski

Mike Danielski

  • 191 Posts
  • 6 Reply Likes
Oh wait, if you import a linked map into the main map, do the icons/tags automatically come with it? I'm going to create a few test maps to see what happens here.
Photo of Mike Danielski

Mike Danielski

  • 191 Posts
  • 6 Reply Likes
OK, it looks like after the Linked Map is "inserted" back into the master map, it converts the icons that are NOT in common with main map into a "General Icons" entry. if it HAS used the same icon in the master map, it seems to properly associate it with the entry in the existing master map icon group.

I checked and the Power Filter command properly recognizes the icons - regardless of whether the entry was originally tagged in the main or linked map. Though this isn't as streamlined as I would like, I can live with this. This way I can end up with a single master map that the Power Filter works on, and can manage to keep my huge 2nd level subtopics as linked maps during the main editing process.

That's good to know!
Photo of Mike Danielski

Mike Danielski

  • 191 Posts
  • 6 Reply Likes
I have to say that I am disappointed that no-one from MindManager is picking up on this thread.

I put all this supporting test and troubleshooting detail to assist the support engineers in finding a solution for me. This problem has not gone away, and to be honest, is threatening to derail my use of the software going forward - it is not proving to be robust enough.

Nick has been kind enough to offer some workarounds but they make the map largely unusable for it's intended purpose and I am trying desperately to find workarounds for this.

Continually running into Out of Memory errors, even when the main large map has been separated into 3 separate parts - all of about equal size - making the map almost a third the size of the original and STILL running into these errors. It's not a hardware issue, it is most definitely a software problem.

Given the amount of work I have still to do on this I am not sure MindManager is going to provide to be up to the task. ...

(sigh)
Photo of Marian Kocmanek

Marian Kocmanek, Official Rep

  • 369 Posts
  • 64 Reply Likes
Mike, 

I will be glad to help troubleshoot and send the findings to our Quality Assurance Team. I'm going to send you an email to set up a call to discuss further. 

Best, 
-Marian