freenode/#clasp - IRC Chatlog
Search
14:12:32
drmeister
I just can't be sure about my build time observations because they stretch over weeks and my machine isn't carefully set into a calm state before building.
14:17:40
drmeister
We've made a lot of changes over the last weeks and they have (1) cut the size of the generated code from about 25M lines to about 8.6M lines, (2) convert cleavir SSA variables to llvm SSA variables, (3) made the build more parallel.
14:22:55
drmeister
Then there is this - we have a buildbot that has been building docker images - it has an overall build time of about 2.5hrs
14:23:41
drmeister
Those are builds over the last week or so - they have changed very little. I can dig into those and pull out more build time data. That is better than times from my laptop.
14:25:01
drmeister
But when building it on a 6 core machine using 12 processes and hyperthreading it takes about 23 min.
14:51:58
drmeister
I think I was misremembering the 28min builds - maybe that was just for cclasp. It takes 20 min just to get through the C++ compilation, aclasp and bclasp.
15:29:07
drmeister
Yeah - the single executable cclasp-boehm has trouble with stackmaps - checking...
15:31:26
drmeister
It appears that there is a problem with linking the stackmaps when I link everything together (sigh).
21:50:06
kpoeck
I think I have now a situation where a gethash on _lisp->_Roots._ClassTable returns nil
21:53:24
drmeister
Ok, there is supposed to be machinery to deal with that - but that is a very, very helpful observation.
21:55:23
kpoeck
Actually now when a symbol that should represent a class is not found, I do a second test with maphash and if I find the symbol I return the class.
22:01:38
drmeister
kpoeck: I've got one of the authors of the MPS here in my living room and we are talking about it.
22:03:08
drmeister
That never occurred to me - but of course - if you are iterating over a hash table and things move - maybe we miss things.
22:13:09
drmeister
kpoeck: Is this with multi threading going on or does this also happen in single threaded mode.
22:15:44
kpoeck
This also looks interesting: https://github.com/clasp-developers/clasp/blob/dev/src/core/hashTable.cc#L287
22:19:04
davidlovemore
For reference: https://www.ravenbrook.com/project/mps/master/manual/html/topic/location.html
22:21:20
kpoeck
I am tempted make a hash-table with all common-lisp-symbols as keys and their symbols-names as their values, create a lot of garbage and test whether I can read them correctly from hunderds of threads
23:24:47
drmeister
Ok kpoeck Thanks - I'll take a look at it. I'm multiprocessing right now trying to fix two other things (stackmaps and the build system).