freenode/#clasp - IRC Chatlog
Search
13:03:56
selwyn
iirc the reason for 'sudo' everything was because of the need to read and write to /tmp/ for the jitted-symbols - if you can do without root then you should
13:03:59
drmeister
I don't know if this is significant. I ran into a problem with your script because ownership for some things were 'root'
18:25:28
kpoeck
drmeister you seem have have edited cleavir_file_list.py manuylly, although this is a generated file. I regenerated it and now "satiation" is again in. Was it the intent to have "satiation" not in the file list?
18:31:36
kpoeck
anyhow I pushed my eclector integration work to https://github.com/clasp-developers/clasp/pull/925
19:02:09
drmeister
Cleavir satiation should be commented out for now. With satiation commented out it will slow down the first compilation - this causes a noticeable pause when you first type in a complex form and it is compiled by Cleavir - but after that there should be no noticable lag.
19:02:28
drmeister
Well, it will lag a little after that but after about 5 min - there should be no more lag.
19:02:56
kpoeck
ok, than I comment it out in the right place, so that regeneration doesn't overwrite it
19:02:59
drmeister
You say Mcclim seems to behave much slower without satiation - I am surprised by that - but I don't know the details of the slow down.
19:23:40
drmeister
https://github.com/clasp-developers/clasp/pull/925/files#diff-a58a8f7fd4f09d8b7ca8b40c4edb41e4R96
19:24:02
kpoeck
https://github.com/kpoeck/clasp/blob/feature-full-eclector-integration/src/lisp/kernel/cleavir/activate-clasp-readtables-for-eclector.lisp#L96
19:25:18
kpoeck
and *read-preserving-whitespace-hook* to read-preserving-whitespace-with-readtable-synced
19:27:53
kpoeck
so should I do SYMBOL_EXPORT_SC_(EclectorReadtablePkg,read_with_readtable_synced); instead?
19:29:25
drmeister
So the idea is to bind eclector.readtable:*readtable* <- *readtable* and then call the eclector.reader:read ?
19:30:50
drmeister
kpoeck: I'm trying to understand what you are doing - this bypasses clasp's read in favor of eclectors the *read-hook* is bound.
19:31:15
kpoeck
and eval::funcall(eclector_readtable::_sym_read_with_readtable_synced, sin ,eof_error_p, eof_value, recursive_p);
19:32:04
kpoeck
thats the whole idea using eclectors reader, assuming it is better than the c++ one, right?
19:32:40
drmeister
Will this wipe out the need for the eclector.readtable functions that we dispatch to?
19:33:08
kpoeck
right now its half baken, we use eclector for compile-file, but not for load, read, read-from-string
19:33:23
drmeister
Because I'm fine with that as well - I just want to know what the consequences are.
19:33:50
drmeister
If splicing in eclector's reader is the way to go then eclector takes over fully once *read-hook* and the other is bound - correct?
19:35:26
drmeister
Or can we? Clasp defines cl__copy_readtable for instance - eclector doesn't define it - so it will still need to dispatch to eclector.readtable functions.
19:36:13
drmeister
This is why I'm asking these questions. If substituting the C++ reader for the eclector is what we are doing - then we should get rid of anything that becomes superfluous and isn't necessary for bootstrapping.
19:37:02
kpoeck
what you did was to allow for eclector readtables in clasp, I now did it the other way, eclector uses clasp readtables - as Bike proposed
19:38:17
drmeister
But are all of the eclector.readtable symbols and dispatch in the readtable.cc file needed.
20:56:39
kpoeck
(time (ql:quickload "mcclim" :verbose t)) -> Time real(7178.749 secs) run(7178.914 secs) consed(87670570864 bytes) interps(1393)
21:02:54
drmeister
Ok. If you get some time - could you try building quickloading it after evaluating (setf cmp:*compile-file-parallel* nil)
21:03:25
drmeister
That size of a job is a great benchmark/torture test for compile-file-parallel vs compile-file-serial
21:04:02
drmeister
We are also looking into getting poiu working - I've added support for Clasp to poiu.
21:05:03
kpoeck
ironclad would also be a good benchmark, but you need my pr to get it to compile because of its readtable manipulation :-)
21:12:41
kpoeck
When I have an error in clasp now, between showing the restarts and the message "search_jitted_stackmaps" it can now take like a minute
23:46:53
drmeister
I'm not sure if it's the llvm9 change that did it - which we should be able to fix or if it's the faso files that slowed things. I hope it's the former. How to figure that out...
0:21:45
drmeister
::notify kpoeck Thanks for pointing out that slow backtrace problem - I came up with a solution that is much much faster. I'll push tonight.