Search
Thursday, 2nd of February 2023, 2:56:29 UTC
13:16:13
drmeister
Bike: I hit a problem with conspack - I write out a hash-table with keyword symbols in the key and then read them in. When I read them back in the keyword symbols have all changed to unintended symbols.
13:46:03
drmeister
I'm hacking it right now by regenerating the keys after I load the data structure.
13:46:40
drmeister
But there are symbols deeper in the values of the hash-tables that are probably mangled this way as well.
13:51:49
Bike
are the keys keywords, or something containing keywords?
13:52:39
Bike
trying to reproduce this but i'm not seeing it.
13:56:05
drmeister
Two hash tables, one has keyword symbol keys and the other has (cons keyword1 keyword2) keys.
13:56:13
drmeister
There are keyword symbols in the values as well...
13:56:14
drmeister
https://usercontent.irccloud-cdn.com/file/0zRH1GJO/image.png
13:56:32
drmeister
Notice how the monomer-context is an uninterned symbol.
13:56:39
drmeister
It was a keyword when it was saved.
13:57:05
drmeister
This is just for debugging - so it's ok here - but it will become a nasty problem at some point.
14:00:32
drmeister
https://usercontent.irccloud-cdn.com/file/Y9fDCq77/image.png
14:00:57
drmeister
After hacking that database - I built the first structure using all of this code. phew.
14:01:24
drmeister
One little defect at the bottom left
14:04:53
drmeister
Timing the code - it will take about half an hour on zeus to build a virtual library of a million compounds.
14:06:00
Bike
not seeing this with a pretty basic hash table of {:foo -> 4, :bar -> 5} or {(:foo :bar) -> 4, (:bar :foo) -> 5}
14:06:35
drmeister
You may need to shut down clasp between saving and loading
14:06:50
drmeister
save the hash table, restart clasp, load the hash table.
14:07:22
drmeister
I saw the same thing when I did it within the same session. The symbols are already interned in the keyword package.
14:07:47
drmeister
I'm generating the file on the HPC system and then loading it on zeus.
14:08:45
drmeister
three hours to generate the file, 5 min to load it.
14:09:33
Bike
oh yeah, now i see it. what the hey.
14:11:33
Bike
mfiano: i can take a look at that, but i think first i should get rpav to give me actual write perms
14:36:09
drmeister
When the wires are uncrossed do you see why keyword symbols are loading as uninterned symbols?
14:43:58
Bike
it happens on sbcl, so it's a bug in conspack rather than clasp
Thursday, 2nd of February 2023, 14:56:29 UTC