CPU 100% peaks on Datalore Kernel

naturlieb · March 18, 2021, 11:37am

hello there!
i was wondering, if I was messing something up, or its just the Kernel.

Although as i am running stuff in every notebook on the Datalore-Kernel it sometimes stops
and the CPU goes up to 100% for no reason.

Can´t run any cells, what makes it really annoying to work with.
then i get a a lot of errors like:

Kernel errors:

09:41RuntimeError: Could not unlink file /var/datalore/persister/8/workbook_storage_last_expr/datafile.1539: 2 No such file or directory

09:41RuntimeError: Could not unlink file /var/datalore/persister/8/workbook_storage_last_expr/datafile.1539: 2 No such file or directory

09:41RuntimeError: Could not unlink file /var/datalore/persister/8/workbook_storage_last_expr/datafile.1539: 2 No such file or directory

09:41RuntimeError: Could not unlink file /var/datalore/persister/8/workbook_storage_last_expr/datafile.1539: 2 No such file or directory

09:41RuntimeError: Could not unlink file /var/datalore/persister/8/workbook_storage_last_expr/datafile.1539: 2 No such file or directory

09:41RuntimeError: Could not unlink file /var/datalore/persister/8/workbook_storage_last_expr/datafile.1539: 2 No such file or directory

09:41RuntimeError: Could not unlink file /var/datalore/persister/8/workbook_storage_last_expr/datafile.1539: 2 No such file or directory

09:42RuntimeError: Could not unlink file /var/datalore/persister/8/workbook_storage_last_expr/datafile.1539: 2 No such file or directory

10:05ValueError: 'cku1N16rZhyiJUNd0OlDGB' is not in list

10:05ValueError: 'XuEpETgESB4HU0Nvy8Y4fv' is not in list

10:05ValueError: 'MF5vpzqDmJ9X2thKroGbQd' is not in list

10:05ValueError: 'yhanKQtZ6bKIPFPdeiAX8j' is not in list

10:05ValueError: 'cku1N16rZhyiJUNd0OlDGB' is not in list

10:05ValueError: 'cku1N16rZhyiJUNd0OlDGB' is not in list

10:05ValueError: 'cku1N16rZhyiJUNd0OlDGB' is not in list

10:05ValueError: 'cku1N16rZhyiJUNd0OlDGB' is not in list

10:05ValueError: 'cku1N16rZhyiJUNd0OlDGB' is not in list

10:05ValueError: 'cku1N16rZhyiJUNd0OlDGB' is not in list

10:05ValueError: 'cku1N16rZhyiJUNd0OlDGB' is not in list

10:05ValueError: 'EpSwqVCJL2X84i1yOVkHEJ' is not in list

10:06ValueError: 'bKvob7K4kc4I2Y5rihQ4Gp' is not in list

10:06ValueError: 'cku1N16rZhyiJUNd0OlDGB' is not in list

10:06ValueError: 'EpSwqVCJL2X84i1yOVkHEJ' is not in list

10:06ValueError: 'D9E8t44O9yvkoeM7UhhhQU' is not in list

10:06ValueError: 'EpSwqVCJL2X84i1yOVkHEJ' is not in list

10:06ValueError: 'EpSwqVCJL2X84i1yOVkHEJ' is not in list

10:06ValueError: 'EpSwqVCJL2X84i1yOVkHEJ' is not in list

10:06ValueError: 'EpSwqVCJL2X84i1yOVkHEJ' is not in list

10:06ValueError: 'EpSwqVCJL2X84i1yOVkHEJ' is not in list

10:06ValueError: 'cku1N16rZhyiJUNd0OlDGB' is not in list

10:06ValueError: 'cku1N16rZhyiJUNd0OlDGB' is not in list

10:06ValueError: 'cku1N16rZhyiJUNd0OlDGB' is not in list

10:06ValueError: 'cku1N16rZhyiJUNd0OlDGB' is not in list

10:06ValueError: 'cku1N16rZhyiJUNd0OlDGB' is not in list

10:06ValueError: 'cku1N16rZhyiJUNd0OlDGB' is not in list

10:06ValueError: 'cku1N16rZhyiJUNd0OlDGB' is not in list

10:06ValueError: 'cku1N16rZhyiJUNd0OlDGB' is not in list

10:07ValueError: 'xtCE42053ObqYUMAzddPNs' is not in list

10:07ValueError: 'wKjGrqH9fIP26bindl3ZTB' is not in list

10:07ValueError: 'HXuzQsM4WxVL2YF3hXvFR3' is not in list

10:07ValueError: 'Qch2ReMvAbHlSJbHT7SUfy' is not in list

10:07ValueError: 'vn9eCaA3gapzOaegHMtqnx' is not in list

10:07ValueError: 'zAdWJi75YfQaEFJJTq3lM7' is not in list

10:07ValueError: 'AXLXmgDLclOyjFqvgYwvPv' is not in list

10:07ValueError: 'he7jZuRGtWvaW08cjYkyjM' is not in list

10:07ValueError: 'J4DMpWmgDPcg50zemwHyeC' is not in list

10:07ValueError: 'LB3QyXeaV08qcJCvxMkmUZ' is not in list

10:07ValueError: 'bKvob7K4kc4I2Y5rihQ4Gp' is not in list

10:07ValueError: 'cku1N16rZhyiJUNd0OlDGB' is not in list

10:07ValueError: 'EpSwqVCJL2X84i1yOVkHEJ' is not in list

10:07ValueError: 'D9E8t44O9yvkoeM7UhhhQU' is not in list

10:07ValueError: 'XuEpETgESB4HU0Nvy8Y4fv' is not in list

10:07ValueError: 'MF5vpzqDmJ9X2thKroGbQd' is not in list

10:07ValueError: 'yhanKQtZ6bKIPFPdeiAX8j' is not in list

10:07ValueError: 'ClNmZpOrfP9yT3adf7iv0X' is not in list

10:07ValueError: 'egBW7GXPRpBiOucTaePif3' is not in list

10:07ValueError: 'MCw8y6nRLXRi4X3OLXK0Ni' is not in list

10:07ValueError: 'vq0UumGuWS4i2aCUbo0V8Z' is not in list

10:07ValueError: 'e86HFrxS1l37v1E0RokXpd' is not in list

10:07ValueError: 'kMH7D1NBJ6wqpYK11HR5Tl' is not in list

10:07ValueError: 'sA6JyqHsiAmltoPvZ55Y9l' is not in list

10:07ValueError: 'ZVEFx8EavP9kiouH0ncofn' is not in list

10:07ValueError: 'pqL1SSGrF7f04WSDXHh2Ii' is not in list

10:07ValueError: 'ZVEFx8EavP9kiouH0ncofn' is not in list

10:08ValueError: 'zAdWJi75YfQaEFJJTq3lM7' is not in list

10:08ValueError: 'AXLXmgDLclOyjFqvgYwvPv' is not in list

10:08ValueError: 'he7jZuRGtWvaW08cjYkyjM' is not in list

10:08ValueError: 'J4DMpWmgDPcg50zemwHyeC' is not in list

10:08ValueError: 'LB3QyXeaV08qcJCvxMkmUZ' is not in list

10:08ValueError: 'bKvob7K4kc4I2Y5rihQ4Gp' is not in list

10:08ValueError: 'cku1N16rZhyiJUNd0OlDGB' is not in list

10:08ValueError: 'EpSwqVCJL2X84i1yOVkHEJ' is not in list

10:08ValueError: 'D9E8t44O9yvkoeM7UhhhQU' is not in list

11:40RuntimeError: Could not unlink file /var/datalore/persister/8/workbook_storage_last_expr/datafile.1539: 2 No such file or directory

12:26RuntimeError: Could not unlink file /var/datalore/persister/8/workbook_storage_last_expr/datafile.1539: 2 No such file or directory

12:26ValueError: 'egBW7GXPRpBiOucTaePif3' is not in list

12:26ValueError: 'MCw8y6nRLXRi4X3OLXK0Ni' is not in list

12:26ValueError: 'vq0UumGuWS4i2aCUbo0V8Z' is not in list

12:26ValueError: 'e86HFrxS1l37v1E0RokXpd' is not in list

12:26RuntimeError: Invalid index to insert: 66```

igro · March 18, 2021, 11:01pm

Hello @naturlieb!

We have seen similar errors before, but unfortunately have not been able to trace the root cause yet, we will try to figure out what is wrong there.

If you have stable steps to reproduce the issue, that would help us a lot.

Sergey_Stupin · March 19, 2021, 6:30am

Is Variable viewer opened while you are working?

naturlieb · March 19, 2021, 7:46am

hi, thanks for your suggestion.
no it wasn`t.

naturlieb · March 19, 2021, 7:47am

I just copied all the code from the currupted notebook to a new one.

It gave me the first CPU error:

Kernel errors:
08:44Exception: (‘Unknown command’, ‘reqid: “2IUvp7Dyqgv2bG6yOrjapJ”\ncellid: “aUrfTxvr0mkOBSH7RCbu0y”\ninput {\n value: “10”\n}\n’)

after running:

def gen_fib():

count = int(input("How many fibonacci numbers would you like to generate? "))

i = 1

if count == 0:

    fib = []

elif count == 1:

    fib = [1]

elif count == 2:

    fib = [1,1]

elif count > 2:

    fib = [1,1]

    while i < (count - 1):

        fib.append(fib[i] + fib[i-1])

        i += 1

return fib

gen_fib()

now the notbook is “corrupted” what makes it impossible to run cells.

naturlieb · March 19, 2021, 7:53am

another one on the “corruped” one from yesterday:
07:54RuntimeError: Could not unlink file /var/datalore/persister/8/workbook_storage_last_expr/datafile.1539: 2 No such file or directory

naturlieb · March 22, 2021, 5:37pm

Ok, I just managed to break another Notebook.
Mostly its the same errors like Kernel, Runtime and Value:

Kernel errors:
17:42Exception: (‘Unknown command’, ‘reqid: “cLNucYIfTExQZ1hsALijXI”\ncellid: “AZ39dCMHGT31dPoIXHOpL6”\ninput {\n value: “16”\n}\n’)

Kernel errors:
08:44 Exception: (‘Unknown command’, ‘reqid: “2IUvp7Dyqgv2bG6yOrjapJ”\ncellid: “aUrfTxvr0mkOBSH7RCbu0y”\ninput {\n value: “10”\n}\n’)

RuntimeError:
09:41 RuntimeError: Could not unlink file /var/datalore/persister/8/workbook_storage_last_expr/datafile.1539: 2 No such file or directory

ValueError:
10:05ValueError: ‘MF5vpzqDmJ9X2thKroGbQd’ is not in list

more info, from what i felt:

the notebooks are normaly stuck on the startup, so i need to manually start them
-not started
i am running like 2-3h sessions on datalore.
it seems this occurs more often on the end of an session.
i am switching between mac an PC once in a while.
depend on where i am working from
sometimes i add about 3 empty cells to separate them more visually
at the end of a session i run all cells to see, if there are some errors in my cells left

kind regards

lumbric · April 23, 2021, 8:45am

@igro @Sergey_Stupin were you able to reproduce the issue? Do you need any further information?

igro · April 23, 2021, 10:55am

@lumbric multiple improvements in the Datalore kernel have already been implemented, unfortunately there are still some cases that could cause ValueError: ‘...’ is not in list errors, we are working on it, but please let us know if you notice any other problems here. Thank you!

lumbric · April 27, 2021, 7:41am

Hm “other problems” probably not, I guess it is the same one - at least the error message is the same.

naturlieb · May 26, 2021, 6:22am

Still could not replicate the issue.
just got another 90+ errors on my notebook.
but the errors seems to repeat:

…
09:33ValueError: ‘t6y1QlJG8asAr6iBsFqF9c’ is not in list

09:33ValueError: ‘8s1vLV9WGnw8AH34CK3ZoI’ is not in list