Datalore SQL cells issue

Hello,

We’re experiencing an issue with the DataLore enterprise version (Hosted on Docker in AWS machine), when trying to run SQL queries. Here is the error we receive:
“JSONDecodeError: Expecting value: line 1 column 2357640 (char 2357639)”.

In order to investigate its origins, we created a table with one column, with only one possible value - True, or 1. Since some of the queries succeeded, until a certain amount of rows (~250000) - we concluded that in spite of the error pointing at Json discrepancy, it might be a different problem.

The number of rows we can retrieve without getting the error is unstable, and depends on the specific run - so perhaps it seems like a memory allocation issue.

The free RAM that appears in that DataLore IDE is around 8GB, and the CPU peaks at 25-50% during the query runtime.

We could not find any advanced options inside DataLore to configure the connection memory limitations.

Can you help us solve this problem?
Thanks in advance.

1 Like

Hello @Sagi ,

Thank you for the detailed report! I was able to reproduce this error on our instance and notified the dev team.

Will keep you posted!

Thank you,
Igor Medovolkin
QA Engineer in Datalore

Hey Igor,

Appreciate your answer, and looking forward to your update - As this issue plays a major role in our decision whether we go from POC to production.

Thanks!

I got same error with IDE of 30GB
how to solve it?

We found and fixed a race condition which caused JSONDecodeError during the data processing step. The fix is already deployed to our cloud instance (datalore.jetbrains.com) and will also be included into the next Enterprise release (2023.2, mid-April).

Thank you!