Re: Accessing data from a 30 GB file in json format

Its a Memory Error. PFA the screenshot.

On Mon, Jul 1, 2019 at 3:41 PM John Bagiliko <john.bagiliko@aims-senegal.org> wrote:

A screenshot may be better

On Mon, Jul 1, 2019, 10:10 AM John Bagiliko <john.bagiliko@aims-senegal.org> wrote:

What is the error message?

On Mon, Jul 1, 2019, 10:07 AM Nibil Ashraf <nibil.ashraff@gmail.com> wrote:

Hey,

I have a file with a size of around 30GB. The file is in json format. I have to access the data and write that to a csv file. When I tried to do that with my laptop which has a a RAM of 4GB, I am getting some error. I tried to load the json file like this json_parsed = json.loads(json_data)

Can someone help me with this? How should I do this? If I should go with some server, please let me know what specifications should I use? 

--
You received this message because you are subscribed to the Google Groups "Django users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to django-users+unsubscribe@googlegroups.com.
To post to this group, send email to django-users@googlegroups.com.
Visit this group at https://groups.google.com/group/django-users.
To view this discussion on the web visit https://groups.google.com/d/msgid/django-users/CAPBZ7vD6Ai5DOAudytO7QeW1ejUqdqyB5YH3F7aTg4YoXtF-uw%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "Django users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to django-users+unsubscribe@googlegroups.com.
To post to this group, send email to django-users@googlegroups.com.
Visit this group at https://groups.google.com/group/django-users.
To view this discussion on the web visit https://groups.google.com/d/msgid/django-users/CAC26BE2Oxrc8kq%3DdfgH7880-h9qRmtjaJeoHmOw851x0WnxT5A%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "Django users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to django-users+unsubscribe@googlegroups.com.
To post to this group, send email to django-users@googlegroups.com.
Visit this group at https://groups.google.com/group/django-users.
To view this discussion on the web visit https://groups.google.com/d/msgid/django-users/CAPBZ7vB%3DOX1YeywoKt%3DN0tXxxQg5RgXK_6A2HU4TV7B%3DaEVuMA%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.