Sunday, July 4, 2021

Need an Advice about large database I/O

Hello Friends,

Hope all is well,

I have a project that involves reading large data files ( csv, excel sheets ) and writing them to a database.

I am thinking of using the django ORM to read / write from files from / to the database ( maybe postgresql ) and to use Django templates to show records from the database.

Is django the write solution for this? using ORM and templates ?

When writing thousands of records to the database , can I execute this in another thread or asynchronously ?

When reading millions of records from a database , how to do it without freezing the view until all records are loaded ?

Looking forward to all your thoughts.

Regards

--
You received this message because you are subscribed to the Google Groups "Django users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to django-users+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/django-users/CAHV4E-ep4Ut%2BEzpc%2BDB5VmJ%2BQn_m90Cqh2wGj0DCC82d%2BQoyBg%40mail.gmail.com.

No comments:

Post a Comment