[Flask] REST based File Sharing server Implementation in Flask

[Corey Boyle]

I see. You could run an object store locally, but that may be more moving
parts than you want at this point.


__
Corey

On Jun 25, 2017 1:58 PM, "G.S.Vijay Raajaa" <gsvijayraajaa at gmail.com> wrote:

> This issue is that the project will be deployed on-premise with no
> internet connectivity from the server. So any 3rd party cloud service is
> ruled out.
>
> Regards,
> Vijay Raajaa GS
>
> On Sun, Jun 25, 2017 at 11:24 PM, Corey Boyle <coreybrett at gmail.com>
> wrote:
>
>> You might also consider storing files in AWS S3 or some other object
>> store. Dreamhost has a service for that as well.
>>
>>
>> __
>> Corey
>>
>> On Jun 25, 2017 1:47 PM, "G.S.Vijay Raajaa" <gsvijayraajaa at gmail.com>
>> wrote:
>>
>>> The number of non-block servings will correspond to the max number of workers in that case? Hypothetically if one user uploads multiple files that keeps all the workers busy, I am blocked when rest of the users online trying to upload files. Any thoughts to delegate it asynchronously?
>>>
>>> Regards,
>>>
>>> Vijay Raajaa GS
>>>
>>>
>>> On Sun, Jun 25, 2017 at 10:13 PM, G.S.Vijay Raajaa <
>>> gsvijayraajaa at gmail.com> wrote:
>>>
>>>> Hi UB,
>>>>
>>>> Thanks for the idea. I shall probe more into the same. But I have quick
>>>> clarifications, even with mongo/gridfs and having the connectionI/O
>>>> delegated to the database driver makes the transaction blocking? Kindly
>>>> correct me if I am wrong. Is there a async way of handling the upload to
>>>> mongo and keep flask serve other incoming request?
>>>>
>>>> On the same note, w.r.t mongodb-gridFS, how do you think the write
>>>> performance is when compared to storing them directly on the filesystem,
>>>> same w.r.t to read for serving?
>>>>
>>>> I like to idea of scalability when you have file store within DB.
>>>>
>>>> Regards,
>>>> Vijay Raajaa GS
>>>>
>>>> On Sun, Jun 25, 2017 at 8:08 PM, G.S.Vijay Raajaa <
>>>> gsvijayraajaa at gmail.com> wrote:
>>>>
>>>>> Hi,
>>>>>
>>>>> I am trying to build a REST based file sharing server on top of flask.
>>>>> I am looking for a scalable stack.
>>>>>
>>>>> The requirement goes as follows;
>>>>>
>>>>> 1) Cater multiple file uploads.
>>>>> 2) Files can be of the order of 30-100GB. The server hosting the
>>>>> python webserver should not read the file to memory and spill to disk.
>>>>> 3) Non blocking - when user uploads multiple files.
>>>>> 4) Non blocking - when multiple user try to upload files.
>>>>>
>>>>> Pointers to any existing open source project is also much appreciated.
>>>>>
>>>>> Idea inspired from https://filebin.net/
>>>>>
>>>>> Seeing if celery + Flask can come handy. Kindly suggest the WSGI to
>>>>> use it for production too.
>>>>>
>>>>> Looking forward to your valuable suggestions.
>>>>>
>>>>> Regards,
>>>>> Vijay Raajaa GS
>>>>>
>>>>
>>>>
>>>
>>> _______________________________________________
>>> Flask mailing list
>>> Flask at python.org
>>> https://mail.python.org/mailman/listinfo/flask
>>>
>>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/flask/attachments/20170625/6ee8a910/attachment-0001.html>