Streaming input: big files input or endless input
maxlapshin opened this issue · comments
I have two cases, that are not covered with misultin yet.
They are very, very important for me now and I think, that one of them will be important for many people.
First is big file upload. Just imagine: I want to upload BluRay disk. I can't raise memory limit, so we need just streaming input.
If I upload to Ruby on Rails application begin nginx, I would do simply thing: setup nginx to save request body to the same partition, where Rails store files, than Rails will get just local path.
But it is not what I want from misultin, because I have other case for upload. If user upload flv file, I want to be able to stream it from the very beginning. So, I need to have streaming input interface.
The same streaming input can be used for endless input streams.
I will try to make a fork and add proper patch, but if you have any ideas about best architecture, it would be great.
basically you are asking to have an option for misultin to not parse automatically the body, and have a way to do so actively? if this is the case, this option is already under consideration.
I would like to be able to do this as well (handle chunked uploads) for processing large files over HTTP. Any idea when this functionality can be implemented in misultin?
hi,
i've been busy in implementing quite some features and this request has been temporarily put aside.
i believe the best way to do so is what i suggested here above, i.e. have an option for misultin to not parse the body automatically, and therefore allow a way to gradually receive the content body.
would this do for the both of you?
I think that would work fine. I'd like to be able to handle large files (>100MB, 1GB, etc...) and I can't do that with misultin until something like this is implemented.
indeed. i will look asap into this.
+1
@maxlapshin, @jbrisbin, @cloudhead: the feature requested is now in master head.
example usage here: https://github.com/ostinelli/misultin/blob/master/examples/misultin_body_recv.erl
please let me know asap if this fits your needs / bugs, etc.
thank you,
r.
Thanks for letting me know! :)
I'll try it out...
Thanks!
Jon Brisbin
http//jbrisbin.com
----- Original Message -----
From: "Roberto Ostinelli"
reply@reply.github.com
To: "J. Brisbin" jon@jbrisbin.com
Sent: Saturday, November 19, 2011 7:48:47 PM
Subject: Re: [misultin] Streaming input: big files input or endless
input (#43)@maxlapshin, @jbrisbin, @cloudhead: the feature requested is now in
head.example usage here:
https://github.com/ostinelli/misultin/blob/master/examples/misultin_body_recv.erlplease let me know asap if this fits your needs / bugs, etc.
thank you,
r.
Reply to this email directly or view it on GitHub:
#43 (comment)
issue closed.