So I’m getting back a streaming response from a whisper api I set up to use fly.io GPU’s. So far I can call it, get back chunks as they come in using req’s into: parameter and put the text and timestamp on a Phoenix LiveView. What I’m struggling with is how to capture all the incoming chunks to a li…

[image] jtomchak: Yeah I saw the :private field but was scared off with the detail Yeah, sorry about that, it’s on my roadmap to improve documentation around this. req.private and resp.private exist solely so when writing steps and into: fun we can store intermediate state. The only restricti…

I have never actually done this but my impression reading the docs is that you’re meant to use the response in the {req, resp} tuple (your context) as an accumulator. You could place the chunks in the :private field of resp under your own key. See :private under “Fields” at Req.Response . Or you cou…

Yeah I saw the :private field but was scared off with the detail a map reserved for libraries and frameworks to use. Prefix the keys with the name of your project to avoid any future conflicts. Only accepts atom/0 keys. But it’s worth a shot

ok. so I should be able to use resp.private to append the chunks as they come back into a list. sweet. I’ll try it out and post the results. I tried with an Agent and managed to get the results back correctly, probably not idiomatic Elixir. def transcribe_audio(url, callback) do req = R…

I don’t seem to be able to append/update :private from within the into: fun def transcribe_audio(url, callback) do req = Req.new( url: "http://faster-whisper-server-patient-voice-8559.flycast/v1/audio/transcriptions", connect_options: [transport_opts: [inet6: true]], …

put_private, update_private, etc return updated response, you need to reassign the resp variable. Btw you can nowadays drop Multipart dependency since we have this capability built in, see encode_body/1 step.

:man_facepalming: d’oh. There we go. Thank you for your help, and the tip on multi part. :+1:

Elixir Programming Language Forum

Handling http response streaming

Questions & Help Questions

jtomchak September 6, 2024, 11:37am 8

d’oh. There we go. Thank you for your help, and the tip on multi part.