I understand the argument of “erlang has it’s roots in telephony, of course erlang/elixir is a great fit for this” I understand that voice chat is “basically just a router for udp packets, and elixir has great libraries for those” For whatever reason, looking at old threads, I am not finding…

It’s an SFU server You can easily find a lot of information about WebRTC on the net, for example at https://webrtchacks.com/ . In short, it goes like that: before starting the transmission, the session is negotiated (network addresses, certificates, tracks, codecs etc) using the SDP offer-an…

[image] RudManusachi: My understanding of such project is: elixir/erlang is a great fit of “orchestration”… connecting people, setting the pipeline of encoding/decoding/streaming via web/etc. But underneath those encoder/decoder are still delegated to some low level libs. Do you have any intu…

My vague memories from “signal processing” class remind me that those algorithms usually require lots of numerical calculations. Simply saying - if digital audio is represented as a list of numbers - any conversion of it would require some kind of number crunching which is not the strongest side of …

[image] zeroexcuses: Is there some expensive step with encoding/mixing/decoding that Erlang/Elixir is not well suited for? Not sure there’s any perfectly justified reason but at least my thinking would be that the BEAM has GC pauses (albeit very short and are per-process which should limit th…

[image] zeroexcuses: I understand the argument of “erlang has it’s roots in telephony, of course erlang/elixir is a great fit for this” I understand that voice chat is “basically just a router for udp packets, and elixir has great libraries for those” Agreed :wink: [image] zeroexcuses: …

@mat-hek : Thanks for the detailed and insightful reply. Can you please verify that Membrane also supports client->server instead of just p2p chat? For example, if we are doing something like Minecraft/AmongUs proximity chat, we want the server to be able to take the audio streams, take the user’…

@mat-hek : Thank you for the detailed response. I went through the SFU link. Is the main difference between MCU vs SFU as follows: MCU = server receives all incoming streams, decodes them, laysout streams on a ‘virtual screen’, re-encodes virtual screen SFU = server does not modify any incomin…

[image] mat-hek: if the connected peer is the Membrane server, it unpacks the audio (OPUS) stream with Membrane.WebRTC.EndpointBin . That bin consists of the ICE endpoint with DTLS handshake, and the RTP bin, that handles SRTP, SRTCP and some of their extensions. at that point, you can do anythi…

[image] zeroexcuses: @mat-hek : Thank you for the detailed response. I went through the SFU link. Is the main difference between MCU vs SFU as follows: MCU = server receives all incoming streams, decodes them, laysout streams on a ‘virtual screen’, re-encodes virtual screen SFU = server does n…

[image] mat-hek: it doesn’t do reencoding, it only repacks/re-muxes streams I do not yet know the difference between “re-encode” and “re-pack/re-mux”. The following is current best guess, is it correct? Suppose we have input streams A, B, C, D, E and we want to output A+0.5B+0.1C re–pack/…

You’re basically right. Encoding refers to codecs (like Opus or H264) and usually involves media compression, while packing/muxing refers to protocols or containers (like RTP or MP4), which only wrap the media, usually by adding some headers. Encoding usually involves some heavy computing, while mux…

Elixir Programming Language Forum

Erlang/elixir sample code for real time voice chat?

Questions & Help Questions

mickel8 August 28, 2024, 2:54pm 21

And the examples are deployed under Elixir WebRTC