M
Mo Moustafa
AI product engineer and creator of Olly (olly.bot), an AI assistant in iMessage with 250K+ users; guest on Packet Pushers' Day Two DevOps discussing OpenRouter and open-source models.
3
APPEARANCES
3
PODCASTS
024
DEC 30
JAN 6
JAN 13
JAN 20
JAN 27
FEB 3
FEB 10
FEB 17
FEB 24
MAR 3
MAR 10
MAR 17
MAR 24
MAR 31
APR 7
APR 14
APR 21
APR 28
MAY 5
MAY 12
MAY 19
MAY 26
JUN 2
JUN 9
JUN 16
JUN 23
JUN 30
JUL 7
JUL 14
JUL 21
JUL 28
AUG 4
AUG 11
AUG 18
AUG 25
SEP 1
SEP 8
SEP 15
SEP 22
SEP 29
OCT 6
OCT 13
OCT 20
OCT 27
NOV 3
NOV 10
NOV 17
NOV 24
DEC 1
DEC 8
DEC 15
DEC 22
DEC 29
JAN 5
JAN 12
JAN 19
JAN 26
FEB 2
FEB 9
FEB 16
FEB 23
MAR 2
MAR 9
MAR 16
MAR 23
MAR 30
APR 6
APR 13
APR 20
APR 27
MAY 4
MAY 11
MAY 18
MAY 25
JUN 1
JUN 8
JUN 15
JUN 22
JUN 29
JUL 6
JUL 13
JUL 20
JUL 27
AUG 3
AUG 10
AUG 17
AUG 24
AUG 31
SEP 7
SEP 14
SEP 21
SEP 28
OCT 5
OCT 12
OCT 19
OCT 26
NOV 2
NOV 9
NOV 16
Nov 4, 2026
D2DO318: Navigating Open-Source Model Providers
13:27

Kyler MiddletonHOST
What behaviors are you seeing that are different and how do you control for that?
M
13:34Mo MoustafaGUEST
The main thing to know is each provider gets the raw weights of the open source model and And then each of them has different hardware.
M
13:58Mo MoustafaGUEST
The hardware might mean that one of them has more RAM compared to, let's say, like flops available, or some of them have more flops than RAM.
M
14:12Mo MoustafaGUEST
And so in order to make the to make the best use of their hardware because they don't want to to waste any um any of the capacity that they have by not utilizing all of their flops or all of the RAM, they might make some different parameter optimizations.
6 MINS LATER
D2DO318: Navigating Open-Source Model Providers
13:27

Kyler MiddletonHOST
What behaviors are you seeing that are different and how do you control for that?
M
13:34Mo MoustafaGUEST
The main thing to know is each provider gets the raw weights of the open source model and And then each of them has different hardware.
M
13:58Mo MoustafaGUEST
The hardware might mean that one of them has more RAM compared to, let's say, like flops available, or some of them have more flops than RAM.
M
14:12Mo MoustafaGUEST
And so in order to make the to make the best use of their hardware because they don't want to to waste any um any of the capacity that they have by not utilizing all of their flops or all of the RAM, they might make some different parameter optimizations.
6 MINS LATER
D2DO318: Navigating Open-Source Model Providers
13:27

Kyler MiddletonHOST
What behaviors are you seeing that are different and how do you control for that?
M
13:34Mo MoustafaGUEST
The main thing to know is each provider gets the raw weights of the open source model and And then each of them has different hardware.
M
13:58Mo MoustafaGUEST
The hardware might mean that one of them has more RAM compared to, let's say, like flops available, or some of them have more flops than RAM.
M
14:12Mo MoustafaGUEST
And so in order to make the to make the best use of their hardware because they don't want to to waste any um any of the capacity that they have by not utilizing all of their flops or all of the RAM, they might make some different parameter optimizations.
6 MINS LATER