1
00:00:01,880 --> 00:00:05,280
Hey everybody, welcome back to 
the Elon Musk Podcast. 

2
00:00:05,360 --> 00:00:08,640
This is a show where we discuss 
the critical crossroads, The 

3
00:00:08,640 --> 00:00:13,520
Shape, SpaceX, Tesla X, The 
Boring Company, and Neurolink. 

4
00:00:13,840 --> 00:00:19,240
I'm your host Will Walden, Elon 
Musk's AI company XAI has 

5
00:00:19,240 --> 00:00:24,560
released Grok 2.5 Urban Open 
Source License, raising one 

6
00:00:24,560 --> 00:00:29,640
question what exactly does Elon 
Musk gain from giving away his 

7
00:00:29,680 --> 00:00:33,640
code? 
This makes XAI the first major 

8
00:00:33,840 --> 00:00:38,560
U.S. company to open source, a 
flagship conversational model 

9
00:00:38,720 --> 00:00:42,920
while it's still considering 
competitive and it directly 

10
00:00:42,920 --> 00:00:45,560
challenges the closed source 
strategies of other companies 

11
00:00:45,880 --> 00:00:48,920
like Open AI, Anthropic and 
Google DeepMind. 

12
00:00:49,320 --> 00:00:52,680
Musk framed the decision as a 
philosophical one about 

13
00:00:52,680 --> 00:00:57,760
transparency, but the decision 
also positions XAI to expand its

14
00:00:57,760 --> 00:01:01,480
influence without outspending 
its rivals and user acquisition 

15
00:01:01,480 --> 00:01:03,840
or cloud infrastructure. 
Now. 

16
00:01:04,040 --> 00:01:08,480
XAI published the weights and 
architecture for Grok 2.5 Friday

17
00:01:08,480 --> 00:01:12,000
night, uploading them to a 
public GitHub repository under 

18
00:01:12,000 --> 00:01:16,400
the Apache 2 Point O license. 
A license allows anyone to use, 

19
00:01:16,680 --> 00:01:21,640
modify, or build on Grok 2.5, 
including for commercial 

20
00:01:21,640 --> 00:01:26,880
purposes, without paying XAI 
anything or attributing anything

21
00:01:26,880 --> 00:01:29,960
to XAI. 
Now this immediately makes Grok 

22
00:01:29,960 --> 00:01:33,800
2.5 one of the most permissively
licensed large language models 

23
00:01:34,240 --> 00:01:38,280
ever released at this scale. 
The model comes in two sizes, a 

24
00:01:38,360 --> 00:01:43,400
314 billion parameter version 
trained with mixture of experts 

25
00:01:43,400 --> 00:01:47,600
techniques and a smaller dense 
version with 25 billion 

26
00:01:47,600 --> 00:01:50,480
parameters. 
Both are trained on publicly 

27
00:01:50,480 --> 00:01:54,920
available and licensed data 
sources, according to X AI and 

28
00:01:54,920 --> 00:01:58,160
Elon Musk described the release 
as a commitment to openness and 

29
00:01:58,160 --> 00:02:01,680
said it aligns with XA is 
broader mission to develop AI 

30
00:02:02,000 --> 00:02:06,360
that benefits all of humanity. 
He previously criticized Sam 

31
00:02:06,360 --> 00:02:09,800
Altman and Open AI for switching
to a closed source model after 

32
00:02:09,800 --> 00:02:12,720
becoming a for profit company in
March. 

33
00:02:12,880 --> 00:02:17,320
XAI open source Croc 1, though 
that model lagged way behind 

34
00:02:17,320 --> 00:02:20,960
current commercial systems, Croc
2.5 narrows that gap 

35
00:02:20,960 --> 00:02:23,960
considerably. 
According to internal 

36
00:02:23,960 --> 00:02:29,040
evaluations, Croc 2.5 ranks 
close to GPT 4 on several 

37
00:02:29,040 --> 00:02:32,640
benchmarks, including MMLU, 
which is massive multitask 

38
00:02:32,640 --> 00:02:36,520
language understanding and Human
Evil, a programming test 

39
00:02:36,520 --> 00:02:40,360
commonly used to measure LLM 
coding capabilities. 

40
00:02:40,760 --> 00:02:44,520
So releasing Grok 2.5 under 
Apache 2 Point O immediately 

41
00:02:44,520 --> 00:02:49,520
places pressure on Sam Altman 
and Open AI in Anthropic, who 

42
00:02:49,520 --> 00:02:52,920
have argued that safety risks 
justify keeping their most 

43
00:02:52,920 --> 00:02:56,520
capable models closed. 
Musk has openly dismissed that 

44
00:02:56,520 --> 00:02:59,600
rationale, claiming that 
companies are using safety as an

45
00:02:59,600 --> 00:03:03,840
excuse to maintain control over 
their code base and their user 

46
00:03:03,840 --> 00:03:07,800
base. 
Now by Elon open sourcing Grok 

47
00:03:07,800 --> 00:03:12,240
2.5 X AI makes it easier for 
startups, researchers and other 

48
00:03:12,240 --> 00:03:15,880
companies to train on a strong 
base model without building from

49
00:03:15,880 --> 00:03:19,040
scratch. 
The trade off Less control for 

50
00:03:19,040 --> 00:03:22,800
broader adoption mirrors what 
Meta has done with Llama two and

51
00:03:22,800 --> 00:03:25,200
three. 
Though Meta still uses a non 

52
00:03:25,200 --> 00:03:29,040
commercial license, the release 
also serves A practical purpose.

53
00:03:29,440 --> 00:03:34,440
Grok runs inside X, where it 
appears the chatbot for premium 

54
00:03:34,440 --> 00:03:37,720
Subs. 
Making Grok 2.5 open source 

55
00:03:37,720 --> 00:03:41,400
gives Musk access to a global 
pool of developers who can test,

56
00:03:41,400 --> 00:03:45,120
improve, and adapt the system 
without being on XA is payroll. 

57
00:03:46,000 --> 00:03:47,720
Now. 
That outsourcing effect has 

58
00:03:47,720 --> 00:03:52,120
already benefited Llama Meta's 
ecosystem, and Musk appears to 

59
00:03:52,120 --> 00:03:54,840
be betting that it can be done 
with Grok as well. 

60
00:03:55,600 --> 00:03:59,400
XAI has stated that future 
versions, including Grok 3, may 

61
00:03:59,400 --> 00:04:03,640
not be open source, suggesting 
that Grok 2.5 may serve as the 

62
00:04:03,640 --> 00:04:07,280
platform's long term public 
version while development 

63
00:04:07,280 --> 00:04:09,440
continues behind the scenes on 
other models. 

64
00:04:10,080 --> 00:04:13,880
Now, Musk has also said the Grok
2.5 has been trained to be 

65
00:04:13,880 --> 00:04:18,160
maximally truthful, quality that
remains difficult to measure. 

66
00:04:18,920 --> 00:04:22,920
XAI claims that Grok now 
outperforms Claude 2.1, Gemini 

67
00:04:23,040 --> 00:04:27,600
1.5, and GPT 4 in some 
conversational tasks, though 

68
00:04:27,920 --> 00:04:29,720
external benchmarks vary on 
that. 

69
00:04:30,320 --> 00:04:33,720
Grok 2.5 is not connected to 
Real Time Search or X's live 

70
00:04:33,720 --> 00:04:37,800
data feed, though that's unlike 
the private chat bot used by X 

71
00:04:37,800 --> 00:04:40,560
users. 
That means developers using the 

72
00:04:40,560 --> 00:04:43,680
open source Grok will not have 
access to Musk's internal data 

73
00:04:43,680 --> 00:04:46,960
pipelines, which remain a 
competitive asset unique to the 

74
00:04:46,960 --> 00:04:49,680
version of Grok embedded within 
X. 

75
00:04:50,640 --> 00:04:55,400
And open sourcing Grok 2.5 also 
gives XAI a way to compete with 

76
00:04:55,400 --> 00:04:58,000
Big Tech without relying on 
partnerships. 

77
00:04:58,520 --> 00:05:02,880
Unlike Anthropic, which has tied
itself closely to Amazon, or 

78
00:05:02,880 --> 00:05:07,320
Open AI, which remains linked to
Microsoft, XAI operates as an 

79
00:05:07,320 --> 00:05:10,920
independent entity that would 
benefits from its access to X's 

80
00:05:10,920 --> 00:05:14,360
user data in its upcoming 
integration with Tesla's 

81
00:05:14,360 --> 00:05:17,400
interface hardware. 
Now, the open source model 

82
00:05:17,400 --> 00:05:21,240
allows XAI to sidestep capital 
constraints by letting external 

83
00:05:21,240 --> 00:05:25,520
users do much of the refinement 
and experimentation that would 

84
00:05:25,520 --> 00:05:28,320
otherwise require dedicated in 
house teams. 

85
00:05:28,720 --> 00:05:31,040
I want to know if you're on your
podcast platform right now. 

86
00:05:31,040 --> 00:05:33,080
If you have comments, leave a 
comment. 

87
00:05:33,240 --> 00:05:38,120
Would you use grok at home? 
Would you be able to mix it 

88
00:05:38,120 --> 00:05:40,280
yourself? 
Would you download it from 

89
00:05:41,120 --> 00:05:43,560
GitHub and be able to use it? 
Let me know. 

90
00:05:43,560 --> 00:05:45,960
Let me know what what comes of 
this. 

91
00:05:46,560 --> 00:05:52,440
So let's get back into Grok. 
Though the 2.5 version mixture 

92
00:05:52,440 --> 00:05:55,920
of Experts architecture divides 
the model into separate 

93
00:05:55,920 --> 00:05:59,840
subnetworks, only a portion of 
which activate at any given 

94
00:05:59,840 --> 00:06:04,040
time, this design improves 
efficiency and reduces training 

95
00:06:04,040 --> 00:06:06,360
costs, especially when deployed 
at scale. 

96
00:06:06,680 --> 00:06:10,560
It also means that developers 
who download Grok 2.5 will need 

97
00:06:10,560 --> 00:06:13,720
infrastructure capable of 
handling that complexity. 

98
00:06:14,080 --> 00:06:17,400
That may limit adoption among 
individual users or small teams,

99
00:06:17,720 --> 00:06:21,480
but larger labs and cloud based 
EI platforms can run the model 

100
00:06:21,480 --> 00:06:26,600
with relative ease and for free.
Releasing such a large scale 

101
00:06:27,000 --> 00:06:31,600
open source model at this time 
sends a huge signal to the 

102
00:06:31,600 --> 00:06:35,160
industry. 
XAI is betting on diffusion over

103
00:06:35,160 --> 00:06:38,120
exclusivity. 
By removing licensing friction, 

104
00:06:38,400 --> 00:06:41,800
it creates a channel for grok 
based variance to proliferate 

105
00:06:42,040 --> 00:06:45,440
across research labs, startups 
and independent projects. 

106
00:06:45,880 --> 00:06:48,800
Musk appears to believe that 
wide availability will help 

107
00:06:48,800 --> 00:06:51,840
create loyalty and technical 
entrenchment, even if it's 

108
00:06:51,840 --> 00:06:55,960
limits of the company ability to
monetize Grok directly and make 

109
00:06:55,960 --> 00:06:59,680
money from every user. 
The decision also reinforces 

110
00:06:59,680 --> 00:07:02,760
Musk's public feud with Open AI 
and Sam Altman. 

111
00:07:03,200 --> 00:07:06,680
He Co founded the company in 
2015, then left in 2018 after 

112
00:07:06,680 --> 00:07:09,600
internal disagreements. 
Since then, Musk has attacked 

113
00:07:09,600 --> 00:07:13,120
Open AI repeatedly, suing it 
earlier this year and accusing 

114
00:07:13,120 --> 00:07:16,680
CEO Sam Altman of betraying its 
founding principles. 

115
00:07:17,120 --> 00:07:21,080
XA is release of Croc 2.5 under 
a fully open license marks a 

116
00:07:21,080 --> 00:07:24,760
clear ideological split from the
commercial closed source path 

117
00:07:24,760 --> 00:07:28,840
that Open AI has taken since its
partnership with Microsoft, and 

118
00:07:28,840 --> 00:07:32,040
Croc 2.5 is now freely available
to download on GitHub. 

119
00:07:32,320 --> 00:07:36,720
You can go do it right now. 
They have install instructions 

120
00:07:36,720 --> 00:07:39,280
and model weights posted 
alongside this license. 

121
00:07:40,480 --> 00:07:43,720
Any developer can fine tune it 
for their own applications. 

122
00:07:43,720 --> 00:07:48,480
You can use it for whatever you 
want to use it for and they have

123
00:07:48,520 --> 00:07:51,760
no say over what you do with it.
Download the code, you can do 

124
00:07:51,760 --> 00:07:52,960
whatever you want to with it 
now. 

125
00:07:54,560 --> 00:07:57,240
You can integrate it into custom
pipelines or study its 

126
00:07:57,240 --> 00:07:59,720
architecture for academic 
purposes. 

127
00:08:00,240 --> 00:08:03,480
You can make a for profit 
company using Grok. 

128
00:08:04,400 --> 00:08:08,160
XAI has not imposed any 
restrictions on use beyond what 

129
00:08:08,160 --> 00:08:11,760
is standard under Apache 2 Point
O, which includes liability 

130
00:08:11,760 --> 00:08:13,800
disclaimers. 
But there's no functional 

131
00:08:13,800 --> 00:08:16,480
limitations on you. 
You can just go wild and build 

132
00:08:16,480 --> 00:08:19,720
whatever you want to build. 
They're planning a flag right 

133
00:08:19,720 --> 00:08:23,880
now in a part of the EI space 
that remains divided between 

134
00:08:23,880 --> 00:08:27,480
access and control. 
The release turns Grok into a 

135
00:08:27,520 --> 00:08:30,840
public tool now that does 
something you get on X or in 

136
00:08:30,840 --> 00:08:33,640
your Tesla. 
It's not just a product anymore.

137
00:08:33,640 --> 00:08:37,520
This is for everybody. 
And Musk claimed this earlier 

138
00:08:37,520 --> 00:08:40,919
this year that he was going to 
release Grok open source and 

139
00:08:40,919 --> 00:08:42,240
everybody would be able to use 
it. 

140
00:08:42,600 --> 00:08:46,680
Now, like we said before, the 
next version of Grok will be 

141
00:08:46,680 --> 00:08:49,880
closed source. 
They're planning on using Grok 

142
00:08:49,880 --> 00:08:55,560
2.5 for testing and so they can 
have something available for 

143
00:08:55,560 --> 00:08:59,040
people to use and when they 
upgrade from the next version of

144
00:08:59,040 --> 00:09:04,360
Grok to two versions after or 
even a version after, we might 

145
00:09:04,360 --> 00:09:07,680
see that on GitHub as well. 
I'm an open source proponent. 

146
00:09:07,680 --> 00:09:12,400
I've used it for thousands of 
development jobs in the past and

147
00:09:12,680 --> 00:09:17,960
still doing that now. 
So I think this is a great move 

148
00:09:17,960 --> 00:09:20,120
by X AI. 
Let me know what you think in 

149
00:09:20,120 --> 00:09:22,800
the comments and I'll see you in
the next one. 

150
00:09:23,480 --> 00:09:25,200
Hey, thank you so much for 
listening today. 

151
00:09:25,200 --> 00:09:27,240
I really do appreciate your 
support. 

152
00:09:27,240 --> 00:09:30,040
If you could take a second and 
hit the subscribe or the follow 

153
00:09:30,040 --> 00:09:32,240
button on whatever podcast 
platform that you're listening 

154
00:09:32,240 --> 00:09:34,920
on right now, I greatly 
appreciate it. 

155
00:09:34,920 --> 00:09:37,600
It helps out the show 
tremendously and you'll never 

156
00:09:37,600 --> 00:09:40,560
miss an episode. 
And each episode is about 10 

157
00:09:40,560 --> 00:09:43,160
minutes or less to get you 
caught up quickly. 

158
00:09:43,560 --> 00:09:46,320
And please, if you want to 
support the show even more, go 

159
00:09:46,320 --> 00:09:51,960
to patreon.com/stagezero and 
please take care of yourselves 

160
00:09:51,960 --> 00:09:53,880
and each other and I'll see you 
tomorrow.

